News Article

LESA Team Develops Occupancy Detection With LEDs

Privacy-preserving time-of-flight sensing without cameras awarded US patent

Above: Future smart ceiling panels, each mounted with a single-pixel depth sensor. The red spots represent the position where the time-of-flight depth sensors are mounted and the dashed lined show the time-of-flight signals

A team of LESA faculty and graduate students from Rensselaer Polytechnic Institute and Boston University have been awarded a US Patent titled, 'Sensory Lighting System and Method for Characterizing an Illumination Space' describing how an LED lighting system can detect occupants' presence, location and pose without cameras.

"Every illuminated space has an optical 'fingerprint'," said LESA director Robert Karlicek, an inventor on the patent, as well as a professor in the department of Electrical, Computer and Systems Engineering at Rensselaer. "If nothing is moving within the space, then the distributions of light and colour in the space don't move.  Using a limited number of low cost sensors mounted on the ceiling, we can measure the optical fingerprint of any space and determine when and how things move within it."

The patented approach to privacy-preserving occupancy sensing uses technology called time-of-flight (ToF) sensing. ToF sensors-using light-return a reasonably accurate physical distance measurement, allowing one to map the space, and determine the location as well as height (sitting, standing, prone) of individuals and other objects in the room.

"Imagine a building management system in an environment such as a healthcare facility, office or retail space, warehouse, airport, or library that always knows where occupants are located as well as the kind of activity occurring, using information generated by the lighting system," Karlicek said. "This kind of data is needed to maximise building energy efficiency, improve security operations, and automatically create more comfortable environments for occupants. The patented technology developed at LESA promises to be more cost effective and accurate than many competing technologies."

Karlicek further noted that the privacy-preserving feature of the technology makes it very attractive for use in almost any setting, since cameras are not used and individuals cannot be recognised.  Perhaps most importantly, since most buildings already have lighting installed, the technology can piggy-back on existing infrastructure, once an LED lighting system is in place. 

"Time-of-flight sensing is very appealing for occupancy sensing in smart environments and Internet-of-things applications, since it's fairly robust to the ambient light in the room and the clothing of the participants.  The  sensors are also becoming very inexpensive.  We're excited about integrating time-of-flight into more advanced cognitive environments that can understand and react to the activities of their occupants," said computer vision expert, Richard Radke, who serves as LESA deputy Ddrector and who is also an inventor on the patent. Radke is a professor in the department of Electrical, Computer, and Systems Engineering at Rensselaer.

To further develop and demonstrate the new technology, LESA has created two prototype testbeds, the 'Smart Conference Room' operated at Rensselaer, and the 'Smart Hospital Room', located at the University of New Mexico.  The testbeds are dedicated to taking LED lighting to new levels of cost-effective data generation and control using only the properties of the light itself.

Ultimately, LESA's goal is to integrate the time-of-flight sensors along with other low-cost sensing technology, control software and machine learning capability, into the room's LED fixtures themselves.  "It is part of LESA's vision to create digitised illumination for new applications in lighting, healthcare, building management, horticulture and advanced 5G wireless communications platforms," Karlicek said.

Other co-inventors on this patent include professor of electrical and computer engineering Thomas Little and former graduate student, Pankil M. Butala, both from Boston University and former graduate student, Li Jia, from Rensselaer. 

AngelTech Live III: Join us on 12 April 2021!

AngelTech Live III will be broadcast on 12 April 2021, 10am BST, rebroadcast on 14 April (10am CTT) and 16 April (10am PST) and will feature online versions of the market-leading physical events: CS International and PIC International PLUS a brand new Silicon Semiconductor International Track!

Thanks to the great diversity of the semiconductor industry, we are always chasing new markets and developing a range of exciting technologies.

2021 is no different. Over the last few months interest in deep-UV LEDs has rocketed, due to its capability to disinfect and sanitise areas and combat Covid-19. We shall consider a roadmap for this device, along with technologies for boosting its output.

We shall also look at microLEDs, a display with many wonderful attributes, identifying processes for handling the mass transfer of tiny emitters that hold the key to commercialisation of this technology.

We shall also discuss electrification of transportation, underpinned by wide bandgap power electronics and supported by blue lasers that are ideal for processing copper.

Additional areas we will cover include the development of GaN ICs, to improve the reach of power electronics; the great strides that have been made with gallium oxide; and a look at new materials, such as cubic GaN and AlScN.

Having attracted 1500 delegates over the last 2 online summits, the 3rd event promises to be even bigger and better – with 3 interactive sessions over 1 day and will once again prove to be a key event across the semiconductor and photonic integrated circuits calendar.

So make sure you sign up today and discover the latest cutting edge developments across the compound semiconductor and integrated photonics value chain.



Search the news archive

To close this popup you can press escape or click the close icon.
Register - Step 1

You may choose to subscribe to the Compound Semiconductor Magazine, the Compound Semiconductor Newsletter, or both. You may also request additional information if required, before submitting your application.

Please subscribe me to:


You chose the industry type of "Other"

Please enter the industry that you work in:
Please enter the industry that you work in:
Live Event