Gesture recognition solution based on STMicroelectronics VL53L5CX Time-of-Flight sensor

Hedy · Dasenic Mar 04,2025 51

The solution P-NUCLEO-53L5A1 is designed to provide low-cost gesture recognition capabilities using Time-of-Flight (ToF) sensors and STM32 microcontrollers. It represents a highly robust and reliable alternative to camera imaging technology, as ToF sensors do not cause privacy issues or performance losses due to low light or non-reflective surfaces.

The sensor used in this design is the VL53L5CX Time-of-Flight sensor with a wide field of view and 8x8 multi-zone detection. The software provided for the gesture monitoring function runs on the STM32F401 MCU, which balances power consumption and processing performance and provides a large number of interfaces and integrated peripherals.

The target application range is very wide. The solution can be easily integrated into household appliances such as coffee machines, cooking plates and ovens, personal electronic devices such as laptops, tablets and AR/VR headsets, and other applications such as vending machines, public screens and elevators.

The VL53L5CX is an advanced Time-of-Flight (ToF) multi-zone ranging sensor that enhances ST's FlightSense product family. It integrates a SPAD array, a physical IR filter, and Diffractive Optical Elements (DOE) in a miniature reflowable package for optimal ranging performance with a variety of cover glass materials in a variety of ambient lighting conditions.

Multi-zone distance measurement is available in up to 8x8 zones with a 63° wide diagonal FoV, which can be reduced via software. Each zone of the VL53L5CX measures the distance to objects up to 4 meters at a maximum frequency of 60 Hz.

Thanks to ST's patented Histogram algorithm, the VL53L5CX is able to detect different objects within the FoV. The histogram also provides immunity to cover glass crosstalk beyond 60 cm.

The STM32 Nucleo board NUCLEO-F401RE microcontroller runs the STSW-IMG035 gesture recognition software, with an intuitive GUI and algorithms for tap, double-tap, and left and right swipe motion detection.

It provides users with an affordable and flexible way to try out new ideas and build prototypes with any STM32 microcontroller, choosing from various combinations of performance, power consumption, and features.

Complete application example for STM32F401 microcontrollers, demonstrating library integration in MCU projects, including VL53L5CX configuration and crosstalk calibration examples

Full solution gesture library on multiple Arm® Cortex® microcontroller units

Intuitive GUI for gesture recognition discovery

Multiple graphical widgets (gesture recognition, hand tracker, photo viewer, slideshow control, etc.)

Data logging for replay and debugging

▶Application scenario

▶Development board photo

▶Scheme diagram

Core technology advantages

VL53L5CX Time-of-Flight sensor

The first real-time native 8x8 multi-zone Time-of-Flight sensor with wide field of view, multi-target detection and distance measurement for each zone

STM32F401 series microcontrollers

The STM32F4 series MCUs represent an ideal balance between cost, power consumption and processing power for almost any application that benefits from gesture recognition capabilities.

Compliant with RoHS, CE, UKCA and China RoHS standards

Provide complete system software, including code examples and graphical user interface (GUI).

ST's patented Histogram algorithm