Ultraleap and Prophesee  have joined up to develop a system using event sensors and hand tracking in AR devices.

The development utlises Ultraleap’s computer vision and ML models and Prophesee’s  GenX320 event-based Metavision sensors.

Reducing power consumption enables an always-on AR device that can track user’s hand interactions natively for longer.

The new Ultraleap models for event sensors are also more robust to adverse light conditions and have lower latency, empowering a new era of outdoor interaction capabilities.

IMG_0174-1024x666.jpeg

All of these features are provided with increased privacy as event sensors are not frame-based and capture only pixel movement information.

The GenX320 sensors from Prophesee deliver ‘always on’ capabilities, making them suitable for use in an event-based ML vision system for hand tracking in AR.

Together, these two technologies will enable robust and immersive interaction methods in a convenient glasses form factor that is required for market adoption in augmented reality.

“Hand interaction adds impressive value to augmented reality, not only by providing the most natural way to interact, but by expanding functionalities and making the control system more ergonomic,” says Ultraleap CEO Tom Carter. “The integration of advanced hand tracking features is a pivotal step towards more immersive and interactive experiences in AR. Event-based vision has the proven ability to add more performance and usability improvements to the current state of AR systems,” says Prophesee CEO Luca Verre.