“It relies on a depth sensor that tracks movements of the thumb and index finger on and above the back of the hand. In this way, not only can smartwatches be controlled, but also smartphones, smart TVs and devices for augmented and virtual reality. They’re called the “Apple Watch Series 2”, “LG Watch”, “Samsung GEAR S3” or “Moto 360 2nd Gen” but they all have the same problem. “Every new product generation has better screens, better processors, better cameras, and new sensors, but regarding input, the limitations remain,” explains Srinath Sridhar, a researcher in the Graphics, Vision and Video group at the Max Planck Institute for Informatics. Together with Christian Theobalt, head of the Graphics, Vision and Video group at MPI, Anders Markussen and Sebastian Boring at the University of Copenhagen and Antti Oulasvirta at Aalto University in Finland, Srinath Sridhar has therefore developed an input method that requires only a small camera to track fingertips in mid-air, and touch and position of the fingers on the back of the hand. This combination enables more expressive interactions than any previous sensing technique. Regarding hardware, the prototype, which the researchers have named “WatchSense”, requires only a depth sensor, a much smaller version of the well-known “Kinect” game controller from the Xbox 360 video game console. With WatchSense, the depth sensor is worn on the user’s forearm, about 20cm from the watch. As a sort of 3D camera, it captures the movements of the thumb and index finger, not only on the back of the hand but also in the space over and above it. The software developed by the researchers recognizes the position and movement of the fingers within the 3D image, allowing the user to control apps on smartphones or other devices. “The currently available depth sensors do not fit inside a smartwatch, but from the trend it’s clear that in the near future, smaller depth sensors will be integrated into smartwatches,” Sridhar says.”
Related Content
Related Posts:
- The making of a quantum movie
- Intense lasers shine new light on the electron dynamics of liquids
- Electricity driving life
- Pills from the 3D printer
- An impossible planet?
- A new access to the universe
- Metal trees in the battery
- Jellyfish-like robots could one day clean up the world’s oceans
- Stalactites and stalagmites in the battery?
- Creating 3D objects with sound