A team at Tokyo University recently developed a device that translates in-air finger movement to input commands so that the device can be used without physically touching the screen. Unlike Sixth Sense, this system does not require surrounding sensors or finger markers. According to Gigazine in an article translated from the original Japanese, the device captures the finger movements with one 154 fps high-speed camera.
The development is definitely notable for not requiring additional sensors and markers, but in watching the demo it is also interesting to think about how gestures will evolve in a touchless system. The Sixth Sense demo showed Pranav Mistry tapping a phone interface projected on his hand. Even though it wasn’t technically necessary, he was still touching the physical surface of his hand. The Tokyo University demo interprets a traditional mouse click motion in air as a selection, which works for demonstration purposes but looks awkward and cumbersome in practice. As technology catches up with science fiction, it is time to figure out what gesture is a click.

One Response to "New Vision Based Mobile Interface"
The typing keyboard looks clumsy. I can see other applications being more useful. Like waving your hand in front of the screen and making the content move. Very interesting nonetheless.