ManoMotion to capture hand gestures for VR using single smartphone camera

June 12, 2017, 3:43 p.m. By: Pranjal Kumar


One of the biggest drawbacks of VR is that it looks good in the headset but as soon as you use your hands, the illusion breaks. This is where Manomotion has decided to improve the VR technology.

They have created a way to inject your hands and the gestures you make into animated images or scene. The best thing about this is that it will happen in real time and the technology is cost effective.

The company has released a software development kit that will help the developers to incorporate the hand gestures into animated application for VR, mixed reality and even AR.

This technology only requires single camera from your smartphone to detect the hand gestures.

The CEO of Stockholm, Daniel Carlman already demonstrated the technology where he used his hand gestures along with the animation built with Unity game engine.

He said,” The VR technology will develop in future. We will need to integrate voice command, gestures and eye tracking in VR technology.”

The company’s 3D gesture recognition technology tracks about 27 degrees of freedom of motion in a hand. It can also track depth. The device could also handle dynamic gestures like swipe, tap, click. This device only a CPU, memory, and a battery. The latency in the detection is around 10 milliseconds.

According to the researchers, this device uses only 30% of the processing power of iPhone 6s. Compared to this LeapMotion uses 3D sensors and HTC Vive for its operation. This makes the device very expensive and also its end result is much less than that of Manomotion.

Manomotion is offering the SDK in a freemium model. With the help of this, you will be able to move objects in VR world. The technology offers a centimeter precision.

Manonmotion supports both Android and iOS platform and comes with a Unity plugin.

Image Source: VentureBeat