Fingo VR Hand recognition

by uSens Inc.

How to use fingo

Fingo is a device that is added to any mobile device for the purpose of viweing inside out hand tracking in VR. The above illustration shows the fingo device on the back of a mobile device. This combination allows users to enjoy not only Mixed VR but also the use of hands in a digital environment.

Some of the features fingo does

Compatible with mobile phone

Free hand 3D interaction@>60fps, sub-mm accuracy

Head orientation + position tracking with > 5 meters movement range

LImmersive @>90 degrees viewing angle

See Your Hands in Virtual Reality

Unlock a whole new level of presence by using your hands in the virtual world – just like the real world. Reach out and see what you've been missing.

Core vision module with computer vision algorithm senses hand actions and gestures in 3D. The algorithm is highly optimized to perform well on mobile platforms, enabling gesture control on mobile VR devices. It's much more convenient than traditional inputs, as the users are able to interact with VR content in a natural manner, easily control the interface, take phone calls, etc, without needing to take off the headset.Core vision module with computer vision algorithm senses hand actions and gestures in 3D. The algorithm is highly optimized to perform well on mobile platforms, enabling gesture control on mobile VR devices. It's much more convenient than traditional inputs, as the users are able to interact with VR content in a natural manner, easily control the interface, take phone calls, etc, without needing to take off the headset.

VR Interactions

We create 3D Human-Computer Interaction solution for augmented and virtual reality. As a domain expert in 3D graphics, Computer Vision and Artificial Intelligence, uSens is one of the first companies to provide inside-out 3D hand tracking as well as 6DOF head position tracking for both mobile and tethered AR/VR systems, allowing end users to immerse themselves in what uSens calls “Super Reality,” the most naturally interactive digital experience.

Free hand interaction. 26 DOF (Degrees of Fredom) tracking is only some of the possibilities using Fingo and mobile devices.

Design Mockups

These were variations of the fingo device. Early mockups had particular designs and different functionalities. All these designs entered a 3D pringting face where we tested each device for resistance, materials, functionality and ease of comfort.

Final Render

Once the device was selected we went into full production. an Initial 500 units werer created for the chinese market where we are still testing and getting feedback from our users and learning how to improve our product

Final Product

Here is teh final product photo next to a coin. The product is small enough to be in the back of any VR HMD or even a cell phone

My Involvement

• Lead UX/UI Designer
• Product Designer
• Flow Charts
• Wireframes
• Prototyping
• Scoping features and planning
• Information Architecture
• CAD Prototyper
• CAD Designer
• User Testing

Project Overview

Fingo is the first mobile ARVR tracker in the market. Uses a combination of software and hardware in order to function inside the VR world.

The directives of the project were to design a simple, innovative and light enclose device to attach to any headset for VR wether it was mobile or tethered and to function exactly the same in both environments providing quality rendering as well as very little latency betwenn the camera projections and the rendering inside VR or AR

Details

First mobile ARVR hand tracking that reads 26 degrees of freedom, one of the first to provide head position tracking for mobile ARVR using RGB/SLAM as well as using IR with markers/objects/markerless.