ARM and eyeSight have gotten together to bring better gesture support for ARM Mali GPU based devices. As a result of the partnership between the two companies, eyeSight’s gesture technology will come incorporated into Mali T600 GPUs. The improved efficiency of gesture computation will help improve face and emotion detection, long distance finger tracking, and even 3D motion recognition (such as finger pointing for selection).
The ARM Mali T600 GPU Compute optimized engine from eyeSight will help developers make use of the better gesture support in mobiles, tablets and TVs and a range of other devices. Smartphones or tablets that come equipped with ARM Mali GPUs and eyeSight’s gesture solution will allow users to control user interfaces (UIs) and content such as music and movies, to activate usability applications, play games, or to browse menus with easy yet powerful hand and fingertip-level gestures.With eyeSight’s technology, Mali GPUs can help the smartphone or tablet recognize a rich language of gestures including directional gestures, (such as up, right, wave, etc.), hand signs (such as a ‘thumbs-up’), and tracking of hands and even fingertips, (for mouse-cursor-accuracy).
The reason for the current inefficient gesture solution is that the low-quality video taken under low light conditions make a lot of compromise on the gesture recognition. With eyeSight’s improved gesture recognition, Mali GPU’s take away the gesture recognition load away from the CPU. Along with the improved gesture recognition, eyeSight’s pre-processing video technology between the camera and gesture control helps clean up the image and helps the GPU clearly recognize the gestures despite poor lighting.
Are gesture based devices the future of smart devices? We will have to wait to see the fruits of the collaboration between eyeSight and ARM.