NEC announced today the development of an interactive technology that allows the control of information through a combination of user gestures and the display of images from a projector. The newly-developed technology is controlled through the combination of a movable camera, which measures and recognizes three-dimensional shapes, and a compact image projector. In addition to enabling the gesture-based control of information between devices, without the use of an input device such as a remote control or mouse, images that facilitate input, such as a keyboard image, can be flexibly displayed in a wide range of locations. This results in natural interactions that are intuitive and allow users to easily see the effect of their actions.
A camera that measures three-dimensional shapes is used to recognize the movement and shape of the hands and fingers as control input. This means that tasks such as the movement of data between terminals and the control of devices can be performed without the use of an input device. The movable measurement camera and projector are controlled in an integrated fashion. As a result, high-precision input and images can be projected while tracking a user’s gesture-based movements over a wide range.
Additionally, the locations of multiple distant devices can be specified to enable control. With the recent expansion of cloud-based services, information terminals have become increasingly diversified, ranging from PCs to smartphones and tablet devices. Using this technology, multiple devices can be controlled based on a user’s movements, without the use of an input device, producing interfaces that boast more natural interaction.