Mitsubishi Electric today announced the development of world’s first technology combining voice-recognition and drawing functions to enable users to display their spoken words on a tablet or smartphone by simply dragging their finger across the screen. The new technology can be combined with a picture-drawing function to create illustrations, maps and other graphics augmented with text, enabling richer expressiveness and enhanced understanding. The addition of multilingual translation would enable displayed words to be translated for face-to-face communication with speakers of other languages.
People with hearing disabilities cannot watch the speakers’ mouth and hand movements simultaneously, making it difficult to understand a conversation involving spoken words and hand movements. Mitsubishi Electric’s new technology allows a listener with a hearing disability to continue looking at the screen while the speaker talks and gestures with their hands.
With multilingual translation:-Words displayed on the screen can be translated into other languages and then read out automatically.
With background images:- Stored images displayed on a screen can be overlaid with text of the speaker’s words to explain the content of the images more clearly.
Handwriting recognition:-When the screen is tapped twice, the system analyzes the handwritten input and read out the written words, or translates them into a different language, allowing foreigners to easily communicate with people who are hard of hearing or people in noisy environments to communicate with others.
Split-screen display:-The screen can be split into two sections so that people facing each other can converse without having to rotate the device back and forth, for example, at a reception counter.
