The system combines a flexible electronic-skin patch based on triboelectric materials with a multilayer artificial-intelligence model. The patch records mouth movements without requiring spoken sound, while the model interprets the signals as silent speech.
A self-powered patch read silent speech and controlled games and avatars
The flexible patch recognized 15 silent-speech categories and was used for visual, gaming and virtual-reality communication tools.

What the patch recognized
The researchers characterized the patch’s structure and electrical performance and compared mouth movements during spoken and silent speech. They reported strong similarities between the two types of movement in their timing and frequency patterns. A model trained on 15 word categories, with 200 samples per category, reached a reported accuracy of 98.75%. The team also demonstrated three applications: real-time visualization of silent speech, an orofacial-controlled version of the game “Feeding Frenzy,” and a virtual-reality communication platform in which avatars could hold dialogues.
Why silent speech matters
The patch offers a hands-free approach to communication that does not depend on producing an audible voice. The researchers say it could support communication for people with laryngeal or lingual impairments, as well as human–machine interfaces, assistive communication systems, virtual-reality communication and biomedical rehabilitation.
Evidence and open questions
This is a journal research article reporting sensor characterization, a comparison of spoken and silent mouth movements, machine-learning classification and demonstrations of three applications. The abstract does not give the number of participants, explain how training and testing samples were separated, or report performance outside the 15 categories used for training. It also does not establish how well the system would work across different users, environments or longer conversations.
// Source
Nano-Micro Letters · 2026 · DOI: 10.1007/s40820-026-02346-x
Authors: Ziwei Huo, Nuo Xu, Yixuan Fu, Rui Gu, Chao Liu, Zhong Lin Wang, Qijun Sun
Institutions: University of Chinese Academy of Sciences, Georgia Institute of Technology, Beijing Institute of Nanoenergy and Nanosystems


