A brain implant decoded speech and gestures to control a virtual avatar

People with paralysis used attempted speech and movements to control a personalized avatar, including both at once.

Editorial illustration — not from the study.

Researchers recorded brain signals with one high-density electrocorticography implant while three participants with paralysis attempted upper-limb and orofacial movements. These signals could be decoded reliably when the movements were performed separately.

The team then used separate speech and gesture decoders to let participants control a personalized virtual avatar. Participants could attempt speech and gestures simultaneously or in isolation, and training the decoders on both types of data improved performance across these situations.

Decoding speech and gestures

Signals from a single cortical implant supported decoding of isolated upper-limb and orofacial movements in three participants. Parallel decoders then enabled control of a personalized virtual avatar through attempted speech and gestures, either separately or simultaneously. Models trained with both isolated and simultaneous data performed better across the tested behavioral contexts.

Toward more natural communication

Speech and nonverbal gestures are both important for natural communication, but paralysis caused by stroke or neurodegenerative disease can affect both. The findings suggest that one cortical implant can support control of more than one type of communication-related movement, rather than requiring separate systems for speech and gestures.

Evidence and caveats

This was a research demonstration involving three participants, using neural signals recorded by a high-density electrocorticography implant and a virtual avatar. The abstract does not report detailed accuracy values, how long performance was sustained, or whether the system was tested in everyday communication. It also does not establish how well the approach would generalize to larger or different groups of people with paralysis.

Could leaves replace roots and bark in some medicinal plants?

A review of five medicinal plants finds evidence that leaves, young stems, small branches and fruits may sometimes replace roots, bark or heartwood as sources of similar plant chemicals. The authors say these substitutions could reduce destructive harvesting, but therapeutic and safety testing is still needed.

7 hours ago·2 views

Biology

LED lights and solid carbon dioxide raised winter cucumber income by 21%

Adding LED lighting and solid carbon dioxide generators to winter greenhouse cucumber production increased yield by 18% and income by 21% compared with the control. Plants also grew larger and produced wider, heavier fruit during the trial.

10 hours ago·2 views

Biology

Gunshot residue and brake dust show different chemical fingerprints

Gunshot residue and brake-pad dust can have overlapping elemental compositions, making them difficult to tell apart with standard testing alone. In a preliminary study, Raman spectroscopy identified differences between the two particle types and could complement existing analysis.

17 hours ago·6 views