One implant decodes speech and gesture at the same time

Nature Neuroscience — peer-reviewed, two participants — A study published in Nature Neuroscience on 14 Sep 2026 decoded speech and upper-body gesture simultaneously from one implant, driving a personalised avatar in real time. One participant, paralysed by a brainstem stroke, silently attempted five phrases alongside movements — waving, nodding, shaking hands, clapping. A second, with ALS, vocalised ten phrases while imagining ten gestures, holding still apart from facial muscles. The finding underneath is that simultaneous expression is not the sum of its parts: neural activity during combined speech-and-gesture differs from either alone, and decoders trained on simultaneous data outperformed ones trained on the isolated kind. Two participants, peer-reviewed — which is the bar this field has often skipped.