Monkeys Drive Robotic Wheelchairs Just by Thinking

In an amazing study that will likely have profound implications for wheelchair-bound people, Duke Health neuroscientists have developed a brain-machine interface (BMI) that enables monkeys to drive a robotic wheelchair using just their thoughts. The researchers were able to help the monkeys learn how to navigate their wheelchairs to a goal after implanting hundreds of hair-thin electrodes in their brains and then training a computer system to translate the monkeys thought signals into directional movement for the wheelchair.

A fascinating news release on the Science Daily website delves into the incredible details and results:

The BMI uses signals from hundreds of neurons recorded simultaneously in two regions of the monkeys’ brains that are involved in movement and sensation. As the animals think about moving toward their goal — in this case, a bowl containing fresh grapes — computers translate their brain activity into real-time operation of the wheelchair.

The interface, described in the March 3 issue of the online journal Scientific Reports, demonstrates the future potential for people with disabilities who have lost most muscle control and mobility due to quadriplegia or ALS, said senior author Miguel Nicolelis, M.D., Ph.D., co-director for the Duke Center for Neuroengineering.

“In some severely disabled people, even blinking is not possible,” Nicolelis said. “For them, using a wheelchair or device controlled by noninvasive measures like an EEG (a device that monitors brain waves through electrodes on the scalp) may not be sufficient. We show clearly that if you have intracranial implants, you get better control of a wheelchair than with noninvasive devices.”

Scientists began the experiments in 2012, implanting hundreds of hair-thin microfilaments in the premotor and somatosensory regions of the brains of two rhesus macaques. They trained the animals by passively navigating the chair toward their goal, the bowl containing grapes. During this training phase, the scientists recorded the primates’ large-scale electrical brain activity. The researchers then programmed a computer system to translate brain signals into digital motor commands that controlled the movements of the wheelchair.

As the monkeys learned to control the wheelchair just by thinking, they became more efficient at navigating toward the grapes and completed the trials faster, Nicolelis said.

In addition to observing brain signals that corresponded to translational and rotational movement, the Duke team also discovered that primates’ brain signals showed signs they were contemplating their distance to the bowl of grapes.

“This was not a signal that was present in the beginning of the training, but something that emerged as an effect of the monkeys becoming proficient in this task,” Nicolelis said. “This was a surprise. It demonstrates the brain’s enormous flexibility to assimilate a device, in this case a wheelchair, and that device’s spatial relationships to the surrounding world.”

The trials measured the activity of nearly 300 neurons in each of the two monkeys. The Nicolelis lab previously reported the ability to record up to 2,000 neurons using the same technique. The team now hopes to expand the experiment by recording more neuronal signals to continue to increase the accuracy and fidelity of the primate BMI before seeking trials for an implanted device in humans, he said.

In addition to Nicolelis, study authors include Sankaranarayani Rajangam; Po-He Tseng; Allen Yin; Gary Lehew; David Schwarz; and Mikhail A. Lebedev.

The National Institutes of Health (DP1MH099903) funded this study. The Itau Bank of Brazil provided research support to the study as part of the Walk Again Project, an international non-profit consortium aimed at developing new assistive technologies for severely paralyzed patients.

The study was published in Scientific Reports, and the infographic below shows the methodology of the work:

monkey-wheelchair-driving
(A) The mobile robotic wheelchair, which seats a monkey, was moved from one of the three starting locations (dashed circles) to a grape dispenser. The wireless recording system records the spiking activities from the monkey’s head stage, and sends the activities to the wireless receiver to decode the wheelchair movement. (B) Schematic of the brain regions from which we recorded units tuned to either velocity or steering. Red dots correspond to units in M1, blue from PMd and green from the somatosensory cortex. (C) Three video frames show Monkey K drive toward the grape dispenser. The right panel shows the average driving trajectories (dark blue) from the three different starting locations (green circle) to the grape dispenser (red circle). The light blue ellipses are the standard deviation of the trajectories. Click/tap for larger image.

Sources: ScienceDaily.com – “Monkeys drive wheelchairs using only their thoughts“; Nature.com Scientific Reports: “Wireless Cortical Brain-Machine Interface for Whole-Body Navigation in Primates

Featured Image Credit: Shawn Rocco/ Duke Health

Now, Check Out: