Recently, a research team led by Professor Nataliya Kos'myna from MIT published a paper on the Ddog project. The research direction of this project is to use brain-computer interface to interact with the Boston Dynamics Spot quadruped robot, aiming to provide assistance to people with physical disabilities such as amyotrophic lateral sclerosis, cerebral palsy, and spinal cord injuries. The goal of this research is to improve the quality of life for these patients through innovative technologies that help them regain mobility and increase their autonomy and social participation. This research provides an important foundation and

This set of projects includes a BCI system called AttentivU, which is presented in the form of a pair of wireless glasses. The sensor is cleverly embedded in the frame and is used to measure people's electroencephalogram (EEG-brain activity) and eye. Electrographic (EOG-eye movement) signal.

The research is based on Brain Switch technology developed by the university, a real-time, closed-loop BCI system that enables instant, non-verbal communication between users and caregivers. Kos'myna's Ddog project uses the same technical framework and infrastructure as Brain Switch to further expand its application areas.

▍Ddog system only requires two iPhones and a pair of glasses

According to the National Organization for Rare Diseases, there are currently about 30,000 patients with amyotrophic lateral sclerosis (ALS) in the United States, with about 5,000 new cases every year. Additionally, approximately 1 million Americans have cerebral palsy, according to the Cerebral Palsy Guide.

Some people gradually lose the ability to walk, dress, talk, write and even breathe, but there are communication aids that can help them communicate with others, although most can only communicate with computers by looking at the device with their eyes. However, systems that allow users to interact with their surroundings are less common.

Ddog’s biggest advantage is its mobility. Spot has the ability to be completely autonomous, that is, it can perform tasks without human intervention under simple instructions.

Spot robot has good locomotion capabilities, and its four-legged design allows it to adapt to a variety of complex terrains, including up and down slopes and stairs, and can reach almost anywhere humans can reach. In addition, the robot's arm accessories add more practical functions to it, such as tasks such as carrying groceries, moving chairs, and delivering books or toys to users.

The system developed by MIT only requires two iPhones and a pair of glasses to run. The research team said the system does not require the use of sticky electrodes or backpacks, making it more convenient for daily use.

▍Ddog working principle analysis

When it first enters a patient's home to provide services, Spot must first build a 3D map of its environment. The first iPhone would ask users about their next action intentions, and users would just have to think about what they wanted and answer.

The second iPhone runs the local navigation map and controls Spot's robotic arm. By combining the iPhone's lidar data, the system can enhance Spot's perception capabilities. The two iPhones communicate with each other and track Spot's progress in completing tasks in real time.

The system developed by the MIT team can work both offline and online. The online version is equipped with a more advanced set of machine learning models and has been fine-tuned to provide more accurate services.

The above is the detailed content of What kind of sparks will be created when the MIT brain-computer interface is connected to Boston Dynamics Spot?. For more information, please follow other related articles on the PHP Chinese website!