Engineers combine AI and wearable cameras in self-walking robotic legs
Someone using an exoskeleton leg capable of thinking and moving on its own using sophisticated artificial intelligence technology approaches a stairs
Credit: University of Waterloo
Robotics researchers are developing exoskeletons and prosthetic legs capable of thinking and moving on their own using sophisticated artificial intelligence (AI) technology.
The system combines computer vision and deep-learning AI to mimic how able-bodied people walk by seeing their surroundings and adjusting their movements.
“We’re giving robotic legs vision so they can control themselves,” said Brokoslaw Laschowski, a PhD candidate in systems design engineering who leads a University of Waterloo research project called ExoNet.
Exoskeletons and prosthetic devices operated by motors already exist, but users must manually control them via smartphone applications.
“That can be inconvenient and cognitively demanding,” said Laschowski, a student member of the Waterloo Artificial Intelligence Institute (Waterloo.ai). “Every time you want to perform a new locomotor activity, you have to stop, take out your smartphone and select the desired mode.”
To address that limitation, the researchers fitted exoskeleton users with wearable cameras and are now optimizing computer software to process the video feed to accurately recognize stairs, doors and other features of the surrounding environment.
The next phase of the ExoNet project will involve sending instructions to motors so that robotic legs can climb stairs, avoid obstacles or take other appropriate actions based on analysis of the user’s current movement and the upcoming terrain.
“Our control approach wouldn’t necessarily require human thought,” said Laschowski, who is supervised by engineering professor John McPhee, the Canada Research Chair in Biomechatronic System Dynamics. “Similar to autonomous cars that drive themselves, we’re designing autonomous exoskeletons and prosthetic legs that walk for themselves.”
The researchers are also working to improve the energy efficiency of motors for robotic exoskeletons and prostheses by using human motion to self-charge batteries.
###
The latest in a series of papers on the related projects, Simulation of Stand-to-Sit Biomechanics for Robotic Exoskeletons and Prostheses with Energy Regeneration, appears in the journal IEEE Transactions on Medical Robotics and Bionics.
The research team also includes engineering professor Alexander Wong, the Canada Research Chair in Artificial Intelligence and Medical Imaging, and William McNally, also a PhD candidate in systems design engineering and a student member of Waterloo.ai.
All latest news from the category: Information Technology
Here you can find a summary of innovations in the fields of information and data processing and up-to-date developments on IT equipment and hardware.
This area covers topics such as IT services, IT architectures, IT management and telecommunications.
Newest articles
How marine worms regenerate lost body parts
The return of cells to a stem cell-like state as the key to regeneration. Many living organisms are able to regenerate damaged or lost tissue, but why some are particularly…
Nano-scale molecular detective
New on-chip device uses exotic light rays in 2D material to detect molecules. Researchers have developed a highly sensitive detector for identifying molecules via their infrared vibrational “fingerprint”. Published in Nature…
Novel CAR T-cell therapy
… demonstrates efficacy and safety in preclinical models of HER2-positive solid tumors. The p95HER2 protein is found expressed in one third of HER2+ tumors, which represent 4% of all tumors….