Intel’s AI camera to let people in wheelchairs get around using facial expressions
A funny thing happens, said Hoobox Robotics CEO Paulo Gurgel Pinheiro when people start to use Wheelie, an AI system that translates facial expressions into movements for motorized wheelchairs.
“The facial expression to move forward is a kiss so when the users perform a [first] kiss, their wheelchair starts to move forward, and they feel so happy that they start to smile, but a smile is to stop the wheelchair, and so the wheelchair stops,” he said.
The Wheelie kit uses the Intel RealSense 3D camera to add facial expression control to any motorized wheelchair was first conceived in research by Pinheiro and others at a university in Brazil. Today trials are underway for an initial batch of 60 users in the United States.
On average, Pinheiro said, user travel roughly half a mile a day and send more than 400 signals to the system.
Wheelie is made primarily for people who lack the ability to move their body below their face or neck, and can recognize up to 10 facial expressions like a wrinkled nose or brow, kiss, wink, or raised eyebrows.
Each user can decide which expression they like best to move forward, backward, right or left.
“Most of our users they like to use kiss to move forward because it’s a positive expression and it’s easy to remember. Most often them like to use tongue out to go backward,” he said. “But to stop, they prefer to use a smile, so it can be a shy smile, full smile, half smile, but most of the users, this is incredible. I don’t know why but they they like to use a smile to stop the wheelchair.”
Other wheelchairs have been made for people without the ability to move their body below their face or neck but have often involved the use of sensors applied to a person’s body.
The initial findings and plans for the future of Wheelie were shared today, International Day of Persons with Disabilities, and the first day of the NeurIPS conference in Montreal.
The facial expression recognition system and sensors to detect things like spasms and delirium are also being used in trials at Albert Einstein Hospital in São Paulo, Pinheiro said.
attempting to move beyond expression detection to get a better understanding of how a person actually feels.
“If you have a facial recognition system company right now, it’s not enough to only deal with facial recognition if you are not detecting human behaviors,” he said. “We believe that in the future, many medical device and a lot of healthcare applications will have some kind of facial recognition software to detect facial expressions and predict human behavior.”
In addition to use of the RealSense camera, Wheelie relies on OpenVINO computer vision toolkit and Core processors. Hoobox has received support from the Intel AI for Social Good initiative.
Created in April, the AI for Social Good initiative at Intel seeks out startups and projects to support that can make solutions for the betterment of humanity. Thus far the initiative has supported historical preservation efforts for the Great Wall of China, and is participating in a competition with Microsoft and Tencent to see who can most efficiently grow cucumbers in automated greenhouses.
“The National Spinal Cord Injury Statistics Center says there is approximately 288,000 people in the U.S. living with spinal cord injuries and about 17,700 new cases every year, and different studies have shown that physical mobility can have the largest impact the quality of life for people with these injuries, and they often rely on motorized wheelchairs or caregivers to move them around,” Intel AI for social good lead Anna Bethke told VentureBeat in a phone interview.
Hoobox isn’t alone in its use of artificial intelligence to enable people with disabilities to live more independent lives.
Automated wheelchairs made their debut this summer in Japan and Singapore, while Ming Liu from Hong Kong University and the IEEE Robotics and Automation Society is working on ways to modify existing motorized wheelchairs to travel in more rugged environments. Using a series of sensors and computer vision, Liu’s lab has made systems that can automatically climb stairs.
A number of startups and companies with backgrounds in robotics are also attempting to make exoskeletons to help people be more mobile.