For people who have suffered neurotrauma such as a stroke, everyday tasks can be extremely challenging because of decreased coordination and strength in one or both upper limbs. These problems have spurred the development of robotic devices to help enhance their abilities. However, the rigid nature of these assistive devices can be problematic, especially for more complex tasks like playing a musical instrument.
A first-of-its-kind robotic glove is lending a "hand" and providing hope to piano players who have suffered a disabling stroke. Developed by researchers from Florida Atlantic University's College of Engineering and Computer Science, the soft robotic hand exoskeleton uses artificial intelligence to improve hand dexterity.
Combining flexible tactile sensors, soft actuators and AI, this robotic glove is the first to "feel" the difference between correct and incorrect versions of the same song and to combine these features into a single hand exoskeleton.
"Playing the piano requires complex and highly skilled movements, and relearning tasks involves the restoration and retraining of specific movements or skills," said Erik Engeberg, Ph.D., senior author, a professor in FAU's Department of Ocean and Mechanical Engineering within the College of Engineering and Computer Science, and a member of the FAU Center for Complex Systems and Brain Sciences and the FAU Stiles-Nicholson Brain Institute. "Our robotic glove is composed of soft, flexible materials and sensors that provide gentle support and assistance to individuals to relearn and regain their motor abilities."
Researchers integrated special sensor arrays into each fingertip of the robotic glove. Unlike prior exoskeletons, this new technology provides precise force and guidance in recovering the fine finger movements required for piano playing. By monitoring and responding to users' movements, the robotic glove offers real-time feedback and adjustments, making it easier for them to grasp the correct movement techniques.
To demonstrate the robotic glove's capabilities, researchers programmed it to feel the difference between correct and incorrect versions of the well-known tune, "Mary Had a Little Lamb," played on the piano. To introduce variations in the performance, they created a pool of 12 different types of errors that could occur at the beginning or end of a note, or due to timing errors that were either premature or delayed, and that persisted for 0.1, 0.2 or 0.3 seconds. Ten different song variations consisted of three groups of three variations each, plus the correct song played with no errors.
To classify the song variations, Random Forest (RF), K-Nearest Neighbor (KNN) and Artificial Neural Network (ANN) algorithms were trained with data from the tactile sensors in the fingertips. Feeling the differences between correct and incorrect versions of the song was done with the robotic glove independently and while worn by a person. The accuracy of these algorithms was compared to classify the correct and incorrect song variations with and without the human subject.
Results of the study, published in the journal Frontiers in Robotics and AI, demonstrated that the ANN algorithm had the highest classification accuracy of 97.13 percent with the human subject and 94.60 percent without the human subject. The algorithm successfully determined the percentage error of a certain song as well as identified key presses that were out of time. These findings highlight the potential of the smart robotic glove to aid individuals who are disabled to relearn dexterous tasks like playing musical instruments.
Researchers designed the robotic glove using 3D printed polyvinyl acid stents and hydrogel casting to integrate five actuators into a single wearable device that conforms to the user's hand. The fabrication process is new, and the form factor could be customized to the unique anatomy of individual patients with the use of 3D scanning technology or CT scans.
"Our design is significantly simpler than most designs as all the actuators and sensors are combined into a single molding process," said Engeberg. "Importantly, although this study's application was for playing a song, the approach could be applied to myriad tasks of daily life and the device could facilitate intricate rehabilitation programs customized for each patient."
Clinicians could use the data to develop personalized action plans to pinpoint patient weaknesses, which may present themselves as sections of the song that are consistently played erroneously and can be used to determine which motor functions require improvement. As patients progress, more challenging songs could be prescribed by the rehabilitation team in a game-like progression to provide a customizable path to improvement.
"The technology developed by professor Engeberg and the research team is truly a gamechanger for individuals with neuromuscular disorders and reduced limb functionality," said Stella Batalama, Ph.D., dean of the FAU College of Engineering and Computer Science. "Although other soft robotic actuators have been used to play the piano; our robotic glove is the only one that has demonstrated the capability to 'feel' the difference between correct and incorrect versions of the same song."
Study co-authors are Maohua Lin, first author and a Ph.D. student; Rudy Paul, a graduate student; and Moaed Abd, Ph.D., a recent graduate; all from the FAU College of Engineering and Computer Science; James Jones, Boise State University; Darryl Dieujuste, a graduate research assistant, FAU College of Engineering and Computer Science; and Harvey Chim, M.D., a professor in the Division of Plastic and Reconstructive Surgery at the University of Florida.
This research was supported by the National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health (NIH), the National Institute of Aging of the NIH and the National Science Foundation. This research was supported in part by a seed grant from the FAU College of Engineering and Computer Science and the FAU Institute for Sensing and Embedded Network Systems Engineering (I-SENSE).
Read more:
Robotic glove that 'feels' lends a 'hand' to relearn playing piano after ... - Science Daily
- Brief: NVIDIA's venture arm invests in autonomous weeding startup Carbon Robotics - AgFunderNews - May 11th, 2024 [May 11th, 2024]
- 7 Robotics Stocks to Bet On for Reliable AI-Powered Returns - InvestorPlace - May 11th, 2024 [May 11th, 2024]
- NSF and USDA join forces to boost innovation in agricultural robotics - Future Farming - May 11th, 2024 [May 11th, 2024]
- Meet The Swiss Start-Up Taking On The Tech Giants In Robotics And AI - Forbes - May 11th, 2024 [May 11th, 2024]
- LimX Dynamics' W1 robot can stand, walk and roll on its hind 'legs' - Interesting Engineering - May 11th, 2024 [May 11th, 2024]
- Lear Corporation's acquisition showcases the industry's use of robotics and AI for efficiency and innovation - CBT Automotive News - May 11th, 2024 [May 11th, 2024]
- OMRON and NEURA Robotics Partner to Unveil New Cognitive Robot at Automate 2024 - Automation.com - May 11th, 2024 [May 11th, 2024]
- Community briefs: Ravenswood robotics at world championship, Bike to the Library Day - The Almanac Online - May 11th, 2024 [May 11th, 2024]
- JCHS Robotics shimes at VEX World Competition | Community News - The Tomahawk - May 11th, 2024 [May 11th, 2024]
- Carbon Robotics to Help Revolutionize Farming with AI, Using Investment from NVentures - Business Wire - May 11th, 2024 [May 11th, 2024]
- Nvidia's DrEureka outperforms humans in training robotics systems - VentureBeat - May 11th, 2024 [May 11th, 2024]
- Humanoid Robots: The Next-Generation Robotic Workforce - Tech Briefs - May 11th, 2024 [May 11th, 2024]
- PHOTOS Motiva helping fund Port Arthur ISD robotics and engineering - Port Arthur News - The Port Arthur News - May 11th, 2024 [May 11th, 2024]
- Kiwanis Club of Miami helps fund McMillan MS robotics team trip - Miami's Community Newspapers - May 11th, 2024 [May 11th, 2024]
- The Interplay Between Robotics and Artificial Intelligence in Manufacturing | RoboticsTomorrow - Robotics Tomorrow - May 11th, 2024 [May 11th, 2024]
- Doosan Robotics releases its longest reach cobots with PRIME SERIES - Robot Report - May 11th, 2024 [May 11th, 2024]
- KION North America and Fox Robotics Announce Non-Exclusive Strategic Partnership - Automation.com - May 11th, 2024 [May 11th, 2024]
- Ag tech startup Carbon Robotics lands Nvidia investment - The Business Journals - May 11th, 2024 [May 11th, 2024]
- Mars Robotics offers chance to drive Mars rover on Saturday - Butler Eagle - May 11th, 2024 [May 11th, 2024]
- Comparative analysis of robot-assisted language learning systems and human tutors in English conversation lessons - EurekAlert - May 11th, 2024 [May 11th, 2024]
- Valencia College to more than double students training in semiconductors, robotics and optics - The Business Journals - May 11th, 2024 [May 11th, 2024]
- DeepMind is experimenting with a nearly indestructible robot hand - New Scientist - May 11th, 2024 [May 11th, 2024]
- Five Things to Consider Before Adopting Robotics for Warehouse Automation - Automation.com - May 11th, 2024 [May 11th, 2024]
- Nvidia and Alphabet's Intrinsic aim to revolutionize next-gen robotics - VentureBeat - May 11th, 2024 [May 11th, 2024]
- NVIDIA and Alphabet's Intrinsic Put Next-Gen Robotics Within Grasp - Automation.com - May 11th, 2024 [May 11th, 2024]
- STEM robotics team celebrates 10 years and remembers hero who saved lives - Denver 7 Colorado News - May 11th, 2024 [May 11th, 2024]
- Zero-shot learning helps Intrinsic pave the future for robotics - FierceElectronics - May 11th, 2024 [May 11th, 2024]
- EN robotics team demonstrates real-world learning | News Sun | kpcnews.com - KPCnews.com - May 11th, 2024 [May 11th, 2024]
- Future Innovators Challenged to Design Nuclear Fission and Fusion Decommissioning Robots - Automation.com - May 11th, 2024 [May 11th, 2024]
- Meet Pepper and Bernard: The robots shaping AI research at SDSU - Daily Aztec - May 11th, 2024 [May 11th, 2024]
- Gene Haas Foundation Partner Hosts FIRST Robotics District Competitions - Kettering University - May 5th, 2024 [May 5th, 2024]
- NASA Showcases Innovations at the 2024 FIRST Robotics World Championships - NASA - May 5th, 2024 [May 5th, 2024]
- Robots are invading the San Carlos Branch Library - San Diego Community Newspaper Group - May 5th, 2024 [May 5th, 2024]
- Wyoming-Based Company Makes High-Tech Robots To Go Where Humans Don't Want To - Cowboy State Daily - May 5th, 2024 [May 5th, 2024]
- Anzu Robotics launches U.S.-based clone of DJI Mavic 3 - Robot Report - May 5th, 2024 [May 5th, 2024]
- Carnegie Mellon University's Robotics Institute begins developing drones to fight wildfires - CBS Pittsburgh - May 5th, 2024 [May 5th, 2024]
- 3 Robotics Stocks That Could Be Multibaggers in the Making: Spring Edition - MSN - May 5th, 2024 [May 5th, 2024]
- Hopkinton teams advance to Robotics World Championships - Hopkinton Independent - May 5th, 2024 [May 5th, 2024]
- "Big Cat Robotics" team from Wellsville returns from VRC World Championship - THE WELLSVILLE SUN - THE WELLSVILLE SUN - May 5th, 2024 [May 5th, 2024]
- PropStream-Sponsored Robotics Team Places in Competition - RisMedia.com - May 5th, 2024 [May 5th, 2024]
- Bellefontaine Robotics Team Travels to World Championship Peak of Ohio - peakofohio.com - May 5th, 2024 [May 5th, 2024]
- ASL Aviation Holdings Inks Deal with Reliable Robotics for 30 Aircraft Autonomy Systems - Business Wire - May 5th, 2024 [May 5th, 2024]
- Global Nano Robotics Market Projected to Surge to US$ 19.86 Billion by 2032: Healthcare Trends Catalyzing Nano ... - GlobeNewswire - May 5th, 2024 [May 5th, 2024]
- 'Afghan Dreamers' | Film about Afghan girls robotics team to be screened on May 15 - Piedmont Exedra - May 5th, 2024 [May 5th, 2024]
- 3 Robotics Stocks That Could Be Multibaggers in the Making: Spring Edition - InvestorPlace - May 5th, 2024 [May 5th, 2024]
- The Rise of the Navy Robots - Signal Magazine - May 5th, 2024 [May 5th, 2024]
- Elon Musk Keeps Talking About the Future of Robotics With Optimus, but This Phenomenal Growth Stock Has Already ... - The Motley Fool - May 5th, 2024 [May 5th, 2024]
- Robosen Robotics Teams Up with Hasbro to Debut the Worlds First Auto-Converting Decepticon Megatron! - aNb Media - May 5th, 2024 [May 5th, 2024]
- John P. Stevens Robotics Team Wins Excellence in Technology at Innovators Awards - TAPinto.net - May 5th, 2024 [May 5th, 2024]
- Nala Robotics and Re-Up partner to develop AI-powered robotic chef - Robotics and Automation News - May 5th, 2024 [May 5th, 2024]
- LCSD1 to Host Final Robotics Competition of the School Year Tomorrow - The Cheyenne Post - May 5th, 2024 [May 5th, 2024]
- GMV showcases its robotic inspection capabilities Robotics & Automation News - Robotics and Automation News - May 5th, 2024 [May 5th, 2024]
- Trine's armored robot finishes 4th in national combat - Trine University - May 5th, 2024 [May 5th, 2024]
- Female robotics founders discuss their journeys in the industry - Robot Report - May 5th, 2024 [May 5th, 2024]
- Hanwha Robotics, B-Robotics join hands on restaurant automation project - Aju Press - May 5th, 2024 [May 5th, 2024]
- Dishchii'bikoh Community School Robotics Team Heads to VEX World Championship - White Mountain Independent - May 5th, 2024 [May 5th, 2024]
- ETH unveils space-hopping robot for asteroid exploration - Robotics and Automation News - May 5th, 2024 [May 5th, 2024]
- Nickelytics and Starship release robots at UCLA and Utah universities - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- Next-Level Robotics: Enhancing Accuracy with Advanced Multisensory Interfaces - AZoRobotics - May 1st, 2024 [May 1st, 2024]
- Death of Lake Orion teen on robotics trip determined to be suicide, Houston police say - Detroit News - May 1st, 2024 [May 1st, 2024]
- Niqo Robotics Raises $9 Million In Funding Round Led By Brida Innovation Ventures: Report - Outlook India - May 1st, 2024 [May 1st, 2024]
- Mission to 'Holy Grail of Shipwrecks' Will Employ Robotics - USNI News - May 1st, 2024 [May 1st, 2024]
- Kiwibot acquires Auto Mobility Solutions Robotics & Automation News - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- Untethered soft actuators for soft standalone robotics - Nature.com - May 1st, 2024 [May 1st, 2024]
- Robotics in the restaurant industry are here to stay: Carlos Gazitua - Fox Business - May 1st, 2024 [May 1st, 2024]
- It's time for UK business to embrace robotics - Design Products & Applications - May 1st, 2024 [May 1st, 2024]
- Meet the `One Percenters' - The Top Ranked Robotics Group from Franklin - Franklin Observer - May 1st, 2024 [May 1st, 2024]
- Atlas, forefather of humanoid robots, gives way to next generation - Marketplace - May 1st, 2024 [May 1st, 2024]
- BlueBotics releases new version of its server fleet management software - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- U.S. manufacturers invested heavily in robotics in 2023, finds IFR - Robot Report - May 1st, 2024 [May 1st, 2024]
- This is a unique time: ARK Invests chief futurist tackles tech innovation from AI to robotics - CNBC - May 1st, 2024 [May 1st, 2024]
- U.S. Companies Invest Heavily in Robots - IFR Preliminary Results EMSNow - EMSNow - May 1st, 2024 [May 1st, 2024]
- MiR launches new autonomous mobile forklift-type robot - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- Rutland Area Robotics' IBOTS compete in FIRST World Championships finals for first time - Rutland Herald - May 1st, 2024 [May 1st, 2024]
- Micropsi Industries introduces new AI-vision software Robotics & Automation News - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- Robots on a Roll: The Future of Farming Is Here Now - Growing Produce - May 1st, 2024 [May 1st, 2024]
- Grand Force, Grand Forks' only FIRST Robotics team, returns from world championship with good memories - Grand Forks Herald - May 1st, 2024 [May 1st, 2024]
- Reston Robotics Team Wins National Competition At Tech Conference - Patch - May 1st, 2024 [May 1st, 2024]
- CapSen Robotics Introduces CapSen PiC 2.0 Bin-Picking Software - Supply and Demand Chain Executive - May 1st, 2024 [May 1st, 2024]
- Gecko Robotics and Al Masaood Energy Partner to Help ADNOC Gas Revolutionize Asset Operations and ... - Business Wire - May 1st, 2024 [May 1st, 2024]