When someone pulls on a virtual reality headset, theyre ready to dive into a simulated world. They might be hanging out in VRChat or slashing beats in Beat Saber. Regardless, interacting with that world usually involves hand controllers. But new virtual reality or VR technology out of Australia is hands-free. Facial expressions allow users to interact with the virtual environment.
This setup could make virtual worlds more accessible to people who cant use their hands, says Arindam Dey. He studies human-computer interaction at the University of Queensland in Brisbane. Other hands-free VR tech has let people move through virtual worlds by using treadmills and eye-trackers. But not all people can walk on a treadmill. And most people find it a challenge to stare at one spot long enough for the VR system to register the action. Simply making faces may be an easier way for those who are disabled to navigate VR.
Facial expressions could enhance the VR experience for people who can use hand controllers, too, Dey adds. They can allow special interactions that we do with our faces, such as smiling, kissing and blowing bubbles.
Deys team shared its findings in the April International Journal of Human Computer Studies.
Weekly updates to help you use Science News for Students in the learning environment
Thank you for signing up!
There was a problem signing you up.
In the researchers new system, VR users wear a cap studded with sensors. Those sensors record brain activity. The sensors can also pick up facial movements that signal certain expressions. Facial data can then be used to control the users movement through a virtual world.
Facial expressions usually signal emotions. So Deys team designed three virtual environments for users to explore. An environment called happy required participants to catch butterflies with a virtual net. Neutral had them picking up items in a workshop. And in the scary one, they had to shoot zombies. These environments allowed the researchers to see whether situations designed to provoke certain emotions affected someones ability to control VR through expressions.
Eighteen young adults tested out the technology. Half of them learned to use three facial expressions to move through the virtual worlds. A smile walked them forward. A frown brought them to a stop. And to perform a task, they clenched their teeth. In the happy world, that task was swooping a net. In the neutral environment, it was picking up an item. In the scary world, it was shooting a zombie.
The other half of participants interacted with the virtual worlds using hand controllers. This was the control group. It allowed the researchers to compare use of facial expressions with the more common form of VR interaction.
After some training, participants spent four minutes in each of the virtual worlds. After visiting each world, participants answered questions about their experience: How easy was their controller to use? How present did they feel in that world? How real did it seem? And so on.
Using facial expressions made participants feel more present inside the virtual worlds. But expressions were more challenging to use than hand controllers. Recordings from the sensor-laden cap showed that the brains of people using facial expressions were working harder than those who used hand controllers. But that could just be because these people were learning a new way to interact in VR. Perhaps the facial expression method would get easier with time. Importantly, virtual settings meant to trigger different emotions did not affect someones ability to control their VR using facial expressions.
This research pushes the boundary of hands-free interaction in VR, says Wenge Xu. He studies human-computer interactions at Birmingham City University in England. He was not involved with the study. Its novel and exciting, he says. But further research is needed to improve the usability of facial expressionbased input.
The researchers are planning more tests and improvements. For instance, everyone in this study was able-bodied. In the future, Dey hopes to test the tech with people who are disabled.
He also plans to explore ways to make interacting through facial expressions easier. That may involve swapping out the sensor-laden caps for some other face-reading technology. One idea: Use cameras that capture face movements or facial gestures, he says. Or sensors could be embedded in the foam cushion of a VR headset. Dey imagines one day people will train VR systems using their own sets of expressions.
Technology has helped me along the way [in a] world that wasnt necessarily made for me, says Tylia Flores. As a person with cerebral palsy, standard methods of interaction arent always available to her. She feels the new technology could make VR more accessible for people whose physical movements are limited.
More:
Facial expressions could be used to interact in virtual reality - Science News for Students
- Virtual Reality - Virtual Reality - December 9th, 2016 [December 9th, 2016]
- VR, Virtual Reality | Virtalis - December 11th, 2016 [December 11th, 2016]
- Road to VR - Virtual Reality News - December 13th, 2016 [December 13th, 2016]
- VR Porn, Exclusive Virtual Reality Sex Videos. WankzVR - December 19th, 2016 [December 19th, 2016]
- Immersion (virtual reality) - Wikipedia - December 22nd, 2016 [December 22nd, 2016]
- Virtual Reality - Setting the Record Straight One Post at ... - December 22nd, 2016 [December 22nd, 2016]
- NBA broadcasts games in virtual reality with NextVR ... - December 28th, 2016 [December 28th, 2016]
- Virtual Reality | Future | Fandom powered by Wikia - December 28th, 2016 [December 28th, 2016]
- Virtual reality, one year out: What went right, what didn't ... - December 28th, 2016 [December 28th, 2016]
- Virtual Reality Toronto - VRTO - Virtual Reality, Toronto - January 9th, 2017 [January 9th, 2017]
- Virtual Reality - January 24th, 2017 [January 24th, 2017]
- Virtual reality headset - Wikipedia - January 27th, 2017 [January 27th, 2017]
- Tribemix Virtual Reality for Dementia Care - YouTube - January 27th, 2017 [January 27th, 2017]
- Virtual Reality Has Arrived in the Art World. Now What? - New York Times - February 7th, 2017 [February 7th, 2017]
- Virtual Reality Experience College Swim Meet - SwimSwam - February 7th, 2017 [February 7th, 2017]
- Explore The Amazon With This Stunning 360 Virtual Reality Video - IFLScience - February 7th, 2017 [February 7th, 2017]
- Adobe's Path To Entering The Virtual Reality Story - Forbes - February 7th, 2017 [February 7th, 2017]
- Europe's virtual reality sector has grown to nearly 300 companies - VentureBeat - February 7th, 2017 [February 7th, 2017]
- Virtual reality to recount Maori life - Otago Daily Times - February 8th, 2017 [February 8th, 2017]
- John Wall: 'I really thought I was gonna die' - ESPN.co.uk - February 8th, 2017 [February 8th, 2017]
- Travel Brands and Meeting Planners Are Using Virtual Reality to Drive Conversion - Skift - February 8th, 2017 [February 8th, 2017]
- Sportsnet to launch 360 Virtual Reality for six NHL games - Sportsnet.ca - February 8th, 2017 [February 8th, 2017]
- In the burgeoning world of virtual reality, storytelling is both cutting-edge and old-fashioned - Los Angeles Times - February 8th, 2017 [February 8th, 2017]
- What parents need to know about virtual reality - Deseret News - February 8th, 2017 [February 8th, 2017]
- 8 Real Success Tips From Women Building The Future With Virtual Reality - Forbes - February 8th, 2017 [February 8th, 2017]
- Virtual reality: prepare for the revolution - AndroidPIT - February 9th, 2017 [February 9th, 2017]
- Prospects Dimming For Facebook's Oculus Rift Virtual-Reality Headsets - Investor's Business Daily - February 9th, 2017 [February 9th, 2017]
- WATCH: YouTube Stars Create Amazing La La Land-Inspired Virtual-Reality Music Video - PEOPLE.com - February 9th, 2017 [February 9th, 2017]
- Virtual Reality addiction threat prompts cautious approach as VR nears 'smartphone-like' take-off - ABC Online - February 9th, 2017 [February 9th, 2017]
- Archaeology turns to virtual reality with Lithodomos start-up - The Sydney Morning Herald - February 9th, 2017 [February 9th, 2017]
- The Future Of Virtual Reality: Mobile VR Platforms In A Battle - Forbes - February 9th, 2017 [February 9th, 2017]
- Virtual reality is boring compared to Beyonc's actual reality - A.V. Club (blog) - February 9th, 2017 [February 9th, 2017]
- Google wants to use Chrome to suck you into virtual reality - CNET - February 9th, 2017 [February 9th, 2017]
- Ringling showcase offers glimpse of virtual reality in Sarasota - Sarasota Herald-Tribune - February 11th, 2017 [February 11th, 2017]
- Allegheny County teachers see how to open world to classrooms with virtual reality - Tribune-Review - February 11th, 2017 [February 11th, 2017]
- Virtual Reality Could Be Your Next Prescription - DesignNews - February 11th, 2017 [February 11th, 2017]
- DACC & Virgin Galactic team up to explore virtual reality - Las Cruces Sun-News - February 11th, 2017 [February 11th, 2017]
- Boulder International Film Festival diving into virtual reality with 2017 slate - Boulder Daily Camera - February 11th, 2017 [February 11th, 2017]
- 'JAEPO 2017' Shows That Japanese Arcade Gaming Is Beginning To Incorporate Virtual Reality - Forbes - February 11th, 2017 [February 11th, 2017]
- Wichita-created virtual reality could take jurors into crime scenes ... - Wichita Eagle - February 11th, 2017 [February 11th, 2017]
- Why this analyst is warning investors to steer clear of virtual reality in 2017 - L.A. Biz - February 12th, 2017 [February 12th, 2017]
- See the Newcastle virtual reality room helping children with autism overcome their phobias - ChronicleLive - February 12th, 2017 [February 12th, 2017]
- See This Famous Masterpiece Recreated in Virtual Reality - UploadVR - February 12th, 2017 [February 12th, 2017]
- Samsung Goes for a New Look in Virtual Reality at New York Fashion Week - Fortune - February 14th, 2017 [February 14th, 2017]
- Virtual reality has a growing impact on college football - FOXSports.com - February 14th, 2017 [February 14th, 2017]
- This company is opening a virtual reality multiplex this fall - Mashable - February 14th, 2017 [February 14th, 2017]
- Personalized virtual reality displays match eyesight | Stanford News - Stanford University News - February 14th, 2017 [February 14th, 2017]
- Virtual reality weather add-ons let you feel the sun and wind - New Scientist - February 14th, 2017 [February 14th, 2017]
- Virtual reality is still too isolating to be 'the next big thing' in tech - CBC.ca - February 14th, 2017 [February 14th, 2017]
- Miyamoto Still Has Doubts About Virtual Reality - GameSpot - February 14th, 2017 [February 14th, 2017]
- Virtual reality industry 'in need of a jump-start,' Imax CEO says at ... - Los Angeles Times - February 16th, 2017 [February 16th, 2017]
- Doctors use virtual reality to prepare children for scans - BBC News - February 16th, 2017 [February 16th, 2017]
- Gamers get a taste of virtual reality with new Missoula arcade - KTVH - February 16th, 2017 [February 16th, 2017]
- Revised orca shows, new virtual-reality swim with whales and new ... - Los Angeles Times - February 16th, 2017 [February 16th, 2017]
- Transcend VR Sues Virtual-Reality Investor Mike Rothenberg - Wall Street Journal (subscription) - February 16th, 2017 [February 16th, 2017]
- This Powerful Gaming Executive Isn't Worried If Virtual Reality Fails - Fortune - February 16th, 2017 [February 16th, 2017]
- Virtual reality helps visitors transport back in time to ancient Roman ... - CBS News - February 16th, 2017 [February 16th, 2017]
- Boise-area entrepreneurs see opportunity in virtual reality amid real-world perils - Idaho Statesman - February 17th, 2017 [February 17th, 2017]
- 3D printing, virtual reality used to bring dinosaur to 'life' - The Hindu - February 17th, 2017 [February 17th, 2017]
- Virtual reality startup Relax VR wants to relieve stress in corporate environments - ZDNet - February 17th, 2017 [February 17th, 2017]
- Escape with Virtual Reality, travelogue at Way - Sentinel-Tribune - February 18th, 2017 [February 18th, 2017]
- VR1: Idaho's first virtual reality arcade opens in Eagle - KBOI-TV - February 18th, 2017 [February 18th, 2017]
- NBA launches virtual reality app with Google Daydream - USA TODAY - February 18th, 2017 [February 18th, 2017]
- Virtual Reality Is Bringing These Lost Worlds Back to Life - NBCNews.com - February 18th, 2017 [February 18th, 2017]
- Now You Can Feel Wind and Temperature While in Virtual Reality - Futurism - February 18th, 2017 [February 18th, 2017]
- IMAX's first virtual reality arcade is here and it is beautiful - The Verge - The Verge - February 18th, 2017 [February 18th, 2017]
- VR Sales Numbers Are Wet Blanket on Adoption Hopes - Fortune - February 20th, 2017 [February 20th, 2017]
- Virtual Reality to Make MRIs Less Scary - Financial Tribune - February 20th, 2017 [February 20th, 2017]
- How Valve is Taking a Nintendo-like Approach to Virtual Reality - UploadVR - February 20th, 2017 [February 20th, 2017]
- Inside an IMAX virtual reality arcade - VentureBeat - February 20th, 2017 [February 20th, 2017]
- With New Invention, Virtual Reality's Potential for Magic Gets Real - New York Times - February 20th, 2017 [February 20th, 2017]
- What Ubisoft learned from its first virtual reality games - VentureBeat - February 20th, 2017 [February 20th, 2017]
- Virtual Reality Was a Flop in 2016. Will 2017 Be the Year It Takes Off? - Motley Fool - February 20th, 2017 [February 20th, 2017]
- Virtual reality to take a decade as users chicken out, study shows - The Australian Financial Review - February 20th, 2017 [February 20th, 2017]
- Virtual reality is making surgery simpler - Deniz Ergurel (subscription) (blog) - February 20th, 2017 [February 20th, 2017]
- Virtual reality has potential to add new dimensions to marketing - Business Day (registration) - February 21st, 2017 [February 21st, 2017]
- Virtual reality will take 'maybe a decade' to become mainstream - Mashable - February 21st, 2017 [February 21st, 2017]
- #MadeInRVAJr: Hanover siblings want to bring virtual reality to your event - WRIC - February 22nd, 2017 [February 22nd, 2017]
- Making Virtual Reality More Accessible - VideoInk - February 22nd, 2017 [February 22nd, 2017]
- New virtual reality lounge opening in the Capital Region - NEWS10 ABC - February 22nd, 2017 [February 22nd, 2017]