Philips Azurion augmented-reality platform makes use of Microsofts HoloLens headsets to guide surgeons through an operation. (Philips Illustration)
Virtual reality? Augmented reality? Mixed reality? Today at a Seattle symposium, experts settled on extended reality, or XR, as the catch-all term for devices that put computer-generated visuals in front of your face. And they settled on health care as one of the most promising frontiers for XR.
I believe health care is going to drive the mass adoption of XR, Vinay Narayan, vice president of platform strategy and developer community at HTC Vive, said at XR Day, an event presented by the University of Washingtons Department of Human Centered Design and Engineering.
Why does Narayan believe that? He pointed out that health-care applications tend to be enterprise-level applications in a high-friction environment, where employees have to deal with loads of data as they make decisions. Health care is also an industry that touches everyone, amounting to $3.5 trillion in annual spending.
Narayan said thats an attractive frontier for technologies like XR, which can streamline operations and bring about better outcomes.
As an example, he pointed to the University of California at San Francisco, which is using HTC Vives VR system to teach medical students how to operate on virtual-reality patients.
Surgeons could soon be using XR to operate on real-reality patients as well. For example, Microsofts HoloLens team has been working with Philips on an image-guided therapy platform called Azurion. The mixed-reality system matches up a patients flesh-and-blood anatomy with a computer-generated model that uses X-ray and ultrasound imaging to guide surgeons through medical procedures.
The Food and Drug Administration has cleared HoloLens-based medical systems for use in pre-operative surgical planning, and HoloLens also figures in a Cleveland clinical trial aimed at guiding surgeons through procedures to treat tumors.
On Thursday, the FDA is planning a public workshop in Washington, D.C., to discuss best practices for virtual and augmented reality in medicine.
I think this is going to be really interesting, said Bernard Kress, partner optical architect on Microsofts HoloLens team.
During his time at Google X Labs, Kress played a leading role in the development of Google Glass, the camera-equipped smart glasses that sparked a sensation (and scorn) when they came out in 2014. The scorn eventually forced Google to phase out its mass-market Glass prototype, but the glasses live on as an enterprise product.
Kress said the optics of smart glasses and headsets have come a long way since then. Among the innovations on tap are light-field smart glasses that let users shift their focus from far to near as they take in an XR scene. Thats very important for surgical applications, Kress said.
Reducing the bulk of XR headsets, and designing the lenses so that other people can see the eyes of the wearer, will be particularly important for applications in the operating room. If you have an Oh My God moment, its really difficult to share this data with nurses. If you cant see the surgeons eyes, well, somethings really missing there, Kress said.
The design of XR environments will also have to be fine-tuned to suit the operating room rather than the gaming arcade. Designers should start to focus on making systems that are calm, smartly fading into the background, said Evie Powell, virtual reality engineer at Seattle-based Proprio.
Proprio is working on an XR platform that can guide a surgeon through an operative procedure, and let medical interns and other observers watch over the surgeons shoulder. Surgeons are able to quickly and precisely integrate their pre-operative plan, and perform the procedure entirely in XR, Powell said.
Perhaps the most important technology coming to the XR marketplace is eye-tracking, which opens the way to true hands-free interaction. You will see it in every single headset, Kress said.
Narayan agreed that eye-tracking is important, and not just for surgery. For example, its hard to imagine being able to work the controllers while youre swinging at virtual balls in MLB Home Run Derby VR. Thats why his company developed Vive Pro Eye, which adds gaze-oriented menu navigation and hands-free control to the game.
With eye-tracking, you stay in position, and actually cycle through the menus and take action with your eyes, Narayan said.
He said eye-tracking will usher in whole new types of applications, such as biometric scanning, identity verification and banking in XR.
The advent of 5G mobile communication networks is also likely to enhance wireless XR experiences. A true AR headset has all these different technologies that are built on top of that. Theres a challenge in building a good headset, Narayan said. What 5G allows you to do is decouple some of the complexities into the network.
XR devices could look a lot different once the next big wave of technology arrives, and perhaps the biggest challenge facing companies in the XR space is building the right surfboard for riding that wave. What were going to see three years from now is being worked on today, Narayan said.
See the rest here:
XR experts see health care as the killer app for VR, AR, MR or whatever you call it - GeekWire
- How good is fish for your diet? - November 8th, 2009 [November 8th, 2009]
- What foods have both fiber and protein? - November 8th, 2009 [November 8th, 2009]
- Is There Evidence That Acupuncture Works? - November 8th, 2009 [November 8th, 2009]
- What are some good fiber foods? - November 8th, 2009 [November 8th, 2009]
- Can Green Tea fight HIV infection? - November 8th, 2009 [November 8th, 2009]
- Quality of GNC Supplements - November 8th, 2009 [November 8th, 2009]
- The Gene Smart Diet - November 8th, 2009 [November 8th, 2009]
- Tips for eating in a vegetarian lifestyle - November 8th, 2009 [November 8th, 2009]
- Regarding the Starting of a new diet regimen - November 8th, 2009 [November 8th, 2009]
- Thoughts on Dropping Weight - November 8th, 2009 [November 8th, 2009]
- What do doctors think about vitamin E supplements? - November 8th, 2009 [November 8th, 2009]
- What herbs or supplements are commonly used for depression? - November 8th, 2009 [November 8th, 2009]
- Is there a safe way to lose a lot of weight? - November 8th, 2009 [November 8th, 2009]
- Diets that promise you will lose weight - November 8th, 2009 [November 8th, 2009]
- Are Fish Toxins Linked to Diabetes? - November 8th, 2009 [November 8th, 2009]
- Can Plastic Surgery Help Migraines? - November 8th, 2009 [November 8th, 2009]
- Weight Loss Surgery Eradicates Diabetes Symptoms - November 8th, 2009 [November 8th, 2009]
- Found: A Gene That Controls Fat Cells - November 8th, 2009 [November 8th, 2009]
- Sugars and Starches, what's the difference? - November 8th, 2009 [November 8th, 2009]
- Improving your health with a serving of nuts? - November 8th, 2009 [November 8th, 2009]
- Is Your Diet Causing You To Be Depressed? - December 13th, 2009 [December 13th, 2009]
- Placebo Effect: Magnetic Bracelet Therapy - December 13th, 2009 [December 13th, 2009]
- Does serotonin promote sleep? - December 13th, 2009 [December 13th, 2009]
- Decreased energy levels - Overeating, Sleep, Nutrition - February 1st, 2010 [February 1st, 2010]
- When will the body begin to cannibalize muscle tissue? - February 7th, 2010 [February 7th, 2010]
- Foods that are high in antioxidants - February 7th, 2010 [February 7th, 2010]
- Editorial: Reduce health care costs by cutting administrative overhead - April 1st, 2012 [April 1st, 2012]
- Health Care Winners: Centene, Onyxx - April 25th, 2012 [April 25th, 2012]
- Dan Morain: Nurses union puts politics ahead of health - April 25th, 2012 [April 25th, 2012]
- What's next if Obamacare falls? - April 25th, 2012 [April 25th, 2012]
- Global Managed Health Care Services Industry - April 25th, 2012 [April 25th, 2012]
- Immigration Fight Echoes Health-Care Case at High Court - April 25th, 2012 [April 25th, 2012]
- Medical Centers Lead Workplace Wellness Effort - April 25th, 2012 [April 25th, 2012]
- The next health care overhaul? Look to employers - April 25th, 2012 [April 25th, 2012]
- Capital BlueCross Hosts Community Health Care Forums Focused on Managing Costs While Maintaining Quality - April 25th, 2012 [April 25th, 2012]
- County committee to look at area health care - April 25th, 2012 [April 25th, 2012]
- President Obama Calls on Students to Tell Congress: #DontDoubleMyRate - Video - April 25th, 2012 [April 25th, 2012]
- Sen. Coburn: Competition in Health Care to Allocate Resources - Video - April 25th, 2012 [April 25th, 2012]
- Jesse Kelly health care - Video - April 25th, 2012 [April 25th, 2012]
- PHC Vision Statement (short version) - Video - April 30th, 2012 [April 30th, 2012]
- The Bioeconomy Blueprint Panel - Video - April 30th, 2012 [April 30th, 2012]
- Providence Health Care's Vision Statement - Video - April 30th, 2012 [April 30th, 2012]
- Department of Health and Human Services: Minority Health Blogger Townhall - Video - April 30th, 2012 [April 30th, 2012]
- Health care worker accused of stealing identities of brain i - Video - April 30th, 2012 [April 30th, 2012]
- Health Care Reform, Part 1 of 3 | KYVE Insiders Roundtable - Video - April 30th, 2012 [April 30th, 2012]
- Health Care Reform: The ACA and Beyond - Video - April 30th, 2012 [April 30th, 2012]
- Is Broccoli Like Health Insurance? - Video - April 30th, 2012 [April 30th, 2012]
- Did Obama make a mistake on health care? - Video - April 30th, 2012 [April 30th, 2012]
- How Democrats Lie About Health Care - Video - April 30th, 2012 [April 30th, 2012]
- Toobin on Health Care: This was a "judicial hissy-fit" - Video - April 30th, 2012 [April 30th, 2012]
- President Obama says health care law will stand - Video - April 30th, 2012 [April 30th, 2012]
- Obama Defends Health Care Law From 'Judicial Activism' - Video - April 30th, 2012 [April 30th, 2012]
- Obama Healthcare Individual Mandate - Video - April 30th, 2012 [April 30th, 2012]
- President Obama attacks Supreme Court on health care - Video - April 30th, 2012 [April 30th, 2012]
- Raw Audio: High Court Dissects Health Care Act - Video - April 30th, 2012 [April 30th, 2012]
- Health care on trial - Video - April 30th, 2012 [April 30th, 2012]
- Final Day of Health Care Law Arguments Before Supreme Court - Video - April 30th, 2012 [April 30th, 2012]
- Feds to put up $1.9B for Oregon health overhaul - May 4th, 2012 [May 4th, 2012]
- Scuttling health care act will freeze Medicare, White House warns - May 4th, 2012 [May 4th, 2012]
- U.S. Health Care Spending High, But Quality Lags: Report - May 4th, 2012 [May 4th, 2012]
- Yes, the Health-Care Mandate Is About Liberty - May 4th, 2012 [May 4th, 2012]
- Health center gets $1M federal grant - May 4th, 2012 [May 4th, 2012]
- Health-care reform panel considers exchange options for Va. - May 4th, 2012 [May 4th, 2012]
- Hmong health care gap focus of Healthy House dinner - May 4th, 2012 [May 4th, 2012]
- Walsh-led health bill to be unveiled - May 4th, 2012 [May 4th, 2012]
- Ontario health system confusing for ailing seniors, study finds - May 4th, 2012 [May 4th, 2012]
- 'Health Care Deserts' More Common in Black Neighborhoods - May 5th, 2012 [May 5th, 2012]
- With federal money, Oregon kicks health care reform into high gear - May 5th, 2012 [May 5th, 2012]
- Nurse practitioners tackling more 'doctor' tasks - May 5th, 2012 [May 5th, 2012]
- Konza Prairie Health Center Receives $4.5 Million Grant - May 5th, 2012 [May 5th, 2012]
- Alberta wages hurting Sask. health care - May 5th, 2012 [May 5th, 2012]
- House releases plan to cut growth of Massachusetts health spending in half - May 5th, 2012 [May 5th, 2012]
- Mass. House Will Unveil Bill Seeking To Rein In Health Costs - May 5th, 2012 [May 5th, 2012]
- President Obama Welcomes the Kentucky Wildcats - Video - May 5th, 2012 [May 5th, 2012]
- President Obama Speaks on College Affordability - Video - May 5th, 2012 [May 5th, 2012]
- My First Job: Gene Sperling - Video - May 5th, 2012 [May 5th, 2012]
- Health-care costs worry near-retirees - May 7th, 2012 [May 7th, 2012]
- Massachusetts Institutes Health-Care Price Controls. Is America Next? - May 7th, 2012 [May 7th, 2012]
- Massachusetts Moves Toward Health-Care Price Controls. Is America Next? - May 7th, 2012 [May 7th, 2012]
- GOP plan boosts Pentagon, cuts social programs - May 7th, 2012 [May 7th, 2012]