Health products powered by artificial intelligence, or AI, are streaming into our lives, from virtual doctor apps to wearable sensors and drugstore chatbots.
IBM boasted that its AI could outthink cancer. Others say computer systems that read X-rays will make radiologists obsolete.
Theres nothing that Ive seen in my 30-plus years studying medicine that could be as impactful and transformative as AI, said Dr. Eric Topol, a cardiologist and executive vice president of Scripps Research in La Jolla, Calif. AI can help doctors interpret MRIs of the heart, CT scans of the head and photographs of the back of the eye, and could potentially take over many mundane medical chores, freeing doctors to spend more time talking to patients, Topol said.
Even the Food and Drug Administration which has approved more than 40 AI products in the past five years says the potential of digital health is nothing short of revolutionary.
Yet many health industry experts fear AI-based products wont be able to match the hype. Many doctors and consumer advocates fear that the tech industry, which lives by the mantra fail fast and fix it later, is putting patients at risk and that regulators arent doing enough to keep consumers safe.
Early experiments in AI provide a reason for caution, said Mildred Cho, a professor of pediatrics at Stanfords Center for Biomedical Ethics.
Systems developed in one hospital often flop when deployed in a different facility, Cho said. Software used in the care of millions of Americans has been shown to discriminate against minorities. And AI systems sometimes learn to make predictions based on factors that have less to do with disease than the brand of MRI machine used, the time a blood test is taken or whether a patient was visited by a chaplain. In one case, AI software incorrectly concluded that people with pneumonia were less likely to die if they had asthma an error that could have led doctors to deprive asthma patients of the extra care they need.
Its only a matter of time before something like this leads to a serious health problem, said Dr. Steven Nissen, chairman of cardiology at the Cleveland Clinic.
Medical AI, which pulled in $1.6 billion in venture capital funding in the third quarter alone, is nearly at the peak of inflated expectations, concluded a July report from the research company Gartner. As the reality gets tested, there will likely be a rough slide into the trough of disillusionment.
That reality check could come in the form of disappointing results when AI products are ushered into the real world. Even Topol, the author of Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again, acknowledges that many AI products are little more than hot air. Its a mixed bag, he said.
Experts such as Dr. Bob Kocher, a partner at the venture capital firm Venrock, are blunter. Most AI products have little evidence to support them, Kocher said. Some risks wont become apparent until an AI system has been used by large numbers of patients. Were going to keep discovering a whole bunch of risks and unintended consequences of using AI on medical data, Kocher said.
None of the AI products sold in the U.S. have been tested in randomized clinical trials, the strongest source of medical evidence, Topol said. The first and only randomized trial of an AI system which found that colonoscopy with computer-aided diagnosis found more small polyps than standard colonoscopy was published online in October.
Few tech startups publish their research in peer-reviewed journals, which allow other scientists to scrutinize their work, according to a January article in the European Journal of Clinical Investigation. Such stealth research described only in press releases or promotional events often overstates a companys accomplishments.
And although software developers may boast about the accuracy of their AI devices, experts note that AI models are mostly tested on computers, not in hospitals or other medical facilities. Using unproven software may make patients into unwitting guinea pigs, said Dr. Ron Li, medical informatics director for AI clinical integration at Stanford Health Care.
AI systems that learn to recognize patterns in data are often described as black boxes because even their developers dont know how they have reached their conclusions. Given that AI is so new and many of its risks unknown the field needs careful oversight, said Pilar Ossorio, a professor of law and bioethics at the University of Wisconsin-Madison.
Yet the majority of AI devices dont require FDA approval.
None of the companies that I have invested in are covered by the FDA regulations, Kocher said.
Legislation passed by Congress in 2016 and championed by the tech industry exempts many types of medical software from federal review, including certain fitness apps, electronic health records and tools that help doctors make medical decisions.
Theres been little research on whether the 320,000 medical apps now in use actually improve health, according to a report on AI published Dec. 17 by the National Academy of Medicine.
Almost none of the [AI] stuff marketed to patients really works, said Dr. Ezekiel Emanuel, professor of medical ethics and health policy in the Perelman School of Medicine at the University of Pennsylvania.
The FDA has long focused its attention on devices that pose the greatest threat to patients. And consumer advocates acknowledge that some devices such as ones that help people count their daily steps need less scrutiny than ones that diagnose or treat disease.
Some software developers dont bother to apply for FDA clearance or authorization, even when legally required, according to a 2018 study in Annals of Internal Medicine.
Industry analysts say that AI developers have little interest in conducting expensive and time-consuming trials. Its not the main concern of these firms to submit themselves to rigorous evaluation that would be published in a peer-reviewed journal, said Joachim Roski, a principal at Booz Allen Hamilton, a technology consulting firm, and co-author of the National Academys report. Thats not how the U.S. economy works.
But Oren Etzioni, chief executive officer at the Allen Institute for AI in Seattle, said AI developers have a financial incentive to make sure their medical products are safe.
If failing fast means a whole bunch of people will die, I dont think we want to fail fast, Etzioni said. Nobody is going to be happy, including investors, if people die or are severely hurt.
The FDA has come under fire in recent years for allowing the sale of dangerous medical devices, which have been linked by the International Consortium of Investigative Journalists to 80,000 deaths and 1.7 million injuries over the past decade.
Many of these devices were cleared for use through a controversial process called the 510(k) pathway, which allows companies to market moderate-risk products with no clinical testing as long as theyre deemed similar to existing devices.
In 2011, a committee of the National Academy of Medicine concluded the 510(k) process is so fundamentally flawed that the FDA should throw it out and start over.
Instead, the FDA is using the process to greenlight AI devices.
Of the 14 AI products authorized by the FDA in 2017 and 2018, 11 were cleared through the 510(k) process, according to a November article in JAMA. None of these appear to have had new clinical testing, the study said. The FDA cleared an AI device designed to help diagnose liver and lung cancer in 2018 based on its similarity to imaging software approved 20 years earlier. That software had itself been cleared because it was deemed substantially equivalent to products marketed before 1976.
AI products cleared by the FDA today are largely locked, so that their calculations and results will not change after they enter the market, said Bakul Patel, director for digital health at the FDAs Center for Devices and Radiological Health. The FDA has not yet authorized unlocked AI devices, whose results could vary from month to month in ways that developers cannot predict.
To deal with the flood of AI products, the FDA is testing a radically different approach to digital device regulation, focusing on evaluating companies, not products.
The FDAs pilot pre-certification program, launched in 2017, is designed to reduce the time and cost of market entry for software developers, imposing the least burdensome system possible. FDA officials say they want to keep pace with AI software developers, who update their products much more frequently than makers of traditional devices, such as X-ray machines.
Scott Gottlieb said in 2017 while he was FDA commissioner that government regulators need to make sure its approach to innovative products is efficient and that it fosters, not impedes, innovation.
Under the plan, the FDA would pre-certify companies that demonstrate a culture of quality and organizational excellence, which would allow them to provide less upfront data about devices.
Pre-certified companies could then release devices with a streamlined review or no FDA review at all. Once products are on the market, companies will be responsible for monitoring their own products safety and reporting back to the FDA. Nine companies have been selected for the pilot: Apple, FitBit, Samsung, Johnson & Johnson, Pear Therapeutics, Phosphorus, Roche, Tidepool and Verily Life Sciences.
High-risk products, such as software used in pacemakers, will still get a comprehensive FDA evaluation. We definitely dont want patients to be hurt, said Patel, who noted that devices cleared through pre-certification can be recalled if needed. There are a lot of guardrails still in place.
But research shows that even low- and moderate-risk devices have been recalled due to serious risks to patients, said Diana Zuckerman, president of the National Center for Health Research. People could be harmed because something wasnt required to be proven accurate or safe before it is widely used.
Johnson & Johnson, for example, has recalled hip implants and surgical mesh.
In a series of letters to the FDA, the American Medical Association and others have questioned the wisdom of allowing companies to monitor their own performance and product safety.
The honor system is not a regulatory regime, said Dr. Jesse Ehrenfeld, who chairs the physician groups board of trustees.
In an October letter to the FDA, Sens. Elizabeth Warren (D-Mass.), Tina Smith (D-Minn.) and Patty Murray (D-Wash.) questioned the agencys ability to ensure company safety reports are accurate, timely and based on all available information.
Some AI devices are more carefully tested than others.
An AI-powered screening tool for diabetic eye disease was studied in 900 patients at 10 primary care offices before being approved in 2018. The manufacturer, IDx Technologies, worked with the FDA for eight years to get the product right, said Dr. Michael Abramoff, the companys founder and executive chairman.
The test, sold as IDx-DR, screens patients for diabetic retinopathy, a leading cause of blindness, and refers high-risk patients to eye specialists, who make a definitive diagnosis.
IDx-DR is the first autonomous AI product one that can make a screening decision without a doctor. The company is now installing it in primary care clinics and grocery stores, where it can be operated by employees with a high school diploma. Abramoffs company has taken the unusual step of buying liability insurance to cover any patient injuries.
Yet some AI-based innovations intended to improve care have had the opposite effect.
A Canadian company, for example, developed AI software to predict a persons risk of Alzheimers based on their speech. Predictions were more accurate for some patients than others. Difficulty finding the right word may be due to unfamiliarity with English, rather than to cognitive impairment, said co-author Frank Rudzicz, an associate professor of computer science at the University of Toronto.
Doctors at New Yorks Mount Sinai Hospital hoped AI could help them use chest X-rays to predict which patients were at high risk of pneumonia. Although the system made accurate predictions from X-rays shot at Mount Sinai, the technology flopped when tested on images taken at other hospitals. Eventually, researchers realized the computer had merely learned to tell the difference between that hospitals portable chest X-rays taken at a patients bedside with those taken in the radiology department. Doctors tend to use portable chest X-rays for patients too sick to leave their room, so its not surprising that these patients had a greater risk of lung infection.
DeepMind, a company owned by Google, has created an AI-based mobile app that can predict which hospitalized patients will develop acute kidney failure up to 48 hours in advance. A blog post on the DeepMind website described the system, used at a London hospital, as a game changer. But the AI system also produced two false alarms for every correct result, according to a July study in Nature. That may explain why patients kidney function didnt improve, said Dr. Saurabh Jha, associate professor of radiology at the Hospital of the University of Pennsylvania. Any benefit from early detection of serious kidney problems may have been diluted by a high rate of overdiagnosis, in which the AI system flagged borderline kidney issues that didnt need treatment, Jha said. Google had no comment in response to Jhas conclusions.
False positives can harm patients by prompting doctors to order unnecessary tests or withhold recommended treatments, Jha said. For example, a doctor worried about a patients kidneys might stop prescribing ibuprofen a generally safe pain reliever that poses a small risk to kidney function in favor of an opioid, which carries a serious risk of addiction.
As these studies show, software with impressive results in a computer lab can founder when tested in real time, Stanfords Cho said. Thats because diseases are more complex and the health care system far more dysfunctional than many computer scientists anticipate.
Many AI developers cull electronic health records because they hold huge amounts of detailed data, Cho said. But those developers often arent aware that theyre building atop a deeply broken system. Electronic health records were developed for billing, not patient care, and are filled with mistakes or missing data.
A KHN investigation published in March found sometimes life-threatening errors in patients medication lists, lab tests and allergies.
In view of the risks involved, doctors need to step in to protect their patients interests, said Dr. Vikas Saini, a cardiologist and president of the nonprofit Lown Institute, which advocates for wider access to health care.
While it is the job of entrepreneurs to think big and take risks, Saini said, it is the job of doctors to protect their patients.
Kaiser Health News (KHN) is a national health policy news service. It is an editorially independent program of the Henry J. Kaiser Family Foundation which is not affiliated with Kaiser Permanente.
See the rest here:
- MS in Artificial Intelligence | Artificial Intelligence - May 19th, 2020
- What is Artificial Intelligence? | Azure Blog and Updates ... - May 19th, 2020
- What Are the Advantages of Artificial Intelligence ... - May 19th, 2020
- AI Tutorial | Artificial Intelligence Tutorial - Javatpoint - May 19th, 2020
- It's Called Artificial Intelligencebut What Is Intelligence? - WIRED - May 19th, 2020
- Powering the Artificial Intelligence Revolution - HPCwire - May 19th, 2020
- Artificial intelligence is struggling to cope with how the world has changed - ZDNet - May 19th, 2020
- An AI future set to take over post-Covid world - The Indian Express - May 19th, 2020
- A New Way To Think About Artificial Intelligence With This ETF - MarketWatch - May 19th, 2020
- Artificial intelligence-based imaging reconstruction may lead to incorrect diagnoses, experts caution - Radiology Business - May 19th, 2020
- Artificial Intelligence in the Covid Frontline - Morningstar - May 19th, 2020
- Patent Analytics Market to Reach USD 1,668.4 Million by 2027; Integration of Machine Learning and Artificial Intelligence to Spur Business... - May 19th, 2020
- Artificial Intelligence in Cancer: How Is It Used in Practice? - Cancer Therapy Advisor - May 19th, 2020
- Five Important Subsets of Artificial Intelligence - Analytics Insight - May 19th, 2020
- Ethical artificial intelligence: Could Switzerland take the lead? - swissinfo.ch - May 19th, 2020
- The Future of Artificial Intelligence: Edge Intelligence - Analytics Insight - May 19th, 2020
- 5 Ways Artificial Intelligence Is Changing Architecture - May 15th, 2020
- Keysight Validates Artificial Intelligence (AI) and ... - May 15th, 2020
- What Is Artificial Intelligence? Examples and News in 2019 ... - May 15th, 2020
- Artificial Intelligence (AI) Is Nothing Without Humans - E3zine.com - May 15th, 2020
- Artificial intelligence is helping seniors who are isolated during the coronavirus pandemic - WXYZ - May 15th, 2020
- ValleyML is launching a Machine Learning and Deep Learning Boot Camp from July 14th to Sept 10th and AI Expo Series from Sept 21st to Nov 19th 2020.... - May 15th, 2020
- TSA Issues Road Map to Tackle Insider Threat With Artificial Intelligence - Nextgov - May 15th, 2020
- The Expanding Role Of Artificial Intelligence In Tax - Forbes - May 15th, 2020
- Artificial Intelligence: Technology Of The Future - Forbes India - May 15th, 2020
- SparkCognition and Milize to Offer Automated Machine Learning Solutions for Financial Institutions to the APAC Region - PRNewswire - May 15th, 2020
- Alpha Modus Allowed 2nd Patent Leveraging Artificial Intelligence for Monitoring and Analyzing Consumer Behavior - Yahoo Finance - May 15th, 2020
- Tesla : Artificial Intelligence - the .AI domain is on the rise - marketscreener.com - May 15th, 2020
- Artificial Intelligence Can Only Help Architecture if We Ask the Right Questions - ArchDaily - May 15th, 2020
- Fighting COVID-19: Artificial Intelligence community to help citizens and the healthcare system - Canada NewsWire - May 15th, 2020
- Understanding the Four Types of Artificial Intelligence - May 9th, 2020
- Artificial intelligence Facts for Kids - May 9th, 2020
- 4 Main Types of Artificial Intelligence - G2 - May 9th, 2020
- Artificial intelligence project lets Holocaust survivors ... - May 9th, 2020
- Artificial intelligence - Simple English Wikipedia, the ... - May 9th, 2020
- Artificial Intelligence Market by Size, Share, Analysis ... - May 9th, 2020
- A.I. Artificial Intelligence movie review (2001) | Roger Ebert - May 9th, 2020
- Artificial Intelligence is Evolving to Process the World Like Humans - Interesting Engineering - May 9th, 2020
- Drug research turns to artificial intelligence in COVID-19 fight - Business in Vancouver - May 9th, 2020
- Women wanted: Why now could be a good time for women to pursue a career in AI - CNBC - May 9th, 2020
- Artificial Intelligence Used to Identify Light Sources With Far Fewer Measurements - Unite.AI - May 9th, 2020
- The Impending Artificial Intelligence Revolution in Healthcare - Op-Ed - HIT Consultant - May 9th, 2020
- COVID-19 identification in X-ray images by Artificial intelligence - News Anyway - May 9th, 2020
- Is artificial intelligence the answer to the care sector amid COVID-19? - Descrier - May 9th, 2020
- Artificial intelligence - Wikipedia - April 26th, 2020
- artificial intelligence | Definition, Examples, and ... - April 26th, 2020
- What is Artificial Intelligence? How Does AI Work? | Built In - April 26th, 2020
- What Is Artificial Intelligence (AI)? | PCMag - April 26th, 2020
- Artificial Intelligence (AI) Definition - Investopedia - April 26th, 2020
- How Artificial Intelligence Is Totally Changing Everything ... - April 26th, 2020
- Artificial Intelligence And Automation Top Focus For Venture Capitalists - Forbes - April 26th, 2020
- Benefits & Risks of Artificial Intelligence - Future of ... - April 26th, 2020
- Artificial intelligence can take banks to the next level - TechRepublic - April 26th, 2020
- Health care of tomorrow, today: How artificial intelligence is fighting the current, and future, COVID-19 pandemic | TheHill - The Hill - April 26th, 2020
- How Artificial Intelligence, IoT And Big Data Can Save The Bees - Forbes - April 26th, 2020
- First meeting of the new CEPEJ Working Group on cyberjustice and artificial intelligence - Council of Europe - April 26th, 2020
- When the coronavirus hit, California turned to artificial intelligence to help map the spread - 60 Minutes - CBS News - April 26th, 2020
- Artificial Intelligence in the Oil & Gas Industry, 2020-2025 - Upstream Operations to Witness Significant Growth - ResearchAndMarkets.com - Yahoo... - April 26th, 2020
- Pre & Post COVID-19 Market Estimates-Artificial Intelligence (AI) Market in Retail Sector 2019-2023| Increased Efficiency of Operations to Boost... - April 26th, 2020
- EUREKA Clusters Artificial Intelligence (AI) Call | News item - The Netherlands and You - April 26th, 2020
- A guide to healthy skepticism of artificial intelligence and coronavirus - Brookings Institution - April 2nd, 2020
- AI vs your career? What artificial intelligence will really do to the future of work - ZDNet - April 2nd, 2020
- Return On Artificial Intelligence: The Challenge And The Opportunity - Forbes - April 2nd, 2020
- Stanford launches an accelerated test of AI to help with Covid-19 care - STAT - April 2nd, 2020
- How Artificial Intelligence Is Helping Fight The COVID-19 Pandemic - Entrepreneur - April 2nd, 2020
- Enterprise Artificial Intelligence Along With Telehealth And Teleconferences Can Help In Fighting COVID-19 - Entrepreneur - April 2nd, 2020
- AI (Artificial Intelligence) Companies That Are Combating The COVID-19 Pandemic - Forbes - April 2nd, 2020
- How Artificial Intelligence is Going to Make Your Analytics Better Than Ever - Security Magazine - April 2nd, 2020
- STAT's guide to how hospitals are using AI to fight Covid-19 - STAT - April 2nd, 2020
- 6 Visions of How Artificial Intelligence will Change Architecture - ArchDaily - April 2nd, 2020
- The race problem with AI: Machines are learning to be racist' - Metro.co.uk - April 2nd, 2020
- Artificial Intelligence in Retail Market Projected to Grow with a CAGR of 35.9% Over the Forecast Period, 2019-2025 - ResearchAndMarkets.com - Yahoo... - April 2nd, 2020
- Google and the Oxford Internet Institute explain artificial intelligence basics with the A-Z of AI - VentureBeat - April 2nd, 2020
- AiThority Interview with Seth Siegel, AI Consulting at Infosys - AiThority - April 2nd, 2020
- Artificial Intelligence turns a persons thoughts into text - Times of India - April 2nd, 2020
- The Limitations of Artificial Intelligence in Businesses - AZoRobotics - April 2nd, 2020
- VA Looking to Expand Usage of Artificial Intelligence Data - GovernmentCIO Media - April 2nd, 2020
- New blood test study uses artificial intelligence to identify cancer. But its not ready for patients yet. - Cancer Research UK - Science Blog - April 2nd, 2020
- Global Artificial Intelligence in Healthcare Market - Premium Insight, Competitive News Feed Analysis, Company Usability Profiles, Market Sizing &... - March 28th, 2020
- The Global Artificial Intelligence in Aviation Market is expected to grow from USD 214.36 Million in 2018 to USD 1,824.46 Million by the end of 2025... - March 28th, 2020