Machine learning is taking medical diagnosis by storm. From eye disease, breast and other cancers, to more amorphous neurological disorders, AI is routinely matching physician performance, if not beating them outright.
Yet how much can we take those results at face value? When it comes to life and death decisions, when can we put our full trust in enigmatic algorithmsblack boxes that even their creators cannot fully explain or understand? The problem gets more complex as medical AI crosses multiple disciplines and developers, including both academic and industry powerhouses such as Google, Amazon, or Apple, with disparate incentives.
This week, the two sides battled it out in a heated duel in one of the most prestigious science journals, Nature. On one side are prominent AI researchers at the Princess Margaret Cancer Centre, University of Toronto, Stanford University, Johns Hopkins, Harvard, MIT, and others. On the other side is the titan Google Health.
The trigger was an explosive study by Google Health for breast cancer screening, published in January this year. The study claimed to have developed an AI system that vastly outperformed radiologists for diagnosing breast cancer, and can be generalized to populations beyond those used for traininga holy grail of sorts thats incredibly difficult due to the lack of large medical imaging datasets. The study made waves across the media landscape, and created a buzz in the public sphere for medical AIs coming of age.
The problem, the academics argued, is that the study lacked sufficient descriptions of the code and model for others to replicate. In other words, we can only trust the study at its wordsomething thats just not done in scientific research. Google Health, in turn, penned a polite, nuanced but assertive rebuttal arguing for their need to protect patient information and prevent the AI from malicious attacks.
Academic discourse like these form the seat of science, and may seem incredibly nerdy and outdatedespecially because rather than online channels, the two sides resorted to a centuries-old pen-and-paper discussion. By doing so, however, they elevated a necessary debate to a broad worldwide audience, each side landing solid punches that, in turn, could lay the basis of a framework for trust and transparency in medical AIto the benefit of all. Now if they could only rap their arguments in the vein of Hamilton and Jeffersons Cabinet Battles in Hamilton.
Its easy to see where the academics arguments come from. Science is often painted as a holy endeavor embodying objectivity and truth. But as any discipline touched by people, its prone to errors, poor designs, unintentional biases orin very small numbersconscious manipulation to skew the results. Because of this, when publishing results, scientists carefully describe their methodology so others can replicate the findings. If a conclusion, say a vaccine that protects against Covid-19, happens in nearly every lab regardless of the scientist, the material, or the subjects, then we have stronger proof that the vaccine actually works. If not, it means that the initial study may be wrongand scientists can then delineate why and move on. Replication is critical to healthy scientific evolution.
But AI research is shredding the dogma.
In computational research, its not yet a widespread criterion for the details of an AI study to be fully accessible. This is detrimental to our progress, said author Dr. Benjamin Haibe-Kains at Princess Margaret Cancer Centre. For example, nuances in computer code or training samples and parameters could dramatically change training and evaluation of resultsaspects that cant be easily described using text alone, as is the norm. The consequence, said the team, is that it makes trying to verify the complex computational pipeline not possible. (For academics, thats the equivalent of gloves off.)
Although the academics took Google Healths breast cancer study as an example, they acknowledged the problem is far more widespread. By examining the shortfalls of the Google Health study in terms of transparency, the team said, we provide potential solutions with implications for the broader field. Its not an impossible problem. Online depositories such as GitHub, Bitbucket, and others already allow the sharing of code. Others allow sharing of deep learning models, such as ModelHub.ai, with support for frameworks such as TensorFlow, which was used by the Google Health team.
Ins-and-outs details of AI models aside, theres also the question of sharing data that those models were trained from. Its a particularly thorny problem for medical AI, because much of those datasets are under license and sharing can generate privacy concerns. Yet its not unheard of. For example, genomics has leveraged patient datasets for decadesessentially each persons genetic base codeand extensive guidelines exist to protect patient privacy. If youve ever used a 23andMe ancestry spit kit and provided consent for your data to be used for large genomic studies, youve benefited from those guidelines. Setting up something similar for medical AI isnt impossible.
In the end, a higher bar for transparency for medical AI will benefit the entire field, including doctors and patients. In addition to improving accessibility and transparency, such resources can considerably accelerate model development, validation and transition into production and clinical Implementation, the authors wrote.
Led by Dr. Scott McKinney, Google Health did not mince words. Their general argument: No doubt the commenters are motivated by protecting future patients as much as scientific principle. We share that sentiment. But under current regulatory frameworks, our hands are tied when it comes to open sharing.
For example, when it comes to releasing a version of their model for others to test on different sets of medical images, the team said they simply cant because their AI system may be classified as medical device software, which is subject to oversight. Unrestricted release may lead to liability issues that place patients, providers, and developers at risk.
As for sharing datasets, Google Health argued that their largest source used is available online with application to access (with just a hint of sass that their organization helped to fund the resource). Other datasets, due to ethical boards, simply cannot be shared.
Finally, the team argued that sharing a models learned parameters,that is, the bread-and-butter of how theyre constructedcan inadvertently expose the training dataset and model to malicious attack or misuse. Its certainly a concern: you may have previously heard of GPT-3, the OpenAI algorithm that writes unnervingly like a humanenough to fool Redditors for a week. But it would take a really sick individual to bastardize a breast cancer detection tool for some twisted gratification.
The academic-Google Health debate is just a small corner of a worldwide reckoning for medical AI. In September 2011, an international consortium of medical experts introduced a set of official standards for clinical trials that deploy AI in medicine, with the goal of plucking out AI snake oil from trustworthy algorithms. One point may sound familiar: how reliably a medical AI functions in the real word, away from favorable training sets or conditions in the lab. The guidelines represent some of the first when it comes to medical AI, but wont be the last.
If this all seems abstract and high up in the ivory tower, think of it another way: youre now witnessing the room where it happens. By publishing negotiations and discourse publicly, AI developers are inviting additional stakeholders to join in on the conversation. Like self-driving cars, medical AI seems like an inevitability. The question is how to judge and deploy it in a safe, equal mannerwhile inviting a hefty dose of public trust.
Image Credit: Marc Manhart from Pixabay
Continue reading here:
Can We Trust AI Doctors? Google Health and Academics Battle It Out - Singularity Hub
- The Google One VPN service is heading to the Google graveyard - The Verge - April 16th, 2024 [April 16th, 2024]
- Google One is losing a lot of its appeal, but Photos has me locked in - Android Authority - April 16th, 2024 [April 16th, 2024]
- Google intensifies fight against YouTube adblockers - Ghacks - April 16th, 2024 [April 16th, 2024]
- Google One VPN Is Bound for the Google Graveyard Later This Year - CNET - April 16th, 2024 [April 16th, 2024]
- Google's next foldable could be the Pixel 9 Pro Fold and finally get flagship specs - TechRadar - April 16th, 2024 [April 16th, 2024]
- Meta and Google announce new in-house AI chips, creating a trillion-dollar question for Nvidia - Fortune - April 16th, 2024 [April 16th, 2024]
- Grow with Google launches a new generative AI course for educators in collaboration with MIT RAISE - The Keyword | Google Product and Technology News - April 16th, 2024 [April 16th, 2024]
- Google is shutting down Google One VPN because 'people simply weren't using it' - ZDNet - April 16th, 2024 [April 16th, 2024]
- Google's Pixel 8A leaks in all colors including a bold green - The Verge - April 16th, 2024 [April 16th, 2024]
- Milan Design Week 2024: Google and Chromasonic Transform Light Into Sound for Making Sense of Color Exhibition ... - Cool Hunting - April 16th, 2024 [April 16th, 2024]
- Something strange might happen to the Google Pixel Fold 2 - Digital Trends - April 16th, 2024 [April 16th, 2024]
- Google begins removing California news from search in response to Journalism Preservation Act - Sacramento Bee - April 16th, 2024 [April 16th, 2024]
- I tested the Google Pixel's Long Exposure photo mode and it's another reason to leave my pro mirrorless camera at ... - TechRadar - April 16th, 2024 [April 16th, 2024]
- iOS 18Apple Issues New Blow To Google With Bold AI Privacy Decision - Forbes - April 16th, 2024 [April 16th, 2024]
- Google Wallet 'verify it's you' request appears minutes after unlock - 9to5Google - April 16th, 2024 [April 16th, 2024]
- Google Will Open Its Magic Editor AI Photo Tools to Everyone for Free, With a Catch - CNET - April 16th, 2024 [April 16th, 2024]
- The Google Pixel 8a leaks twice, hinting at its design, and four color options - TechRadar - April 16th, 2024 [April 16th, 2024]
- Google Vids is Google's fourth big productivity app for Workspace - Ars Technica - April 16th, 2024 [April 16th, 2024]
- Google working to prevent accidental Circle to Search activations - 9to5Google - April 16th, 2024 [April 16th, 2024]
- Google Unleashes 'New Era Of Productivity' With AI Agents: Partners - CRN - April 16th, 2024 [April 16th, 2024]
- Did you even use the Google One VPN? [Poll] - 9to5Google - April 16th, 2024 [April 16th, 2024]
- Faced with possibly paying for news, Google removes links to California news sites for some users - ABC News - April 16th, 2024 [April 16th, 2024]
- Google Chrome removes side panel button in favor of pinning - 9to5Google - April 16th, 2024 [April 16th, 2024]
- Google and Chromasonic make sense of colour at Milan Design Week - Wallpaper* - April 16th, 2024 [April 16th, 2024]
- Google and MIT launch a free generative AI course for teachers - ZDNet - April 16th, 2024 [April 16th, 2024]
- The Google Pixel 7a is on sale for a new low of $349 - Engadget - April 16th, 2024 [April 16th, 2024]
- Here's how the Google Pixel 9's new modem will power satellite connectivity - Android Police - April 16th, 2024 [April 16th, 2024]
- Here's 16 pages of what Epic wants after winning its Google app store lawsuit - The Verge - April 16th, 2024 [April 16th, 2024]
- When Parkinson's anxiety, Google Maps, and texting collide - Parkinson's News Today - April 16th, 2024 [April 16th, 2024]
- Google Meet slides in time-saving UI update for its toolbar on desktop - Android Central - April 16th, 2024 [April 16th, 2024]
- Google AI podcast: 6 conversations with global leaders - The Keyword | Google Product and Technology News - April 12th, 2024 [April 12th, 2024]
- Nvidia, Google Expand Partnership With Nvidia Blackwell Coming to Google Cloud in 2025 - Investopedia - April 12th, 2024 [April 12th, 2024]
- Google partners with Bayer on new AI product for radiologists - CNBC - April 12th, 2024 [April 12th, 2024]
- Exclusive: Google Workers Revolt Over $1.2 Billion Israel Contract - TIME - April 12th, 2024 [April 12th, 2024]
- Google's new Arm-based CPU will challenge Microsoft and Amazon in the AI race - The Verge - April 12th, 2024 [April 12th, 2024]
- Google releases first Android 15 beta with improved performance and edge-to-edge display by default - SiliconANGLE News - April 12th, 2024 [April 12th, 2024]
- Google's Gemini 1.5 Pro can now hear - The Verge - April 12th, 2024 [April 12th, 2024]
- WPP and Google Cloud forge groundbreaking new collaboration to lead generative AI-driven marketing into its next ... - WPP - April 12th, 2024 [April 12th, 2024]
- These Google Photo Editing Tools Will Be Free Soon - Lifehacker - April 12th, 2024 [April 12th, 2024]
- I shot the eclipse with an iPhone 15 Pro Max, Google Pixel 8 Pro and a Samsung Galaxy S23 Ultra here's which one ... - TechRadar - April 12th, 2024 [April 12th, 2024]
- Responses To Google Search About Amarillo - 101.9 The Bull - April 12th, 2024 [April 12th, 2024]
- Google announces Axion, its first custom Arm-based data center processor - TechCrunch - April 12th, 2024 [April 12th, 2024]
- Google and world's largest ad group announce landmark AI collaboration - Search Engine Land - April 12th, 2024 [April 12th, 2024]
- Google releases 'prompting guide' with tips for Gemini in Workspace - 9to5Google - April 12th, 2024 [April 12th, 2024]
- Google Photos is making its AI photo editing tools available for all users - Mashable - April 12th, 2024 [April 12th, 2024]
- Orange Expands Partnership With Google Cloud to Use AI and GenAI Across Workstreams and Geographies With New ... - PR Newswire - April 12th, 2024 [April 12th, 2024]
- Google finally launches its Find My Device network. Here are the Android models that support it - ZDNet - April 12th, 2024 [April 12th, 2024]
- Google Store now accepts trade-ins for the Pixel Tablet - 9to5Google - April 12th, 2024 [April 12th, 2024]
- Google's Find My Device network has finally launched and the Pixel 8 gets special tracking powers - TechRadar - April 12th, 2024 [April 12th, 2024]
- Alphabet Stock Rises Amid Introduction of AI Products - PYMNTS.com - April 12th, 2024 [April 12th, 2024]
- Discover the Czech National Library's treasures with Google Arts & Culture - The Keyword | Google Product and Technology News - April 12th, 2024 [April 12th, 2024]
- Google's Gemini Pro 1.5 can now hear as well as see what it means for you - Tom's Guide - April 12th, 2024 [April 12th, 2024]
- Next Vision, or Vision Next? What we really thought about Google and Intel's AI events - The Register - April 12th, 2024 [April 12th, 2024]
- Google Wallet on Wear OS isn't as convenient as it could be - Android Police - April 12th, 2024 [April 12th, 2024]
- Google AI's Updates Show Its Ambitions To Go Beyond Automating Tasks As It Aims To Revolutionize Business ... - Yahoo Finance - April 12th, 2024 [April 12th, 2024]
- Google Workspace gets a game-changing security feature - Android Police - April 12th, 2024 [April 12th, 2024]
- Google Flights says these are the top summer travel destinations of 2024 - Fox Business - April 12th, 2024 [April 12th, 2024]
- Google Built Its Own Server CPU in Blow to Intel and AMD - The Motley Fool - April 12th, 2024 [April 12th, 2024]
- Google Photos on Android seems primed to pick up a 'recover storage' option - Android Central - April 12th, 2024 [April 12th, 2024]
- Former Google Deepmind Researchers Assemble Luminaries Across Music And Tech To Launch Udio, A New AI ... - PR Newswire - April 12th, 2024 [April 12th, 2024]
- Google parent Alphabet says AI helped it beat profit expectations - theSun - January 30th, 2024 [January 30th, 2024]
- Microsoft beats estimates, but Google gets slammed on ad revenue worries - FXStreet - January 30th, 2024 [January 30th, 2024]
- Google TV's homescreen video ads now include fast food too - 9to5Google - January 30th, 2024 [January 30th, 2024]
- Google partners on passkey upgrades, dropping Pixel exclusivity in the future - 9to5Google - January 30th, 2024 [January 30th, 2024]
- Google TV Has New Annoying Ads - How-To Geek - January 30th, 2024 [January 30th, 2024]
- Atropos Health partners with Google Cloud to rapidly generate insights from healthcare data using AI - VentureBeat - January 30th, 2024 [January 30th, 2024]
- Spring a leak? Google will find it through a new partnership aimed at saving water in New Mexico - El Paso Inc. - January 30th, 2024 [January 30th, 2024]
- Hugging Face and Google Cloud Announce Collaboration for Open AI Initiative - InfoQ.com - January 30th, 2024 [January 30th, 2024]
- Stock Market Today: Stocks mixed with Microsoft, Google earnings and Fed in focus - TheStreet - January 30th, 2024 [January 30th, 2024]
- Google's Parent Company Squeezes Its Moonshot Projects, 'Other Bets' - The Information - January 30th, 2024 [January 30th, 2024]
- Google parent Alphabet reports 52% surge in profit on strong business - The National - January 30th, 2024 [January 30th, 2024]
- Some advertisers are unable to access Google Ads - Search Engine Land - January 30th, 2024 [January 30th, 2024]
- How to get started with Side Panel on Google Chrome - Windows Central - January 30th, 2024 [January 30th, 2024]
- Google Cloud and Hugging Face Announce Strategic Partnership to Accelerate Generative AI and ML Development - PR Newswire - January 30th, 2024 [January 30th, 2024]
- How To Update Google Chrome To Its Latest Version - SlashGear - January 30th, 2024 [January 30th, 2024]
- Google wants to make it easier to disable Chrome's annoying notifications - Android Police - January 30th, 2024 [January 30th, 2024]
- Google app update reveals Google doesn't know what to call Assistant with Bard - Android Central - January 30th, 2024 [January 30th, 2024]
- Spring a leak? Google will find it through a new partnership aimed at saving water in New Mexico - The Caledonian-Record - January 30th, 2024 [January 30th, 2024]
- Google And Hugging Face Partner To Advance Generative AI With Open Models - Forbes - January 30th, 2024 [January 30th, 2024]
- Tech earnings preview: Microsoft, Apple, Google, Meta, and Amazon - Fast Company - January 30th, 2024 [January 30th, 2024]