Companies have learned the hard way that their artificial intelligence tools have unforeseen outputs, like Amazons (AMZN) favoring mens resumes over womens or Ubers disabling the user accounts of transgender drivers. When not astutely overseen by human intelligence, deploying AI can often bend into an unseemly rainbow of discriminatory qualities like ageism, sexism, and racism. Thats because biases unnoticed in the input data can become amplified in the outputs.
Another underappreciated hazard is the potential for AI to cater to our established preferences. You can see that in apps that manage everything from sources of journalism to new music and prospective romance. Once an algorithm gets a sense of what you like, it delivers the tried and true, making the world around you more homogeneous than it might otherwise be without embedded artificial intelligence. Having your preferences catered to can sometimes be great. But it can also be debilitating in insidious ways, like in the search to find the right therapist.
As a psychiatrist who works on improving the design of tech-enabled health care services, I foresee how misapplied AI could create pitfalls for the growing number of online platforms that aim to make it easier for individuals seeking therapy to find a therapist.
advertisement
It is now possible to search through online listings that sort therapists by various factors. You can learn about the type of therapy a provider offers as well as his or her clinical specialization and educational background. You can sometimes see a photo of the clinician, or even watch a video interview to get a better sense of what she or he is all about.
Shared demographic features can be key factors in finding a therapist. Hearing about a few of my friends personal experiences, demographic matching was salient. One was willing to go only to a male person of color; another told me he would only feel comfortable seeking therapy with a woman or a gay man. Minority mental health care providers are demographically underrepresented in the profession, which can result in the therapeutic environment feeling like a foreign, unwelcoming space to many prospective patients.
Making health care and specifically mental health care culturally inclusive is extremely important. To get a sense of how much of an impact representation can have, look no further than the inspirational force of psychiatrist Jessica Clemons, also known by her Instagram handle as @askDrJess, who has done preeminent work flipping the script on mental health in communities of color and engaging underrepresented groups with mental health.
What often drives individuals searches for providers with shared demographic features is the belief that such providers will be able to understand them better and help them get better because the therapist shares their lived experiences. But that presumption may unintentionally set up a therapeutic environment built on a shaky foundation.
Heres what the available evidence shows happens in practice. Among racial and ethnic minorities, there tends to be a preference for providers who share their identity, or at least share a common status as a racial/ethnic minority. Although a meta-analysis showed that such individuals perceive their identity-matched providers to be more effective, measurable outcomes didnt match the perception. Ultimately, the treatment outcomes were about the same regardless of the therapists identity.
Its possible that studies like these systematically underreport hard-to-quantify factors that are part and parcel of psychotherapy, like helping an individual feel fundamentally understood and making ones personal struggles comprehensible to themselves in light of their prior experiences. And some might argue that a patients positive perception is, in fact, the best way to measure therapeutic success.
Yet a 2015 study demonstrated that individuals would knowingly seek less-effective therapy in exchange for sharing identity features with their therapist. At the very least, this shows that individuals are willing to make objective sacrifices in order to ensure that their identity is a central part of their therapy, even if that means at odds with what an economist would call rational decision-making that the therapy itself is less effective in addressing its defined purpose.
The overlooked danger in using artificial intelligence or other tools to prioritize identity features when selecting a mental health provider is that it could systematically amplify a potential confirmation bias for some individuals seeking therapy. In daily life, confirmation biases develop when individuals set up their environments often subconsciously to make new evidence confirm their preconceptions.
The challenges, for example, that a gay or black person faces often rightly justified through hard-earned if not traumatic life experiences may make it difficult to navigate social or professional interactions with others whom they believe cannot empathize or appreciate their perspectives or values. In turn, if that individual exclusively seeks a therapist with whom they readily identify, the experience can confirm and amplify the discrepancy they feel between their carefully pre-screened therapist and the rest of the outside world.
Offering the idea of establishing a relationship with a therapist who is outside a patients natural comfort zone may seem insensitive to patient autonomy. As a white man with reasonable knowledge of mental health care systems and the means to afford care, I dont face nearly any of the barriers to care that many others do. As a clinician, however, I have witnessed firsthand the unique value of therapeutic relationships that transcend demographics. When the visible identity differences melt into the background with time, the therapeutic relationship has the potential to gently challenge a patients preconceptions regarding trust, compassion, and clinical competence. Thus, the successful patient/provider relationship is more dependent on a multi-dimensional interpersonal connection than on one or a few demographic features.
Artificial intelligence and sorting algorithms invisibly embedded in mental health care navigation can have unintended consequences that become greater as technological innovation slips further into the patient-provider matching process. Therapists, entrepreneurs, and health care service designers must be collectively attuned to the potential problems posed by artificial intelligence when it is treated as a magical black box. Not paying attention to input features and catering to customer demands without foresight could systematically segregate health care provision and erect greater barriers in health care as we cluster into ever more homogenized groups. And because of the underrepresentation of minorities as mental health care providers, any homogenization of care could have the potential to significantly worsen access to care for many minority patients.
Addressing these concerns will require several steps. Solutions must be carried out on two levels: the individual provider and the health care system. Technology developers must exercise a great degree of caution in the use of automated identity matching between patient and mental health provider. For clinicians and clinical educators, its important to note that most individuals value a therapist with extensive cultural training and experience even more highly than simply sharing racial or ethnic identity with their provider. This makes patient-panel diversity and cultural competency training to be defining issues in the quality of clinical training and continuing professional education in the coming years.
Technology has the potential to readily improve individuals opportunities to seamlessly connect with high quality mental health care. However, treating artificial intelligence as if it were a black box that automatically produces an optimal result holds the potential to systematically undercut access to care when expert clinical judgement isnt closely tied to applying AI.
Scott Breitinger, M.D., is an instructor in psychiatry at the Mayo Clinic in Rochester, Minn.
Read more here:
Artificial intelligence can complicate finding the right therapist - STAT
- Researchers create innovative verification techniques to increase security in artificial intelligence and image processing - European Research Council - April 29th, 2024 [April 29th, 2024]
- Who in Europe is investing the most in artificial intelligence? - Euronews - April 29th, 2024 [April 29th, 2024]
- 4 Artificial Intelligence (AI) Stocks Members of Congress Can't Stop Buying (and Nvidia Isn't 1 of Them!) - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- The Standard Names Porter Orr Second Vice President of Artificial Intelligence Strategy and Development - NRToday.com - April 29th, 2024 [April 29th, 2024]
- Meet Nvidia CEO Jensen Huang, the man behind the $2 trillion company powering today's artificial intelligence - CBS News - April 29th, 2024 [April 29th, 2024]
- This Warren Buffett Dividend King Stock Just Invested $1.1 Billion Into Artificial Intelligence (AI) - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- Joe Rogan Reveals What Could Be 'Game Over for the Human Race' - Newsweek - April 29th, 2024 [April 29th, 2024]
- LegalTech Artificial Intelligence Market to Soar to $6.4 Billion by 2028: Global Long-term Forecast to 2033 - Strategic ... - Yahoo Finance UK - April 29th, 2024 [April 29th, 2024]
- Artificial Intelligence Tokens Stumble Again! Is The AI Hype Over? - Coinpedia Fintech News - April 29th, 2024 [April 29th, 2024]
- CISA unveils guidelines for AI and critical infrastructure - FedScoop - April 29th, 2024 [April 29th, 2024]
- IBM's Webinar: Cybersecurity In The Era Of Artificial Intelligence Keynotes - AiThority - April 29th, 2024 [April 29th, 2024]
- Being and becoming a good doctor in the age of artificial intelligence - Firstpost - April 29th, 2024 [April 29th, 2024]
- Pope to take part in G7 summit in June to talk Artificial Intelligence - Crux Now - April 29th, 2024 [April 29th, 2024]
- Pope Francis to attend G7 summit to speak on artificial intelligence - Catholic News Agency - April 29th, 2024 [April 29th, 2024]
- 1 Unstoppable Artificial Intelligence (AI) Stock to Buy and Hold Forever - Yahoo Finance - April 29th, 2024 [April 29th, 2024]
- Pope to bring his call for ethical artificial intelligence to G7 summit in June in southern Italy - The Associated Press - April 29th, 2024 [April 29th, 2024]
- Elon Musk Called Tesla an Artificial Intelligence (AI) Robotics Company. Does That Make It a Buy? - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- Emulating neurodegeneration and aging in artificial intelligence systems - Tech Xplore - April 29th, 2024 [April 29th, 2024]
- Pope Francis to participate in G7 session on AI - Vatican News - English - April 29th, 2024 [April 29th, 2024]
- A Once-in-a-Generation Investment Opportunity: 1 Bill Ackman Artificial Intelligence (AI) Stock to Buy Hand Over Fist ... - Yahoo Finance - April 29th, 2024 [April 29th, 2024]
- Tesla Stock Investors Cheer Progress on Its Artificial Intelligence (AI) Future - Yahoo Finance - April 29th, 2024 [April 29th, 2024]
- In Race to Build A.I., Tech Plans a Big Plumbing Upgrade - The New York Times - April 29th, 2024 [April 29th, 2024]
- A Baltimore-area teacher is accused of using AI to make his boss appear racist - NPR - April 29th, 2024 [April 29th, 2024]
- 3 Top Artificial Intelligence (AI) Stocks That Billionaires Jim Simons, Ray Dalio, and Israel Englander Are Buying - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- The iPad Pro can give us a big surprise with its artificial intelligence chips. - Softonic EN - April 29th, 2024 [April 29th, 2024]
- This Artificial Intelligence (AI) Stock Could Soar 70%, According to Wall Street. Time to Buy? - Yahoo Finance - April 29th, 2024 [April 29th, 2024]
- Billionaire Bill Ackman Owns 8 Stocks -- and This Hypergrowth Artificial Intelligence (AI) Stock Isn't One of Them - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- Artificial Intelligence Has Come for Our...Beauty Pageants? - Glamour - April 29th, 2024 [April 29th, 2024]
- 3 Stocks to Grab Now to Ride the Artificial Intelligence Chip Boom to Riches - InvestorPlace - April 29th, 2024 [April 29th, 2024]
- Is ASML's Big Sell-off a Warning Sign to Artificial Intelligence (AI) Investors? - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- 3 Artificial Intelligence (AI) Stocks to Buy With $1,150 and Hold for Decades - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- This combines the power of artificial intelligence with human insights - finews.com - March 22nd, 2024 [March 22nd, 2024]
- Cohere Targets $5 Billion Valuation for ChatGPT Rival - PYMNTS.com - March 22nd, 2024 [March 22nd, 2024]
- IMF: Artificial Intelligence (AI) Will Transform 40% of Jobs. Can Investors Capitalize? - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- Cathie Wood Is Selling These 2 Artificial Intelligence (AI) Stocks. Should You? - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- iShares Robotics and Artificial Intelligence Multisector ETF (NYSEARCA:IRBO) Shares Acquired by Creative Financial ... - Defense World - March 22nd, 2024 [March 22nd, 2024]
- Inaugural Plenary Meeting of States Endorsing the Political Declaration on Responsible Military Use of Artificial ... - Department of State - March 22nd, 2024 [March 22nd, 2024]
- AMD Fell Today -- Is This a Chance to Buy the Artificial Intelligence (AI) Stock? - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- Artificial Intelligence (AI) Stocks Are Red-Hot, but Here's 1 to Avoid (for Now) - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- A Once-in-a-Generation Investment Opportunity: 1 Artificial Intelligence (AI) Growth Stock to Buy and Hold Forever - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- 2 Artificial Intelligence (AI) Stocks That Could Go Parabolic - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Artificial intelligence will radically improve health care, but only if managed carefully - The Hill - March 22nd, 2024 [March 22nd, 2024]
- Tennessee Makes A.I. an Outlaw to Protect Its Country Music and More - The New York Times - March 22nd, 2024 [March 22nd, 2024]
- When Using Artificial Intelligence In Pharma R&D, Start With Identifying Problem To Solve - HBW Insight - March 22nd, 2024 [March 22nd, 2024]
- Why Super Micro Computer, Advanced Micro Devices, and Other Artificial Intelligence (AI) Stocks Tumbled on Tuesday - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- 3 Billionaires Are Selling Artificial Intelligence (AI) Stock Nvidia and Buying These 10 AI Stocks Instead - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Nvidia Just Bought 5 Artificial Intelligence (AI) Stocks. These 2 Stand Out the Most. - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- UN adopts first global artificial intelligence resolution - ARMENPRESS - March 22nd, 2024 [March 22nd, 2024]
- This New Artificial Intelligence (AI) Chip Is a Massive Game Changer for Nvidia Stock - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Nvidia Led the First Phase of Artificial Intelligence (AI), but These 2 Growth Stocks Will Lead the Next Phases ... - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Meet Wall Street's Newest Stock-Split Stock, Along With the Artificial Intelligence (AI) Stock Likeliest to Follow in Its ... - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Amid Rumors of a Deal With Rivian, Apple Acquired This Artificial Intelligence (AI) Start-Up Instead - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- UN adopts first global artificial intelligence resolution - CGTN - March 22nd, 2024 [March 22nd, 2024]
- 1 No-Brainer Artificial Intelligence (AI) Stock to Buy With $25 and Hold for 10 Years - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- 2 Artificial Intelligence (AI) Stocks That Could Make You a Millionaire - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Is Intel the Best Artificial Intelligence (AI) Semiconductor Stock to Buy Before It Skyrockets? - The Motley Fool - February 20th, 2024 [February 20th, 2024]
- The greater social implications of artificial intelligence - New Day NW - KING5.com - February 20th, 2024 [February 20th, 2024]
- AI comes to the world of beauty as eyelash robot uses artificial intelligence to place fake lashes - Fox News - February 20th, 2024 [February 20th, 2024]
- Beyer Appointed To Bipartisan Task Force On Artificial Intelligence - Falls Church News Press - February 20th, 2024 [February 20th, 2024]
- Why Did Nvidia Invest in These 5 Artificial Intelligence (AI) Stocks? Should You Buy Them, Too? - The Motley Fool - February 20th, 2024 [February 20th, 2024]
- Three key themes on artificial intelligence - Research Information - February 20th, 2024 [February 20th, 2024]
- How Artificial Intelligence is transforming consumerism - WFLA - February 20th, 2024 [February 20th, 2024]
- SAP names Philipp Herzig as chief artificial intelligence officer - CIO - February 20th, 2024 [February 20th, 2024]
- Unleashing the Power of Artificial Intelligence: Transforming Web-Based Applications for Enhanced Efficiency and User ... - Financialbuzz.com - February 20th, 2024 [February 20th, 2024]
- Koch Industries continues to accelerate its artificial intelligence initiative - The Business Journals - February 20th, 2024 [February 20th, 2024]
- Forget Nvidia: These 3 Artificial Intelligence (AI) Stocks Can Be the Next Stock-Split Stocks - The Motley Fool - February 20th, 2024 [February 20th, 2024]
- Artificial Intelligence for small business focus of upcoming JWCC Lunch and Learn on Feb. 28 Muddy River News - Muddy River News - February 20th, 2024 [February 20th, 2024]
- Opponents Highlight the Environmental Impact of Artificial Intelligence - News-Press Now - February 20th, 2024 [February 20th, 2024]
- Generative AI's environmental costs are soaring and mostly secret - Nature.com - February 20th, 2024 [February 20th, 2024]
- Chapter Summary: Genesis of Artificial Intelligence and a Scientific Revolution: 1950-1979 - EIN News - February 20th, 2024 [February 20th, 2024]
- What would Thomas Aquinas make of Artificial Intelligence? - ACI Africa - February 20th, 2024 [February 20th, 2024]
- ChatGPT Predicted Bitcoin Price Will "Skyrocket" - Cryptonews - February 20th, 2024 [February 20th, 2024]
- Worried About an Artificial Intelligence (AI) Stock Bubble? Consider This Billionaire Investor's Advice. - Yahoo Finance - February 20th, 2024 [February 20th, 2024]
- This Super Artificial Intelligence (AI) Stock Could Be at the Beginning of a Terrific Bull Run - Yahoo Finance - February 20th, 2024 [February 20th, 2024]
- 5 Artificial Intelligence (AI) Stocks That Could Make You a Millionaire - Yahoo Finance - February 20th, 2024 [February 20th, 2024]
- Will AI replace Colorado teachers? Here's what experts say. - The Colorado Sun - February 20th, 2024 [February 20th, 2024]
- Nvidia Could Be About to Counter a Big Artificial Intelligence (AI) Threat With This Move - Yahoo Finance - February 20th, 2024 [February 20th, 2024]
- The Healthiest U.S. Pharma Companies: Ranked by RealRate's Impressive Artificial Intelligence - Medium - February 20th, 2024 [February 20th, 2024]
- Down 84%, Is This Artificial Intelligence (AI) Stock a Buy After an Earnings Pop? - The Motley Fool - February 20th, 2024 [February 20th, 2024]
- 'AI for Humans' may be the most entertaining way to learn about artificial intelligence - Fast Company - February 20th, 2024 [February 20th, 2024]