Perfectly imperfect
What is the acceptable failure rate of an airplane? Well, it is not zero no matter what how hard we want to believe otherwise. There is a number, and it is a very low number. When it comes to machines, computers, artificial intelligence, etc., they are perfectly imperfect. Mistakes will be made. Poor recommendations will occur. AI will never be perfect. That does not mean they do not provide value. People need to understand why machines may mistakes and set their beliefs accordingly. This means understanding the three key areas on why AI fails: implicit bias, poor data, and expectations.
The first challenge is implicit bias, which are the unconscious perceptions people have that cloud thoughts and actions. Consider, the recent protests on racial justice and police brutality and the powerful message that Black Lives Matter. The Forbes article AI Taking A Knee: Action To Improve Equal Treatment Under The Law is a great example of how implicit bias has played a role in the discrimination and just how hard (but not impossible) it is to use AI to reduce prejudice in our law enforcement and judicial systems. AI learns from people. If implicit bias is in the training, then the AI will learn this bias. Moreover, when the AI performs work, that work will reflect this bias even if the work is for social good.
Take for example the Allegheny Family Screening Tool. It is meant to predict which welfare children might be at risk from foster parent abuse. The initial rollout of this solution had some challenges though. The local Department of Human Services acknowledged that the tool might have racial and income bias. Triggers like neglect were often confused or misconstrued by associating foster parents who lived in poverty with inattention or mistreatment. Since learning of these problems, tremendous steps were taken to reduce the implicit bias in the screening tool. Elimination is much harder. When it comes to bias, how do people manage the unknown unknowns? How is social context addressed? What does right or fair behavior mean? If people cannot identify, define, and resolve these questions, then how will they teach the machine? This is a major driver AI will be perfectly imperfect because of implicit bias.
Coronavirus 2019 - ncov flu infection - 3D illustration
The second challenge is data. Data is the fuel for AI. The machine trains through ground truth (i.e. rules on how to make decisions, not the decisions themselves) and from lots of big data to learn the patterns and relationships within the data. If our data is incomplete or flawed, then AI cannot learn well. Consider COVID-19. John Hopkins, The COVID Tracking Project, U.S. Centers for Disease Control (CDC), and the World Health Organization all report different numbers. With such variation, it is very difficult for an AI to gleam meaningful patterns from the data let alone find those hidden insights. More challenging, what about incomplete or erroneous data? Imagine teaching an AI about healthcare but only providing data on womens health. That impedes how we can use AI in healthcare.
Then there is a challenge in that people may provide too much data. It could be irrelevant, unmeaningful, or even a distraction. Consider when IBM had Watson read the Urban Dictionary, and then it could not distinguish when to use normal language or to use slang and curse words. The problem got so bad that IBM had to erase the Urban Dictionary from Watsons memory. Similarly, an AI system needs to hear about 100 million words to become fluent in a language. However, a human child only seems to need around 15 million words to become fluent. This implies that we may not know what data is meaningful. Thus, AI trainers may actually focus on superfluous information that could lead the AI to waste time, or even worse, identify false patterns.
The third challenge is expectations. Even though humans make mistakes, people still expect machines to be perfect. In healthcare, experts have estimated that the misdiagnosis rate may be as high as 20%, which means potentially one out of five patients are misdiagnosed. Given this data as well as a scenario where an AI assisted diagnosis may have an error rate of one out of one hundred thousand, most people still prefer to see only the human doctor. Why? One of the most common reasons given is that the misdiagnosis rate of the AI is too high (even though it is much lower than a human doctor.) People expect AI to be perfect. Potentially even worse, people expect the human AI trainers to be perfect too.
On March 23, 2016, Microsoft launched Tay (Thinking About You), a Twitter bot. Microsoft had trained its AI to the level of language and interaction of a 19-year-old, American girl. In a grand social experiment, Tay was released to the world. 96,000 tweets later, Microsoft had to shut Tay down about 16 hours after launch because it had turned sexist, racist, and promoted Nazism. Regrettably, some individuals decided to teach Tay about seditious language to corrupt it. In conjunction, Microsoft did not think to teach Tay about inappropriate behavior so it had no basis (or reason) to know that something like inappropriate behavior and malicious intent might exist. The grand social experiment resulted in failure, and sadly, was probably a testament more about human society than the limitations of AI.
nobodys perfect
Implicit bias, poor data, and people expectations show that AI will never be perfect. It is not the magic bullet solution many people hope to have. AI can still do some extraordinary things for humans like restore mobility to a lost limb or improve food production while using less resources. People should not discount the value we can get. We should always remember: AI is perfectly imperfect, just like us.
Read more from the original source:
Perfectly Imperfect: Coping With The Flaws Of Artificial Intelligence (AI) - Forbes
- Use of Artificial Intelligence in the Prediction of Chiari Malformation Type 1 Recurrence After Posterior Fossa ... - Cureus - May 23rd, 2024 [May 23rd, 2024]
- Fritz Lang First Depicted Artificial Intelligence on Film in Metropolis (1927), and It Frightened People Even Then - Open Culture - May 23rd, 2024 [May 23rd, 2024]
- Dehumanizing the Wars: Introduction of Artificial Intelligence in the Warfare - Modern Diplomacy - May 23rd, 2024 [May 23rd, 2024]
- Google Parent Alphabet Is Selling Shares of 2 Hypergrowth Stocks and Piling Into a Promising Artificial Intelligence (AI ... - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- Meta AI Head: ChatGPT Will Never Reach Human Intelligence - PYMNTS.com - May 23rd, 2024 [May 23rd, 2024]
- Waiting for Alexa: When Will Amazon Strike Up the AI Conversation? - PYMNTS.com - May 23rd, 2024 [May 23rd, 2024]
- Artificial intelligence town halls? House committee weighs new approach before writing AI rules - Washington Times - May 23rd, 2024 [May 23rd, 2024]
- Inventing AI: Tracing the diffusion of artificial intelligence with U.S. patents - United States Patent and Trademark Office - May 23rd, 2024 [May 23rd, 2024]
- UM6P to Host High-Level Forum on Artificial Intelligence, Development in Africa - Morocco World News - May 23rd, 2024 [May 23rd, 2024]
- DHS warns of threats to election posed by artificial intelligence - ABC News - May 23rd, 2024 [May 23rd, 2024]
- Artificial intelligence, great wealth transfer: Why this financial analyst sees a rosy time ahead for stocks - CNBC - May 23rd, 2024 [May 23rd, 2024]
- As S&P 500 reaches fresh highs, experts say generative artificial intelligence will create new investment opportunities - CNBC - May 23rd, 2024 [May 23rd, 2024]
- Google Parent Alphabet Is Selling Shares of 2 Hypergrowth Stocks and Piling Into a Promising Artificial Intelligence (AI ... - MSN - May 23rd, 2024 [May 23rd, 2024]
- The Best Artificial Intelligence (AI) ETF to Invest $1,000 in Right Now - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- How To Land A Job In Artificial Intelligence (AI) - Forbes - May 23rd, 2024 [May 23rd, 2024]
- Madhumita Murgia On The Good, Bad And Ugly Of Artificial Intelligence In Our Daily Lives - Forbes India - May 23rd, 2024 [May 23rd, 2024]
- Researchers use artificial intelligence to classify brain tumors - Voice of America - VOA News - May 23rd, 2024 [May 23rd, 2024]
- BBVA steps up its plans in artificial intelligence by signing an agreement with OpenAI - BBVA - May 23rd, 2024 [May 23rd, 2024]
- 2 Artificial Intelligence (AI) Stocks You Can Buy and Hold for the Next Decade - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- Study including WVU and Marshall analyzes cyber threats to Artificial Intelligence systems - West Virginia MetroNews - May 23rd, 2024 [May 23rd, 2024]
- Stock-Split Watch: 5 Artificial Intelligence (AI) Stocks That Look Ready to Split - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- 2 Spectacular ETFs That Can Help You Capitalize on the Artificial Intelligence (AI) Boom - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- NASA pledging responsible use of artificial intelligence | National | khq.com - KHQ Right Now - May 23rd, 2024 [May 23rd, 2024]
- 1 Stock Down 11% to Buy Before Artificial Intelligence (AI) Could Supercharge Its Growth and Send It Soaring - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- Alphabet Goes All In on Artificial Intelligence (AI). Is It Time to Go All In on the Stock? - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- A Once-in-a-Generation Investment Opportunity: Here's 1 Artificial Intelligence (AI) Stock to Buy in May and Hold Forever - Yahoo Finance - May 23rd, 2024 [May 23rd, 2024]
- 2 Artificial Intelligence (AI) Stocks That Offer Dividends and Long-Term Returns - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- Forget Nvidia: Billionaires Are Selling It and Buying These 2 Supercharged Artificial Intelligence (AI) Growth Stocks ... - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- 1 Ridiculously Undervalued Artificial Intelligence (AI) Stock to Buy Hand Over Fist - Yahoo Finance - May 23rd, 2024 [May 23rd, 2024]
- Missed Out on Nvidia's Ginormous Gains? Here's an Artificial Intelligence (AI) Stock You Can Buy Right Now. - The Motley Fool - May 23rd, 2024 [May 23rd, 2024]
- Researchers create innovative verification techniques to increase security in artificial intelligence and image processing - European Research Council - April 29th, 2024 [April 29th, 2024]
- Who in Europe is investing the most in artificial intelligence? - Euronews - April 29th, 2024 [April 29th, 2024]
- 4 Artificial Intelligence (AI) Stocks Members of Congress Can't Stop Buying (and Nvidia Isn't 1 of Them!) - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- The Standard Names Porter Orr Second Vice President of Artificial Intelligence Strategy and Development - NRToday.com - April 29th, 2024 [April 29th, 2024]
- Meet Nvidia CEO Jensen Huang, the man behind the $2 trillion company powering today's artificial intelligence - CBS News - April 29th, 2024 [April 29th, 2024]
- This Warren Buffett Dividend King Stock Just Invested $1.1 Billion Into Artificial Intelligence (AI) - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- Joe Rogan Reveals What Could Be 'Game Over for the Human Race' - Newsweek - April 29th, 2024 [April 29th, 2024]
- LegalTech Artificial Intelligence Market to Soar to $6.4 Billion by 2028: Global Long-term Forecast to 2033 - Strategic ... - Yahoo Finance UK - April 29th, 2024 [April 29th, 2024]
- Artificial Intelligence Tokens Stumble Again! Is The AI Hype Over? - Coinpedia Fintech News - April 29th, 2024 [April 29th, 2024]
- CISA unveils guidelines for AI and critical infrastructure - FedScoop - April 29th, 2024 [April 29th, 2024]
- IBM's Webinar: Cybersecurity In The Era Of Artificial Intelligence Keynotes - AiThority - April 29th, 2024 [April 29th, 2024]
- Being and becoming a good doctor in the age of artificial intelligence - Firstpost - April 29th, 2024 [April 29th, 2024]
- Pope to take part in G7 summit in June to talk Artificial Intelligence - Crux Now - April 29th, 2024 [April 29th, 2024]
- Pope Francis to attend G7 summit to speak on artificial intelligence - Catholic News Agency - April 29th, 2024 [April 29th, 2024]
- 1 Unstoppable Artificial Intelligence (AI) Stock to Buy and Hold Forever - Yahoo Finance - April 29th, 2024 [April 29th, 2024]
- Pope to bring his call for ethical artificial intelligence to G7 summit in June in southern Italy - The Associated Press - April 29th, 2024 [April 29th, 2024]
- Elon Musk Called Tesla an Artificial Intelligence (AI) Robotics Company. Does That Make It a Buy? - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- Emulating neurodegeneration and aging in artificial intelligence systems - Tech Xplore - April 29th, 2024 [April 29th, 2024]
- Pope Francis to participate in G7 session on AI - Vatican News - English - April 29th, 2024 [April 29th, 2024]
- A Once-in-a-Generation Investment Opportunity: 1 Bill Ackman Artificial Intelligence (AI) Stock to Buy Hand Over Fist ... - Yahoo Finance - April 29th, 2024 [April 29th, 2024]
- Tesla Stock Investors Cheer Progress on Its Artificial Intelligence (AI) Future - Yahoo Finance - April 29th, 2024 [April 29th, 2024]
- In Race to Build A.I., Tech Plans a Big Plumbing Upgrade - The New York Times - April 29th, 2024 [April 29th, 2024]
- A Baltimore-area teacher is accused of using AI to make his boss appear racist - NPR - April 29th, 2024 [April 29th, 2024]
- 3 Top Artificial Intelligence (AI) Stocks That Billionaires Jim Simons, Ray Dalio, and Israel Englander Are Buying - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- The iPad Pro can give us a big surprise with its artificial intelligence chips. - Softonic EN - April 29th, 2024 [April 29th, 2024]
- This Artificial Intelligence (AI) Stock Could Soar 70%, According to Wall Street. Time to Buy? - Yahoo Finance - April 29th, 2024 [April 29th, 2024]
- Billionaire Bill Ackman Owns 8 Stocks -- and This Hypergrowth Artificial Intelligence (AI) Stock Isn't One of Them - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- Artificial Intelligence Has Come for Our...Beauty Pageants? - Glamour - April 29th, 2024 [April 29th, 2024]
- 3 Stocks to Grab Now to Ride the Artificial Intelligence Chip Boom to Riches - InvestorPlace - April 29th, 2024 [April 29th, 2024]
- Is ASML's Big Sell-off a Warning Sign to Artificial Intelligence (AI) Investors? - The Motley Fool - April 29th, 2024 [April 29th, 2024]
- 3 Artificial Intelligence (AI) Stocks to Buy With $1,150 and Hold for Decades - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- This combines the power of artificial intelligence with human insights - finews.com - March 22nd, 2024 [March 22nd, 2024]
- Cohere Targets $5 Billion Valuation for ChatGPT Rival - PYMNTS.com - March 22nd, 2024 [March 22nd, 2024]
- IMF: Artificial Intelligence (AI) Will Transform 40% of Jobs. Can Investors Capitalize? - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- Cathie Wood Is Selling These 2 Artificial Intelligence (AI) Stocks. Should You? - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- iShares Robotics and Artificial Intelligence Multisector ETF (NYSEARCA:IRBO) Shares Acquired by Creative Financial ... - Defense World - March 22nd, 2024 [March 22nd, 2024]
- Inaugural Plenary Meeting of States Endorsing the Political Declaration on Responsible Military Use of Artificial ... - Department of State - March 22nd, 2024 [March 22nd, 2024]
- AMD Fell Today -- Is This a Chance to Buy the Artificial Intelligence (AI) Stock? - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- Artificial Intelligence (AI) Stocks Are Red-Hot, but Here's 1 to Avoid (for Now) - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- A Once-in-a-Generation Investment Opportunity: 1 Artificial Intelligence (AI) Growth Stock to Buy and Hold Forever - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- 2 Artificial Intelligence (AI) Stocks That Could Go Parabolic - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Artificial intelligence will radically improve health care, but only if managed carefully - The Hill - March 22nd, 2024 [March 22nd, 2024]
- Tennessee Makes A.I. an Outlaw to Protect Its Country Music and More - The New York Times - March 22nd, 2024 [March 22nd, 2024]
- When Using Artificial Intelligence In Pharma R&D, Start With Identifying Problem To Solve - HBW Insight - March 22nd, 2024 [March 22nd, 2024]
- Why Super Micro Computer, Advanced Micro Devices, and Other Artificial Intelligence (AI) Stocks Tumbled on Tuesday - Yahoo Finance - March 22nd, 2024 [March 22nd, 2024]
- 3 Billionaires Are Selling Artificial Intelligence (AI) Stock Nvidia and Buying These 10 AI Stocks Instead - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Nvidia Just Bought 5 Artificial Intelligence (AI) Stocks. These 2 Stand Out the Most. - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- UN adopts first global artificial intelligence resolution - ARMENPRESS - March 22nd, 2024 [March 22nd, 2024]
- This New Artificial Intelligence (AI) Chip Is a Massive Game Changer for Nvidia Stock - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]
- Nvidia Led the First Phase of Artificial Intelligence (AI), but These 2 Growth Stocks Will Lead the Next Phases ... - The Motley Fool - March 22nd, 2024 [March 22nd, 2024]