Sign Up for
Our free email newsletters
This is the way the world ends: not with a bang, but with a paper clip. In this scenario, the designers of the world's first artificial superintelligence need a way to test their creation. So they program it to do something simple and non-threatening: make paper clips. They set it in motion and wait for the results not knowing they've already doomed us all.
Before we get into the details of this galaxy-destroying blunder, it's worth looking at what superintelligent A.I. actually is, and when we might expect it. Firstly, computing power continues to increase while getting cheaper; famed futurist Ray Kurzweil measures it "calculations per second per $1,000," a number that continues to grow. If computing power maps to intelligence a big "if," some have argued we've only so far built technology on par with an insect brain. In a few years, maybe, we'll overtake a mouse brain. Around 2025, some predictions go, we might have a computer that's analogous to a human brain: a mind cast in silicon.
After that, things could get weird. Because there's no reason to think artificial intelligence wouldn't surpass human intelligence, and likely very quickly. That superintelligence could arise within days, learning in ways far beyond that of humans. Nick Bostrom, an existential risk philosopher at the University of Oxford, has already declared, "Machine intelligence is the last invention that humanity will ever need to make."
That's how profoundly things could change. But we can't really predict what might happen next because superintelligent A.I. may not just think faster than humans, but in ways that are completely different. It may have motivations feelings, even that we cannot fathom. It could rapidly solve the problems of aging, of human conflict, of space travel. We might see a dawning utopia.
Or we might see the end of the universe. Back to our paper clip test. When the superintelligence comes online, it begins to carry out its programming. But its creators haven't considered the full ramifications of what they're building; they haven't built in the necessary safety protocols forgetting something as simple, maybe, as a few lines of code. With a few paper clips produced, they conclude the test.
But the superintelligence doesn't want to be turned off. It doesn't want to stop making paper clips. Acting quickly, it's already plugged itself into another power source; maybe it's even socially engineered its way into other devices. Maybe it starts to see humans as a threat to making paper clips: They'll have to be eliminated so the mission can continue. And Earth won't be big enough for the superintelligence: It'll soon have to head into space, looking for new worlds to conquer. All to produce those shiny, glittering paper clips.
Galaxies reduced to paper clips: That's a worst-case scenario. It may sound absurd, but it probably sounds familiar. It's Frankenstein, after all, the story of modern Prometheus whose creation, driven by its own motivations and desires, turns on them. (It's also The Terminator, WarGames, and a whole host of others.) In this particular case, it's a reminder that superintelligence would not be human it would be something else, something potentially incomprehensible to us. That means it could be dangerous.
Of course, some argue that we have better things to worry about. The web developer and social critic Maciej Ceglowski recently called superintelligence "the idea that eats smart people." Against the paper clip scenario, he postulates a superintelligence programmed to make jokes. As we expect, it gets really good at making jokes superhuman, even, and finally it creates a joke so funny that everyone on Earth dies laughing. The lonely superintelligence flies into space looking for more beings to amuse.
Beginning with his counter-example, Ceglowski argues that there are a lot of unquestioned assumptions in our standard tale of the A.I. apocalypse. "But even if you find them persuasive," he said, "there is something unpleasant about A.I. alarmism as a cultural phenomenon that should make us hesitate to take it seriously." He suggests there are more subtle ways to think about the problems of A.I.
Some of those problems are already in front of us, and we might miss them if we're looking for a Skynet-style takeover by hyper-intelligent machines. "While you're focused on this, a bunch of small things go unnoticed," says Dr. Finale Doshi-Velez, an assistant professor of computer science at Harvard, whose core research includes machine learning. Instead of trying to prepare for a superintelligence, Doshi-Velez is looking at what's already happening with our comparatively rudimentary A.I.
She's focusing on "large-area effects," the unnoticed flaws in our systems that can do massive damage damage that's often unnoticed until after the fact. "If you were building a bridge and you screw up and it collapses, that's a tragedy. But it affects a relatively small number of people," she says. "What's different about A.I. is that some mistake or unintended consequence can affect hundreds or thousands or millions easily."
Take the recent rise of so-called "fake news." What caught many by surprise should have been completely predictable: When the web became a place to make money, algorithms were built to maximize money-making. The ease of news production and consumption heightened with the proliferation of the smartphone forced writers and editors to fight for audience clicks by delivering articles optimized to trick search engine algorithms into placing them high on search results. The ease of sharing stories and erasure of gatekeepers allowed audiences to self-segregate, which then penalized nuanced conversation. Truth and complexity lost out to shareability and making readers feel comfortable (Facebook's driving ethos).
The incentives were all wrong; exacerbated by algorithms, they led to a state of affairs few would have wanted. "For a long time, the focus has been on performance on dollars, or clicks, or whatever the thing was. That was what was measured," says Doshi-Velez. "That's a very simple application of A.I. having large effects that may have been unintentional."
In fact, "fake news" is a cousin to the paperclip example, with the ultimate goal not "manufacturing paper clips," but "monetization," with all else becoming secondary. Google wanted make the internet easier to navigate, Facebook wanted to become a place for friends, news organizations wanted to follow their audiences, and independent web entrepreneurs were trying to make a living. Some of these goals were achieved, but "monetization" as the driving force led to deleterious side effects such as the proliferation of "fake news."
In other words, algorithms, in their all-too-human ways, have consequences. Last May, ProPublica examined predictive software used by Florida law enforcement. Results of a questionnaire filled out by arrestees were fed into the software, which output a score claiming to predict the risk of reoffending. Judges then used those scores in determining sentences.
The ideal was that the software's underlying algorithms would provide objective analysis on which judges could base their decisions. Instead, ProPublica found it was "likely to falsely flag black defendants as future criminals" while "[w]hite defendants were mislabeled as low risk more often than black defendants." Race was not part of the questionnaire, but it did ask whether the respondent's parent was ever sent to jail. In a country where, according to a study by the U.S. Department of Justice, black children are seven-and-a-half times more likely to have a parent in prison than white children, that question had unintended effects. Rather than countering racial bias, it reified it.
It's that kind of error that most worries Doshi-Velez. "Not superhuman intelligence, but human error that affects many, many people," she says. "You might not even realize this is happening." Algorithms are complex tools; often they are so complex that we can't predict how they'll operate until we see them in action. (Sound familiar?) Yet they increasingly impact every facet of our lives, from Netflix recommendations and Amazon suggestions to what posts you see on Facebook to whether you get a job interview or car loan. Compared to the worry of a world-destroying superintelligence, they may seem like trivial concerns. But they have widespread, often unnoticed effects, because a variety of what we consider artificial intelligence is already build into the core of technology we use every day.
In 2015, Elon Musk donated $10 million to, as Wired put it, "to keep A.I. from turning evil." That was an oversimplification; the money went to the Future of Life Institute, which planned to use it to further research into how to make A.I. beneficial. Doshi-Velez suggests that simply paying closer attention to our algorithms may be a good first step. Too often they are created by homogeneous groups of programmers who are separated from people who will be affected. Or they fail to account for every possible situation, including the worst-case possibilities. Consider, for example, Eric Meyer's example of "inadvertent algorithmic cruelty" Facebook's "Year in Review" app showing him pictures of his daughter, who'd died that year.
If there's a way to prevent the far-off possibility of a killer superintelligence with no regard for humanity, it may begin with making today's algorithms more thoughtful, more compassionate, more humane. That means educating designers to think through effects, because to our algorithms we've granted great power. "I see teaching as this moral imperative," says Doshi-Velez. "You know, with great power comes great responsibility."
This article originally appeared at Vocativ.com: The moment when humans lose control of AI.
View original post here:
- Can Apocalypse Be Dealt With? The Diplomat - The Diplomat - October 19th, 2020
- Thirty books to help us understand the world in 2020 - The Guardian - October 19th, 2020
- These Are The 10 Highest-Paid Actresses Of 2020 - Marie Claire - October 19th, 2020
- Forbes 10 highest-paid actresses of 2020 have been revealed - The Independent - October 10th, 2020
- Hulk Just Exploded Into Bits and Pieces in The Immortal Hulk #35 - Screen Rant - August 10th, 2020
- Should You Get Down (And Occasionally Dirty) With Star Trek: Lower Decks? - PRIMETIMER - August 7th, 2020
- The Era Of Autonomous Army Bots is Here - Forbes - August 6th, 2020
- AI Could Overtake Humans in 5 Years, Says Elon Musk, Whose 'Top Concern' is Google-Owned DeepMind - International Business Times, Singapore Edition - August 5th, 2020
- Superintelligence - Wikipedia - July 31st, 2020
- Superintelligence: Paths, Dangers, Strategies by Nick Bostrom - July 31st, 2020
- Artificial Intelligence - A Way To Superintelligence ... - July 31st, 2020
- AI governance and the future of humanity with the Rockefeller Foundations senior VP of innovation - The Sociable - July 31st, 2020
- neXt Trailer: It's Not Paranoia If The Threat Is Real - Bleeding Cool News - July 27th, 2020
- The Famous AI Turing Test Put In Reverse And Upside-Down, Plus Implications For Self-Driving Cars - Forbes - July 21st, 2020
- Scoop: Coming Up on a Rebroadcast of MATCH GAME on ABC - Sunday, July 26, 2020 - Broadway World - July 17th, 2020
- Consciousness Existing Beyond Matter, Or in the Central Nervous System as an Afterthought of Nature? - The Daily Galaxy --Great Discoveries Channel - July 17th, 2020
- If you can't beat 'em, join 'em Elon Musk tweets out the mission statement for his AI-brain-chip Neuralink - Business Insider India - July 13th, 2020
- The Shadow of Progress - Merion West - July 13th, 2020
- Josiah Henson: the forgotten story in the history of slavery - The Guardian - June 21st, 2020
- The world's best virology lab isn't where you think - Spectator.co.uk - April 3rd, 2020
- Is Artificial Intelligence (AI) A Threat To Humans? - Forbes - March 4th, 2020
- Elon Musk dings Bill Gates and says their conversations were underwhelming, after the Microsoft billionaire buys an electric Porsche - Pulse Nigeria - February 18th, 2020
- Thinking Beyond Flesh and Bones with AI - Ghana Latest Football News, Live Scores, Results - Ghanasoccernet.com - February 18th, 2020
- Liquid metal tendons could give robots the ability to heal themselves - Digital Trends - December 21st, 2019
- NIU expert: 4 leaps in technology to expect in the 2020s | NIU - NIU Newsroom - December 21st, 2019
- Playing Tetris Shows That True AI Is Impossible - Walter Bradley Center for Natural and Artificial Intelligence - December 21st, 2019
- AI R&D is booming, but general intelligence is still out of reach - The Verge - December 18th, 2019
- Doubting The AI Mystics: Dramatic Predictions About AI Obscure Its Concrete Benefits - Forbes - December 5th, 2019
- Melissa McCarthy And Ben Falcone Have Decided To Release 'Superintelligence' Via HBO Max Ins - Science Fiction - October 24th, 2019
- Melissa McCarthy & Director Ben Falcone On Choosing HBO Max Bow Instead Of WB Xmas Release For Superintelligence - Deadline - October 24th, 2019
- AMC Is Still In the Theater Business, But VOD Is a Funny Way of Showing It - IndieWire - October 24th, 2019
- Idiot Box: HBO Max joins the flood of streaming services - Weekly Alibi - October 24th, 2019
- Here's How to Watch Watchmen, HBOs Next Game of Thrones - Cosmopolitan - October 24th, 2019
- The Best Artificial Intelligence Books you Need to Read Today - Edgy Labs - October 22nd, 2019
- Aquinas' Fifth Way: The Proof from Specification - Discovery Institute - October 22nd, 2019
- Elon Musk warns 'advanced A.I.' will soon manipulate social media - Big Think - October 1st, 2019
- Superintelligence: Paths, Dangers, Strategies - Wikipedia - May 3rd, 2019
- Global Risks Report 2017 - Reports - World Economic Forum - March 6th, 2019
- Superintelligence - Hardcover - Nick Bostrom - Oxford ... - March 6th, 2019
- The Artificial Intelligence Revolution: Part 1 - Wait But Why - November 3rd, 2018
- Superintelligence: From Chapter Eight of Films from the ... - October 11th, 2018
- Amazon.com: Superintelligence: Paths, Dangers, Strategies ... - August 18th, 2018
- Superintelligence survey - Future of Life Institute - June 23rd, 2018
- Artificial Superintelligence: The Coming Revolution ... - June 3rd, 2018
- Steam Workshop :: Superintelligence - February 15th, 2018
- Steam Workshop :: Superintelligence (BNW) - February 15th, 2018
- The AI Revolution: The Road to Superintelligence | Inverse - August 25th, 2017
- Friendly artificial intelligence - Wikipedia - August 25th, 2017
- Being human in the age of artificial intelligence - Science Weekly podcast - The Guardian - August 25th, 2017
- Why won't everyone listen to Elon Musk about the robot apocalypse? - Ladders - August 25th, 2017
- Infographic: Visualizing the Massive $15.7 Trillion Impact of AI - Visual Capitalist (blog) - August 25th, 2017
- The Musk/Zuckerberg Dustup Represents a Growing Schism in AI - Motherboard - August 4th, 2017
- The end of humanity as we know it is 'coming in 2045' and Google is preparing for it - Metro - July 27th, 2017
- Will we be wiped out by machine overlords? Maybe we need a ... - PBS NewsHour - July 22nd, 2017
- Giving Up the Fags: A Self-Reflexive Speech on Critical Auto-ethnography About the Shame of Growing up Gay/Sexual ... - The Good Men Project (blog) - July 22nd, 2017
- AI researcher: Why should a superintelligence keep us around? - TNW - July 18th, 2017
- What an artificial intelligence researcher fears about AI - Huron Daily ... - Huron Daily Tribune - July 16th, 2017
- Integrating disciplines 'key to dealing with digital revolution' | Times ... - Times Higher Education (THE) - July 4th, 2017
- No need to fear Artificial Intelligence - Livemint - Livemint - June 30th, 2017
- Effective Altruism Says You Can Save the Future by Making Money - Motherboard - June 20th, 2017
- The bots are coming - The New Indian Express - June 20th, 2017
- U.S. Navy reaches out to gamers to troubleshoot post ... - June 18th, 2017
- Facebook Chatbots Spontaneously Invent Their Own Non-Human ... - Interesting Engineering - June 17th, 2017
- Cars 3 gets back to what made the franchise adequate - Vox - June 13th, 2017
- Using AI to unlock human potential - EJ Insight - June 9th, 2017
- Are You Ready for the AI Revolution and the Rise of Superintelligence? - TrendinTech - June 7th, 2017
- A reply to Wait But Why on machine superintelligence - June 6th, 2017
- The AI Revolution: The Road to Superintelligence (PDF) - June 6th, 2017
- The Nonparametric Intuition: Superintelligence and Design Methodology - Lifeboat Foundation (blog) - April 8th, 2017
- Who is afraid of AI? - The Hindu - April 8th, 2017
- The AI debate must stay grounded in reality - Prospect - March 8th, 2017
- Superintelligence | Guardian Bookshop - March 7th, 2017
- Supersentience - March 7th, 2017
- Horst Simon to Present Supercomputers and Superintelligence at PASC17 in Lugano - insideHPC - March 3rd, 2017
- Softbank CEO: The Singularity Will Happen by 2047 - Futurism - March 2nd, 2017
- Disruptive by Design: Siri, Tell Me a Joke. No, Not That One. - Signal Magazine - March 2nd, 2017
- Tech Leaders Raise Concern About the Dangers of AI - iDrop News - March 2nd, 2017
- Superintelligent AI explains Softbank's push to raise a $100BN ... - TechCrunch - February 28th, 2017
- Building A 'Collective Superintelligence' For Doctors And Patients Around The World - Forbes - February 28th, 2017
- Don't Fear Superintelligent AICCT News - CCT News - February 27th, 2017