The question is not so far-fetched. Robots are currently being developed to work inside nuclear reactors, fight wars and care for the elderly. As AIs grow more sophisticated, they are projected to take over many human jobs within the next few decades. So we must ponder the question: Could AIs develop conscious experience?
This issue is pressing for several reasons. First, ethicists worry that it would be wrong to force AIs to serve us if they can suffer and feel a range of emotions. Second, consciousness could make AIs volatile or unpredictable, raising safety concerns (or conversely, it could increase an AIs empathy; based on its own subjective experiences, it might recognize consciousness in us and treat us with compassion).
Third, machine consciousness could impact the viability of brain-implant technologies, like those to be developed by Elon Musks new company, Neuralink. If AI cannot be conscious, then the parts of the brain responsible for consciousness could not be replaced with chips without causing a loss of consciousness. And, in a similar vein, a person couldnt upload their brain to a computer to avoid death, because that upload wouldnt be a conscious being.
In addition, if AI eventually out-thinks us yet lacks consciousness, there would still be an important sense in which we humans are superior to machines; it feels like something to be us. But the smartest beings on the planet wouldnt be conscious or sentient.
A lot hangs on the issue of machine consciousness, then. Yet neuroscientists are far from understanding the basis of consciousness in the brain, and philosophers are at least equally far from a complete explanation of the nature of consciousness.
A test for machine consciousness
So what can be done? We believe that we do not need to define consciousness formally, understand its philosophical nature or know its neural basis to recognize indications of consciousness in AIs. Each of us can grasp something essential about consciousness, just by introspecting; we can all experience what it feels like, from the inside, to exist.
Based on this essential characteristic of consciousness, we propose a test for machine consciousness, the AI Consciousness Test (ACT), which looks at whether the synthetic minds we create have an experience-based understanding of the way it feels, from the inside, to be conscious.
One of the most compelling indications that normally functioning humans experience consciousness, although this is not often noted, is that nearly every adult can quickly and readily grasp concepts based on this quality of felt consciousness. Such ideas include scenarios like minds switching bodies (as in the film Freaky Friday); life after death (including reincarnation); and minds leaving their bodies (for example, astral projection or ghosts). Whether or not such scenarios have any reality, they would be exceedingly difficult to comprehend for an entity that had no conscious experience whatsoever. It would be like expecting someone who is completely deaf from birth to appreciate a Bach concerto.
Thus, the ACT would challenge an AI with a series of increasingly demanding natural language interactions to see how quickly and readily it can grasp and use concepts and scenarios based on the internal experiences we associate with consciousness. At the most elementary level we might simply ask the machine if it conceives of itself as anything other than its physical self.
At a more advanced level, we might see how it deals with ideas and scenarios such as those mentioned in the previous paragraph. At an advanced level, its ability to reason about and discuss philosophical questions such as the hard problem of consciousness would be evaluated. At the most demanding level, we might see if the machine invents and uses such a consciousness-based concept on its own, without relying on human ideas and inputs.
Consider this example, which illustrates the idea: Suppose we find a planet that has a highly sophisticated silicon-based life form (call them Zetas). Scientists observe them and ponder whether they are conscious beings. What would be convincing proof of consciousness in this species? If the Zetas express curiosity about whether there is an afterlife or ponder whether they are more than just their physical bodies, it would be reasonable to judge them conscious. If the Zetas went so far as to pose philosophical questions about consciousness, the case would be stronger still.
There are also nonverbal behaviors that could indicate Zeta consciousness such as mourning the dead, religious activities or even turning colors in situations that correlate with emotional challenges, as chromatophores do on Earth. Such behaviors could indicate that it feels like something to be a Zeta.
The death of the mind of the fictional HAL 9000 AI computer in Stanley Kubricks 2001: A Space Odyssey provides another illustrative example. The machine in this case is not a humanoid robot as in most science fiction depictions of conscious machines; it neither looks nor sounds like a human being (a human did supply HALs voice, but in an eerily flat way). Nevertheless, the content of what it says as it is deactivated by an astronaut specifically, a plea to spare it from impending death conveys a powerful impression that it is a conscious being with a subjective experience of what is happening to it.
Could such indicators serve to identify conscious AIs on Earth? Here, a potential problem arises. Even todays robots can be programmed to make convincing utterances about consciousness, and a truly superintelligent machine could perhaps even use information about neurophysiology to infer the presence of consciousness in humans. If sophisticated but non-conscious AIs aim to mislead us into believing that they are conscious for some reason, their knowledge of human consciousness could help them do so.
We can get around this though. One proposed technique in AI safety involves boxing in an AImaking it unable to get information about the world or act outside of a circumscribed domain, that is, the box. We could deny the AI access to the internet and indeed prohibit it from gaining any knowledge of the world, especially information about conscious experience and neuroscience.
We doubt a superintelligent machine could be boxed in effectively it would find a clever escape. We do not anticipate the development of superintelligence over the next decade, however. Furthermore, for an ACT to be effective, the AI need not stay in the box for long, just long enough administer the test.
ACTs also could be useful for consciousness engineering during the development of different kinds of AIs, helping to avoid using conscious machines in unethical ways or to create synthetic consciousness when appropriate.
Beyond the Turing Test
An ACT resembles Alan Turings celebrated test for intelligence, because it is entirely based on behavior and, like Turings, it could be implemented in a formalized question-and-answer format. (An ACT could also be based on an AIs behavior or on that of a group of AIs.)
But an ACT is also quite unlike the Turing test, which was intended to bypass any need to know what was transpiring inside the machine. By contrast, an ACT is intended to do exactly the opposite; it seeks to reveal a subtle and elusive property of the machines mind. Indeed, a machine might fail the Turing test because it cannot pass for human, but pass an ACT because it exhibits behavioral indicators of consciousness.
This is the underlying basis of our ACT proposal. It should be said, however, that the applicability of an ACT is inherently limited. An AI could lack the linguistic or conceptual ability to pass the test, like a nonhuman animal or an infant, yet still be capable of experience. So passing an ACT is sufficient but not necessary evidence for AI consciousness although it is the best we can do for now. It is a first step toward making machine consciousness accessible to objective investigations.
So, back to the superintelligent AI in the box we watch and wait. Does it begin to philosophize about minds existing in addition to bodies, like Descartes? Does it dream, as in Isaac Asimovs Robot Dreams? Does it express emotion, like Rachel in Blade Runner? Can it readily understand the human concepts that are grounded in our internal conscious experiences, such as those of the soul or atman?
The age of AI will be a time of soul-searching both of ours, and for theirs.
Susan Schneider, PhD, is a professor of philosophy and cognitive science at the University of Connecticut, a researcher at YHouse, Inc., in New York, a member of the Ethics and Technology Group at Yale University and a visiting member at the Institute for Advanced Study at Princeton. Her books include The Language of Thought, Science Fiction and Philosophy, and The Blackwell Companion to Consciousness (with Max Velmans). She is featured in the new film, Supersapiens, the Rise of the Mind.
Edwin L. Turner, PhD, is a professor of Astrophysical Sciences at Princeton University, an Affiliate Scientist at the Kavli Institute for the Physics and Mathematics of the Universe at the University of Tokyo, a visiting member in the Program in Interdisciplinary Studies at the Institute for Advanced Study in Princeton, and a co-founding Board of Directors member of YHouse, Inc. Recently he has been an active participant in the Breakthrough Starshot Initiative. He has taken an active interest in artificial intelligence issues since working in the AI Lab at MIT in the early 1970s.
By Susan Schneider, PhD, and Edwin Turner, PhD Originally published in Scientific American, July 19, 2017
View original post here:
- Mind uploading - 01 - November 8th, 2009 [November 8th, 2009]
- Mind uploading - 02 - November 8th, 2009 [November 8th, 2009]
- A new way to battle Mexican drug cartels - KLTV - March 8th, 2010 [March 8th, 2010]
- Mobile Health Screening Units Visit Lowe's Workers - International Supermarket News - March 8th, 2010 [March 8th, 2010]
- The quintessential sewing machine - Business Mirror - March 8th, 2010 [March 8th, 2010]
- The Future of Windows - Technologizer (blog) - March 8th, 2010 [March 8th, 2010]
- SEO Press Release Distribution Site Online PR News Celebrates 10000 Active Users - Online PR News (press release) - March 8th, 2010 [March 8th, 2010]
- Utilizing Online Mailing Services – Make the Most of Direct Marketing - RisMedia.com (press release) - March 8th, 2010 [March 8th, 2010]
- Carr's first look at 'Extreme' home - KLTV - March 8th, 2010 [March 8th, 2010]
- Should you advertise on iPhones? - Smart Company (blog) - March 8th, 2010 [March 8th, 2010]
- Review: Mega Man 10 - Destructoid - March 8th, 2010 [March 8th, 2010]
- Had I World Enough, and Time - Institute for Ethics and Emerging Technologies - March 8th, 2010 [March 8th, 2010]
- Unicast Continues Innovative Technology Enhancements With Latest Release of ... - CNNMoney.com (press release) - March 16th, 2010 [March 16th, 2010]
- Facebook scouts for 'passionate' India head - Economic Times - March 16th, 2010 [March 16th, 2010]
- SXSW: YouTube Launches Partner Program for Indie Bands - Wired News - March 17th, 2010 [March 17th, 2010]
- Wider Still and Wider! - Bangkok Post - March 17th, 2010 [March 17th, 2010]
- P2P Versus The World - Rampage - March 17th, 2010 [March 17th, 2010]
- Yakuza 3 - The MMOMFG Review - MMOMFG (blog) - March 17th, 2010 [March 17th, 2010]
- Behind the musings: The annotated high schools column - Chicago Tribune (blog) - March 17th, 2010 [March 17th, 2010]
- Jihad Jane, YouTube, and Me - David Horowitz's NewsReal Blog (blog) - March 17th, 2010 [March 17th, 2010]
- Justin Bieber Releases 'U Smile,' Announces Summer Tour Dates - MTV.com - March 17th, 2010 [March 17th, 2010]
- FCC announces National Broadband Plan - VentureBeat - March 17th, 2010 [March 17th, 2010]
- Image hosting on the cheap: a look at three free services - Ars Technica - March 17th, 2010 [March 17th, 2010]
- Content Management: Secrets of the Trade - Formtek Blog (blog) - March 17th, 2010 [March 17th, 2010]
- FCC's National Broadband Plan: There is a dark side - ZDNet - March 17th, 2010 [March 17th, 2010]
- 5 Reasons Old Media Should Buy Facebook - AllFacebook (blog) - March 17th, 2010 [March 17th, 2010]
- "Steal It" and Other Internal YouTube Emails from Viacom's Copyright Suit - Fast Company - March 19th, 2010 [March 19th, 2010]
- Now cafes in monument premises for tourists during CWG - Sify - March 19th, 2010 [March 19th, 2010]
- Google-Viacom court papers leave a lot to the imagination - FierceOnlineVideo - March 19th, 2010 [March 19th, 2010]
- FCC's broadband plan: A possible dream - Washington Post (blog) - March 19th, 2010 [March 19th, 2010]
- The Importance of Using Social Networking for Business; Part I – Facebook - IPWatchdog.com - March 19th, 2010 [March 19th, 2010]
- Recording YouTube Videos - Acoustic Guitar - March 19th, 2010 [March 19th, 2010]
- Who's using location-based social networking? - KC Free Press - March 20th, 2010 [March 20th, 2010]
- iPhone will continue to beckon BlackBerry owners - CNET - March 20th, 2010 [March 20th, 2010]
- Rain leaves its mark on Azalea Trail events - KLTV - March 21st, 2010 [March 21st, 2010]
- Viacom v. YouTube/Google: A Piracy Case in Their Own Words - DailyFinance - March 21st, 2010 [March 21st, 2010]
- Getting a look at next high-tech | Philadelphia Inquirer | 03/22/2010 - Philadelphia Inquirer - March 22nd, 2010 [March 22nd, 2010]
- Sprint chews on Apple while lauding 4G Overdrive hotspot - The Tech Herald - March 22nd, 2010 [March 22nd, 2010]
- 'Repo Men' contest -- the nationwide chase is almost over - Los Angeles Times (blog) - March 22nd, 2010 [March 22nd, 2010]
- Viacom vs. YouTube/Google: A Piracy Case in Their Own Words - DailyFinance - March 22nd, 2010 [March 22nd, 2010]
- These iPhone apps will help make March Madness a little more sane - Appolicious - March 22nd, 2010 [March 22nd, 2010]
- Eye-Fi Pro X2 cards have arrived, and you probably want one - tuaw.com (blog) - March 23rd, 2010 [March 23rd, 2010]
- Pharmacist shows who wins, loses with health care bill - KLTV - March 23rd, 2010 [March 23rd, 2010]
- High-Tech Texts! - The Campus Slate - March 24th, 2010 [March 24th, 2010]
- CTIA WIRELESS 2010: Samsung's New Galaxy Brings 4" AMOLED Screen, Social Hub ... - Marketnews.ca - March 24th, 2010 [March 24th, 2010]
- Google must follow Chinese rules or leave - China Daily - March 24th, 2010 [March 24th, 2010]
- Jay-Z Short Documentary 'NY-Z' Premieres Online - MTV.com - March 24th, 2010 [March 24th, 2010]
- DAs clash over Mineola sex ring appeal - KLTV - March 25th, 2010 [March 25th, 2010]
- iSilo for iPhone - BusinessWeek - March 26th, 2010 [March 26th, 2010]
- Questions Abound as "New START" Agreement is Completed - Global Security Newswire - March 26th, 2010 [March 26th, 2010]
- What will Apple do next in mobile services? - Mobile Entertainment - March 26th, 2010 [March 26th, 2010]
- How much is too much to pay for health care? - Anchorage Daily News - March 27th, 2010 [March 27th, 2010]
- The Future of Smartphones: 4G and Beyond - Entrepreneur - March 27th, 2010 [March 27th, 2010]
- Uploading and uplifting: sharing big data files - Earthtimes (press release) - March 28th, 2010 [March 28th, 2010]
- Verizon Blasts 'Outdated' FCC Broadband Plan - NewsFactor Network - March 28th, 2010 [March 28th, 2010]
- Web Host Layered Tech Offers Mezeo-Powered Cloud Storage - Web Host Industry Review - March 29th, 2010 [March 29th, 2010]
- Dropbox: Now one more reason to want a Nexus One - ZDNet (blog) - March 30th, 2010 [March 30th, 2010]
- Exaflood: Politicians Prop Up Dinosaurs, Ignore Cutting Edge Technology - NewsBlaze (press release) - March 30th, 2010 [March 30th, 2010]
- Instructions - Washington Post - March 30th, 2010 [March 30th, 2010]
- Uploading for Life Extension Will Be Valid - Institute for Ethics and Emerging Technologies - March 31st, 2010 [March 31st, 2010]
- 'Glee's' MySpace Auditions: What Not To Sing - Wall Street Journal (blog) - March 31st, 2010 [March 31st, 2010]
- Memeo iPad Reader: Like the GDrive on your iPad (only different) - ZDNet (blog) - April 1st, 2010 [April 1st, 2010]
- Why are pipe bomb 'how to' videos legal? Answer is alarming - KLTV - April 1st, 2010 [April 1st, 2010]
- Trip to Haiti inspiration for East Texas teen - KLTV - April 1st, 2010 [April 1st, 2010]
- Jason Kilar Leads Hulu To Profitability, But Will He Stay On At Hulu? - TVbytheNumbers - April 2nd, 2010 [April 2nd, 2010]
- Layers for IPad Adds Online Gallery, Pro Options - PC World - April 2nd, 2010 [April 2nd, 2010]
- Shane Dawson, YouTube's Comic for the Under-30 Set - New York Times - April 2nd, 2010 [April 2nd, 2010]
- Hands-On With the Apple iPad — and Your Questions - Wired News - April 4th, 2010 [April 4th, 2010]
- FedEx Simplifies International Shipping with FedEx Electronic Trade Documents - MarketWatch (press release) - April 6th, 2010 [April 6th, 2010]
- Cacoo Lets Multiple Users Create Designs Collaboratively And In Real-time - TechCrunch (blog) - April 7th, 2010 [April 7th, 2010]
- Comcast: Your New Overlord - ITworld.com - April 7th, 2010 [April 7th, 2010]
- Bloggers Photograph Food, We Get Hungry - Switched (blog) - April 7th, 2010 [April 7th, 2010]
- Apple suggests only the iPhone can fingerprint songs - Geek.com - April 7th, 2010 [April 7th, 2010]
- Senior with mental challenges killed along highway - KLTV - April 7th, 2010 [April 7th, 2010]
- Book a Cruise and "Flip" Over a Free Camcorder - CruiseCritic.co.uk - April 8th, 2010 [April 8th, 2010]
- Creation Myths: what the argument that the iPad's not for creating content ... - Huffington Post (blog) - April 8th, 2010 [April 8th, 2010]
- Want market share? Make a brain claim - Marketing Web - April 8th, 2010 [April 8th, 2010]
- 10 Ways World of Warcraft - OUPblog (blog) - April 8th, 2010 [April 8th, 2010]
- Check-in to Foursquare: Latest social media service lands in SW Florida - Naples Daily News - April 8th, 2010 [April 8th, 2010]
- Apple iPhone OS 4 Announcement Makes Users Feel "Finally!" - HULIQ - April 8th, 2010 [April 8th, 2010]