Non-Computable You: What You Do That Artificial Intelligence Never Will (Discovery Institute Press, 2022) by Robert J. Marks is available here. What follows is an excerpt from Chapter 2.
Selmer Bringsjord, and his colleagues have proposed the Lovelace test as a substitute for the flawed Turing test. The test is named after Ada Lovelace.
Bringsjord defined software creativity as passing the Lovelace test if the program does something that cannot be explained by the programmer or an expert in computer code.2 Computer programs can generate unexpected and surprising results.3 Results from computer programs are often unanticipated. But the question is, does the computer create a result that the programmer, looking back, cannot explain?
When it comes to assessing creativity (and therefore consciousness and humanness), the Lovelace test is a much better test than the Turing test. If AI truly produces something surprising which cannot be explained by the programmers, then the Lovelace test will have been passed and we might in fact be looking at creativity. So far, however, no AI has passed the Lovelace test.4 There have been many cases where a machine looked as if it were creative, but on closer inspection, the appearance of creative content fades.
Here are a couple of examples.
A computer program namedAlphaGo was taught to play GO, the most difficult of all popular board games. AlphaGo was an impressively monumental contribution to machine intelligence. AI already had mastered tic-tac-toe, then the more complicated game of checkers, and then the still more complicated game of chess. Conquest of GO remained an unmet goal of AI until it was finally achieved by AlphaGo.
In a match against (human) world championLee Sedol in 2016, AlphaGo made a surprising move. Those who understood the game described the move as ingenious and unlike anything a human would ever do.
Were we seeing the human attribute of creativity in AlphaGo beyond the intent of the programmers? Does this act pass the Lovelace test?
The programmers of AlphaGo claim that they did not anticipate the unconventional move. This is probably true. But AlphaGo is trained to play GO by the programmers. GO is a board game with fixed rules in a static never-changing arena. And thats what the AI did, and did well. It applied programmed rules within a narrow, rule-bound game. AlphaGo was trained to play GO and thats what it did.
So, no. The Lovelace test was not passed. If the AlphaGo AI were to perform a task not programmed, like beating all comers at the simple game of Parcheesi, the Lovelace test would be passed. But as it stands, Alpha GO is not creative. It can only perform the task it was trained for, namely playing GO. If asked, AlphaGo is unable to even explain the rules of GO.
This said, AI can appear smart when it generates a surprising result. But surprise does not equate to creativity. When a computer program is asked to search through a billion designs to find the best, the result can be a surprise. But that isnt creativity. The computer program has done exactly what it was programmed to do.
Heres another example from my personal experience. The Office of Naval Research contracted Ben Thompson, of Penn States Applied Research Lab, and me and asked us to evolve swarm behavior. As we saw in Chapter 1, simple swarm rules can result in unexpected swarm behavior like stacking Skittles. Given simple rules, finding the corresponding emergent behavior is easy. Just run a simulation. But the inverse design problem is a more difficult one. If you want a swarm to perform some task, what simple rules should the swarm bugs follow? To solve this problem, we applied an evolutionary computing AI. This process ended up looking at thousands of possible rules to find the set that gave the closest solution to the desired performance.
One problem we looked at involved a predatorprey swarm. All action took place in a closed square virtual room. Predators, called bullies, ran around chasing prey called dweebs. Bullies captured dweebs and killed them. We wondered what performance would be if the goal was maximizing the survival time of the dweeb swarm. The swarms survival time was measured up to when the last dweeb was killed.
After running the evolutionary search, we were surprised by the result: The dweebs submitted themselves to self-sacrifice in order to maximize the overall life of the swarm.
This is what we saw: A single dweeb captured the attention of all the bullies, who chased the dweeb in circles around the room. Around and around they went, adding seconds to the overall life of the swarm. During the chase, all the other dweebs huddled in the corner of the room, shaking with what appeared to be fear. Eventually, the pursuing bullies killed the sacrificial dweeb, and pandemonium broke out as the surviving dweebs scattered in fear. Eventually another sacrificial dweeb was identified, and the process repeated. The new sacrificial dweeb kept the bullies running around in circles while the remaining dweebs cowered in a corner.
The sacrificial dweeb result was unexpected, a complete surprise.There was nothing written in the evolutionary computer code explicitly calling for these sacrificial dweebs. Is this an example of AI doing something we had not programmed it to do? Did it pass the Lovelace test?
Absolutely not.
We had programmed the computer to sort through millions of strategies that would maximize the life of the dweeb swarm, and thats what the computer did. It evaluated options and chose the best one. The result was a surprise, but does not pass the Lovelace test for creativity. The program did exactly what it was written to do. And the seemingly frightened dweebs were not, in reality, shaking with fear; humans tend to project human emotions onto non-sentient things. They were rapidly adjusting to stay as far away as possible from the closest bully. They were programmed to do this.
If the sacrificial dweeb action and the unexpected GO move against Lee Sedol do not pass the Lovelace test, what would? The answer is, anything outside of what code was programmed to do.
Heres an example from the predatorprey swarm example. The Lovelace test would be passed if some dweebs became aggressive and started attacking and killing lone bullies a potential action we did not program into the suite of possible strategies. But that didnt happen and, because the ability of a dweeb to kill a bully is not written into the code, it will never happen.
Likewise, without additional programming, AlphaGo will never engage opponent Lee Sedol in trash talk or psychoanalyze Sedol to get a game edge. Either of those things would be sufficiently creative to pass the Lovelace test. But remember: the AlphaGo software as written could not even provide an explanation of its own programmed behavior, the game of GO.
You may also wish to read the earlier excerpts published here:
Why you are not and cannot be computable. A computer science prof explains in a new book that computer intelligence does not hold a candle to human intelligence. In this excerpt from his forthcoming book, Non-Computable You, Robert J. Marks shows why most human experience is not even computable.
The Software of the Gaps: An excerpt from Non-Computable You. In his just-published book, Robert J. Marks takes on claims that consciousness is emerging from AI and that we can upload our brains. He reminds us of the tale of the boy who dug through a pile of manure because he was sure that underneath all that poop, there MUST surely be a pony!
and
Marks: Artificial intelligence is no more creative than a pencil.You can use a pencil but the creativity comes from you. With AI, clever programmers can conceal that fact for a while. In this short excerpt from his new book, Non-Computable You, Robert J. Marks discusses the tricks that make you think chatbots are people.
Notes
1 Selmer Bringsjord, Paul Bello, and David Ferrucci, Creativity, the Turing Test, and the (Better) Lovelace Test, in The Turing Test: The Elusive Standard of Artificial Intelligence, ed. James H. Moor (Boston: Kluwer Academic Publishers, 2003), 215239.
2 David Klinghoffer, Robert Marks on the Lovelace Test, Evolution News and Science Today, Discovery Institute, January 24, 2018.
3 Bringsjord, Bello, and Ferrucci, Creativity. The Lovelace test (LT) is more formally stated by Bringsjord and his colleagues. Here is their definition: Artificial agent A, designed by H, passes LT if and only if (1) A outputs o; (2) As outputting o is not the result of a fluke hardware error, but rather the result of processes A can repeat; (3) H (or someone who knows what H knows, and has Hs resources) cannot explain how A produced o. Notice that this differs from Turings surprises which, as he admitted, occurred because he as programmer erred or else forgot what he had done.
4 Selmer Bringsjord, The Turing Test is Dead. Long Live the Lovelace Test, interview by Robert J. Marks in Mind Matters News, podcast, 27:25, April 2, 2020, https://mindmatters.ai/podcast/ep76/.
Read more:
- Mind uploading - 01 - November 8th, 2009 [November 8th, 2009]
- Mind uploading - 02 - November 8th, 2009 [November 8th, 2009]
- A new way to battle Mexican drug cartels - KLTV - March 8th, 2010 [March 8th, 2010]
- Mobile Health Screening Units Visit Lowe's Workers - International Supermarket News - March 8th, 2010 [March 8th, 2010]
- The quintessential sewing machine - Business Mirror - March 8th, 2010 [March 8th, 2010]
- The Future of Windows - Technologizer (blog) - March 8th, 2010 [March 8th, 2010]
- SEO Press Release Distribution Site Online PR News Celebrates 10000 Active Users - Online PR News (press release) - March 8th, 2010 [March 8th, 2010]
- Utilizing Online Mailing Services – Make the Most of Direct Marketing - RisMedia.com (press release) - March 8th, 2010 [March 8th, 2010]
- Carr's first look at 'Extreme' home - KLTV - March 8th, 2010 [March 8th, 2010]
- Should you advertise on iPhones? - Smart Company (blog) - March 8th, 2010 [March 8th, 2010]
- Review: Mega Man 10 - Destructoid - March 8th, 2010 [March 8th, 2010]
- Had I World Enough, and Time - Institute for Ethics and Emerging Technologies - March 8th, 2010 [March 8th, 2010]
- Unicast Continues Innovative Technology Enhancements With Latest Release of ... - CNNMoney.com (press release) - March 16th, 2010 [March 16th, 2010]
- Facebook scouts for 'passionate' India head - Economic Times - March 16th, 2010 [March 16th, 2010]
- SXSW: YouTube Launches Partner Program for Indie Bands - Wired News - March 17th, 2010 [March 17th, 2010]
- Wider Still and Wider! - Bangkok Post - March 17th, 2010 [March 17th, 2010]
- P2P Versus The World - Rampage - March 17th, 2010 [March 17th, 2010]
- Yakuza 3 - The MMOMFG Review - MMOMFG (blog) - March 17th, 2010 [March 17th, 2010]
- Behind the musings: The annotated high schools column - Chicago Tribune (blog) - March 17th, 2010 [March 17th, 2010]
- Jihad Jane, YouTube, and Me - David Horowitz's NewsReal Blog (blog) - March 17th, 2010 [March 17th, 2010]
- Justin Bieber Releases 'U Smile,' Announces Summer Tour Dates - MTV.com - March 17th, 2010 [March 17th, 2010]
- FCC announces National Broadband Plan - VentureBeat - March 17th, 2010 [March 17th, 2010]
- Image hosting on the cheap: a look at three free services - Ars Technica - March 17th, 2010 [March 17th, 2010]
- Content Management: Secrets of the Trade - Formtek Blog (blog) - March 17th, 2010 [March 17th, 2010]
- FCC's National Broadband Plan: There is a dark side - ZDNet - March 17th, 2010 [March 17th, 2010]
- 5 Reasons Old Media Should Buy Facebook - AllFacebook (blog) - March 17th, 2010 [March 17th, 2010]
- "Steal It" and Other Internal YouTube Emails from Viacom's Copyright Suit - Fast Company - March 19th, 2010 [March 19th, 2010]
- Now cafes in monument premises for tourists during CWG - Sify - March 19th, 2010 [March 19th, 2010]
- Google-Viacom court papers leave a lot to the imagination - FierceOnlineVideo - March 19th, 2010 [March 19th, 2010]
- FCC's broadband plan: A possible dream - Washington Post (blog) - March 19th, 2010 [March 19th, 2010]
- The Importance of Using Social Networking for Business; Part I – Facebook - IPWatchdog.com - March 19th, 2010 [March 19th, 2010]
- Recording YouTube Videos - Acoustic Guitar - March 19th, 2010 [March 19th, 2010]
- Who's using location-based social networking? - KC Free Press - March 20th, 2010 [March 20th, 2010]
- iPhone will continue to beckon BlackBerry owners - CNET - March 20th, 2010 [March 20th, 2010]
- Rain leaves its mark on Azalea Trail events - KLTV - March 21st, 2010 [March 21st, 2010]
- Viacom v. YouTube/Google: A Piracy Case in Their Own Words - DailyFinance - March 21st, 2010 [March 21st, 2010]
- Getting a look at next high-tech | Philadelphia Inquirer | 03/22/2010 - Philadelphia Inquirer - March 22nd, 2010 [March 22nd, 2010]
- Sprint chews on Apple while lauding 4G Overdrive hotspot - The Tech Herald - March 22nd, 2010 [March 22nd, 2010]
- 'Repo Men' contest -- the nationwide chase is almost over - Los Angeles Times (blog) - March 22nd, 2010 [March 22nd, 2010]
- Viacom vs. YouTube/Google: A Piracy Case in Their Own Words - DailyFinance - March 22nd, 2010 [March 22nd, 2010]
- These iPhone apps will help make March Madness a little more sane - Appolicious - March 22nd, 2010 [March 22nd, 2010]
- Eye-Fi Pro X2 cards have arrived, and you probably want one - tuaw.com (blog) - March 23rd, 2010 [March 23rd, 2010]
- Pharmacist shows who wins, loses with health care bill - KLTV - March 23rd, 2010 [March 23rd, 2010]
- High-Tech Texts! - The Campus Slate - March 24th, 2010 [March 24th, 2010]
- CTIA WIRELESS 2010: Samsung's New Galaxy Brings 4" AMOLED Screen, Social Hub ... - Marketnews.ca - March 24th, 2010 [March 24th, 2010]
- Google must follow Chinese rules or leave - China Daily - March 24th, 2010 [March 24th, 2010]
- Jay-Z Short Documentary 'NY-Z' Premieres Online - MTV.com - March 24th, 2010 [March 24th, 2010]
- DAs clash over Mineola sex ring appeal - KLTV - March 25th, 2010 [March 25th, 2010]
- iSilo for iPhone - BusinessWeek - March 26th, 2010 [March 26th, 2010]
- Questions Abound as "New START" Agreement is Completed - Global Security Newswire - March 26th, 2010 [March 26th, 2010]
- What will Apple do next in mobile services? - Mobile Entertainment - March 26th, 2010 [March 26th, 2010]
- How much is too much to pay for health care? - Anchorage Daily News - March 27th, 2010 [March 27th, 2010]
- The Future of Smartphones: 4G and Beyond - Entrepreneur - March 27th, 2010 [March 27th, 2010]
- Uploading and uplifting: sharing big data files - Earthtimes (press release) - March 28th, 2010 [March 28th, 2010]
- Verizon Blasts 'Outdated' FCC Broadband Plan - NewsFactor Network - March 28th, 2010 [March 28th, 2010]
- Web Host Layered Tech Offers Mezeo-Powered Cloud Storage - Web Host Industry Review - March 29th, 2010 [March 29th, 2010]
- Dropbox: Now one more reason to want a Nexus One - ZDNet (blog) - March 30th, 2010 [March 30th, 2010]
- Exaflood: Politicians Prop Up Dinosaurs, Ignore Cutting Edge Technology - NewsBlaze (press release) - March 30th, 2010 [March 30th, 2010]
- Instructions - Washington Post - March 30th, 2010 [March 30th, 2010]
- Uploading for Life Extension Will Be Valid - Institute for Ethics and Emerging Technologies - March 31st, 2010 [March 31st, 2010]
- 'Glee's' MySpace Auditions: What Not To Sing - Wall Street Journal (blog) - March 31st, 2010 [March 31st, 2010]
- Memeo iPad Reader: Like the GDrive on your iPad (only different) - ZDNet (blog) - April 1st, 2010 [April 1st, 2010]
- Why are pipe bomb 'how to' videos legal? Answer is alarming - KLTV - April 1st, 2010 [April 1st, 2010]
- Trip to Haiti inspiration for East Texas teen - KLTV - April 1st, 2010 [April 1st, 2010]
- Jason Kilar Leads Hulu To Profitability, But Will He Stay On At Hulu? - TVbytheNumbers - April 2nd, 2010 [April 2nd, 2010]
- Layers for IPad Adds Online Gallery, Pro Options - PC World - April 2nd, 2010 [April 2nd, 2010]
- Shane Dawson, YouTube's Comic for the Under-30 Set - New York Times - April 2nd, 2010 [April 2nd, 2010]
- Hands-On With the Apple iPad — and Your Questions - Wired News - April 4th, 2010 [April 4th, 2010]
- FedEx Simplifies International Shipping with FedEx Electronic Trade Documents - MarketWatch (press release) - April 6th, 2010 [April 6th, 2010]
- Cacoo Lets Multiple Users Create Designs Collaboratively And In Real-time - TechCrunch (blog) - April 7th, 2010 [April 7th, 2010]
- Comcast: Your New Overlord - ITworld.com - April 7th, 2010 [April 7th, 2010]
- Bloggers Photograph Food, We Get Hungry - Switched (blog) - April 7th, 2010 [April 7th, 2010]
- Apple suggests only the iPhone can fingerprint songs - Geek.com - April 7th, 2010 [April 7th, 2010]
- Senior with mental challenges killed along highway - KLTV - April 7th, 2010 [April 7th, 2010]
- Book a Cruise and "Flip" Over a Free Camcorder - CruiseCritic.co.uk - April 8th, 2010 [April 8th, 2010]
- Creation Myths: what the argument that the iPad's not for creating content ... - Huffington Post (blog) - April 8th, 2010 [April 8th, 2010]
- Want market share? Make a brain claim - Marketing Web - April 8th, 2010 [April 8th, 2010]
- 10 Ways World of Warcraft - OUPblog (blog) - April 8th, 2010 [April 8th, 2010]
- Check-in to Foursquare: Latest social media service lands in SW Florida - Naples Daily News - April 8th, 2010 [April 8th, 2010]
- Apple iPhone OS 4 Announcement Makes Users Feel "Finally!" - HULIQ - April 8th, 2010 [April 8th, 2010]