But Ben Shneiderman, a University of Maryland computer scientist who has for decades warned against blindly automating tasks with computers, thinks fully automated cars and the tech industrys vision for a robotic future is misguided. Even dangerous. Robots should collaborate with humans, he believes, rather than replace them.
Late last year, Dr. Shneiderman embarked on a crusade to convince the artificial intelligence world that it is heading in the wrong direction. In February, he confronted organizers of an industry conference on Assured Autonomy in Phoenix, telling them that even the title of their conference was wrong. Instead of trying to create autonomous robots, he said, designers should focus on a new mantra, designing computerized machines that are reliable, safe and trustworthy.
There should be the equivalent of a flight data recorder for every robot, Dr. Shneiderman argued.
It is a warning thats likely to gain more urgency when the worlds economies eventually emerge from the devastation of the coronavirus pandemic and millions who have lost their jobs try to return to work. A growing number of them will find they are competing with or working side by side with machines.
Dr. Shneiderman, 72, began spreading his message decades ago. A pioneer in the field human-computer interaction, he co-founded in 1982 what is now the Conference on Human Factors in Computing Systems and coined the term direct manipulation to describe the way objects are moved on a computer screen either with a mouse or, more recently, with a finger.
In 1997, Dr. Shneiderman engaged in a prescient debate with Pattie Maes, a computer scientist at the Massachusetts Institute of Technologys Media Lab, over the then-fashionable idea of intelligent software agents designed to perform autonomous tasks for computer users anything from reordering groceries to making a restaurant reservation.
Designers believe they are creating something lifelike and smart however, users feel anxious and unable to control these systems, he argued.
Since then, Dr. Shneiderman has argued that designers run the risk not just of creating unsafe machines but of absolving humans of ethical responsibility of the actions taken by autonomous systems, ranging from cars to weapons.
The conflict between human and computer control is at least as old as interactive computing itself.
The distinction first appeared in two computer science laboratories that were created in 1962 near Stanford University. John McCarthy, a computer scientist who had coined the term artificial intelligence, established the Stanford Artificial Intelligence Laboratory with the goal of creating a thinking machine in a decade. And Douglas Engelbart, who invented the computer mouse, created the Augmentation Research Center at the Stanford Research Center and coined the term intelligence augmentation, or I.A.
In recent years, the computer industry and academic researchers have tried to bring the two fields back together, describing the resulting discipline as humanistic or human-centered artificial intelligence.
Dr. Shneiderman has challenged the engineering community to rethink the way it approaches artificial intelligence-based automation. Until now, machine autonomy has been described as a one-dimensional scale ranging from machines that are manually controlled to systems that run without human intervention.
The best known of these one-dimensional models is a set of definitions related to self-driving vehicles established by the Society of Automotive Engineers. It describes six levels of vehicle autonomy ranging from Level 0, requiring complete human control, to Level 5, which is full driving automation.
In contrast, Dr. Shneiderman has sketched out a two-dimensional alternative that allows for both high levels of machine automation and human control. With certain exceptions such as automobile airbags and nuclear power plant control rods, he asserts that the goal of computing designers should be systems in which computing is used to extend the abilities of human users.
This approach has already been popularized by both roboticists and Pentagon officials. Gill Pratt, the head of the Toyota Research Institute, is a longtime advocate of keeping humans in the loop. His institute has been working to develop Guardian, a system that the researchers have described as super advanced driver assistance.
There is so much that automation can do to help people that is not about replacing them, Dr. Pratt said. He has focused the laboratory not just on car safety but also on the challenge of developing robotic technology designed to support older drivers as well.
Similarly, Robert O. Work, a deputy secretary of defense under Presidents Trump and Barack Obama, backed the idea of so-called centaur weapons systems, which would require human control, instead of A.I.-based robot killers, now called lethal autonomous weapons.
The term centaur was originally popularized in the chess world, where partnerships of humans and computer programs consistently defeated unassisted software.
At the Phoenix conference on autonomous systems this year, Dr. Shneiderman said Boeings MCAS flight-control system, which was blamed after two 737 Max jets crashed, was an extreme example of high automation and low human control.
The designers believed that their autonomous system could not fail, he wrote in an unpublished article that has been widely circulated. Therefore, its existence was not described in the user manual and the pilots were not trained in how to switch to manual override.
Dr. Shneiderman said in an interview that he had attended the conference with the intent of persuading the organizers to change its name from a focus on autonomy to a focus on human control.
Ive come to see that names and metaphors are very important, he said.
He also cited examples where the Air Force, the National Aeronautics and Space Administration, and the Defense Science Board, a committee of civilian experts that advises the Defense Department on science and technology, had backed away from a reliance on autonomous systems.
Robin Murphy, a computer scientist and robotics specialist at Texas A&M University, said she had spoken to Dr. Shneiderman and broadly agreed with his argument.
I think theres some imperfections, and I have talked to Ben about this, but I dont know anything better, she said. Weve got to think of ways to better represent how humans and computers are engaged together.
There are also skeptics.
Bens notion that his two-dimensional model is a fresh perspective simply is not true, said Missy Cummings, director of Duke Universitys Humans and Autonomy Laboratory, who said she relied on his human-interface ideas in her design classes.
The degree of collaboration should be driven by the amount of uncertainty in the system and the criticality of outcomes, she said. Nuclear reactors are highly automated for a reason: Humans often do not have fast enough reaction times to push the rods in if the reactor goes critical.
Link:
A Case for Cooperation Between Machines and Humans - The New York Times
- The Automation Conference - December 9th, 2016 [December 9th, 2016]
- The Best Home Automation Systems of 2016 | Top Ten Reviews - December 24th, 2016 [December 24th, 2016]
- Compact Automation - Actuators, Hydraulic Cylinders, Linear ... - December 24th, 2016 [December 24th, 2016]
- What is Home Automation? | Home Automation Systems - December 24th, 2016 [December 24th, 2016]
- Job Seekers - Automation Personnel Services - December 24th, 2016 [December 24th, 2016]
- iAutomation - December 25th, 2016 [December 25th, 2016]
- Beyond Automation - hbr.org - December 25th, 2016 [December 25th, 2016]
- Automation The Car Company Tycoon Game on Steam - December 25th, 2016 [December 25th, 2016]
- Automation - Wikipedia - December 25th, 2016 [December 25th, 2016]
- Build automation - Wikipedia - December 26th, 2016 [December 26th, 2016]
- Home - Enerwave Home Automation - December 27th, 2016 [December 27th, 2016]
- Automation | Technologies | Systems | Integrator ... - December 27th, 2016 [December 27th, 2016]
- Automation - DESHAZO - December 27th, 2016 [December 27th, 2016]
- Custom Automation & Machine Design | Automation GT - December 27th, 2016 [December 27th, 2016]
- IT Automation - BMC - December 27th, 2016 [December 27th, 2016]
- Werner Electric | Automation - January 28th, 2017 [January 28th, 2017]
- Automationtechies | Automation Engineering Recruiting - January 28th, 2017 [January 28th, 2017]
- Automation - Mazak Corporation - January 28th, 2017 [January 28th, 2017]
- Automation | Food Engineering - January 28th, 2017 [January 28th, 2017]
- Test Automation Services for Development of Regression ... - January 28th, 2017 [January 28th, 2017]
- UI Automation Overview - msdn.microsoft.com - February 5th, 2017 [February 5th, 2017]
- The Evolution of Automation and What It Means for the Integration Industry - Commercial Integrator - February 7th, 2017 [February 7th, 2017]
- Automation, robots could replace 250000 public sector workers in the next 15 years - Computer Business Review - February 7th, 2017 [February 7th, 2017]
- New telecom transformation goals require service automation - TechTarget - February 7th, 2017 [February 7th, 2017]
- Automation expected to displace insurance underwriters, real estate brokers - CIO Dive - February 7th, 2017 [February 7th, 2017]
- The Perks Of Automation And The Risks: Why To Think Twice About Getting Into That Driverless Uber - Forbes - February 7th, 2017 [February 7th, 2017]
- Voices Reinventing enterprise finance by overhauling AP automation - Accounting Today - February 7th, 2017 [February 7th, 2017]
- DFLabs Launches the First Security Automation and Orchestration Platform based Upon Supervised Active Intelligence - Business Wire (press release) - February 7th, 2017 [February 7th, 2017]
- VIDEO: Going Big on Automation in a Small Footprint Facility - ENGINEERING.com - February 7th, 2017 [February 7th, 2017]
- Building a better model of human-automation interaction - Phys.org - Phys.Org - February 7th, 2017 [February 7th, 2017]
- Cruise Automation Is Testing an App For Hailing Self-Driving Cars - Fortune - February 8th, 2017 [February 8th, 2017]
- AlixPartners examines automation in manufacturing and logistics management - Logistics Management - February 8th, 2017 [February 8th, 2017]
- Women need to look out for each other in automated workplaces - The Guardian - February 8th, 2017 [February 8th, 2017]
- Automation vs. the H-1B visa program: Which matters to employees? - TechTarget - February 8th, 2017 [February 8th, 2017]
- Automation is the unavoidable future of the economy - The Daily Cougar - February 8th, 2017 [February 8th, 2017]
- Speeders beware: Legislation would allow automation crackdown ... - SFGate - February 9th, 2017 [February 9th, 2017]
- Robots versus bureaucrats: Why public sector work is ripe for automation - Financial Post - February 9th, 2017 [February 9th, 2017]
- Rockwell Automation Surged 10% in January as Growth Picked Up Steam - Motley Fool - February 9th, 2017 [February 9th, 2017]
- Global Medical Automation Market to Reach Approximately $75.6 Billion by 2025 - By End User, Application ... - PR Newswire (press release) - February 10th, 2017 [February 10th, 2017]
- Automation 'key' to advancing Thai production - The Nation - February 10th, 2017 [February 10th, 2017]
- WorkWave Releases New Lead Management And Marketing ... - PR Newswire (press release) - February 10th, 2017 [February 10th, 2017]
- 'We employ insane levels of automation' Kris Canekeratne - Times of India - February 10th, 2017 [February 10th, 2017]
- Most people are optimistic about workplace automation, social data suggests - ZDNet - February 10th, 2017 [February 10th, 2017]
- Yes, there's a job creation argument for automation and technology ... - The Hill (blog) - February 10th, 2017 [February 10th, 2017]
- Technobabble: Automation and the modern worker - CIO Dive - February 10th, 2017 [February 10th, 2017]
- Improving Behavior Through Automation of Vehicle Systems - School Transportation News (blog) - February 11th, 2017 [February 11th, 2017]
- Automation Nightmare: Philosopher Warns We Are Creating a World Without Consciousness - Big Think - February 11th, 2017 [February 11th, 2017]
- Why Don't We See More Automation in Federal Networks? - Nextgov - February 11th, 2017 [February 11th, 2017]
- Automation can revitalize the US workforce - Fox News - February 11th, 2017 [February 11th, 2017]
- Readers Write (Feb. 12): The moose population; jobs, start-ups and automation; diversity in the funny pages - Minneapolis Star Tribune - February 12th, 2017 [February 12th, 2017]
- Automation can replace bureaucrats and save taxpayers money - Hot Air - February 12th, 2017 [February 12th, 2017]
- TigerStop hopes to ride automation to new heights - The Columbian - February 12th, 2017 [February 12th, 2017]
- Your Most Valuable Resource is Time Get More of it through Automation - CMS Critic (press release) (blog) - February 13th, 2017 [February 13th, 2017]
- What Does Device Automation Mean for Users? - Medical Device and Diagnostics Industry (blog) - February 13th, 2017 [February 13th, 2017]
- How To Beat Automation And Not Lose Your Job - Forbes - February 13th, 2017 [February 13th, 2017]
- Logistics firm gets automation boost - The Straits Times - February 14th, 2017 [February 14th, 2017]
- PP Control & Automation launch new video to kick-start exciting plans for 2017 - Manufacturer.com - February 14th, 2017 [February 14th, 2017]
- Automation's Impace on Data Center Monitoring Alerts - The Data Center Journal - February 14th, 2017 [February 14th, 2017]
- Hollysys Automation Technologies Reports Unaudited Financial Results for the First Half Year and the Second Quarter ... - PR Newswire (press release) - February 15th, 2017 [February 15th, 2017]
- 4 Automation Hacks to Save You Money and Manpower - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Istuary Innovation Group and Bluewrist Partner to Bring Robotics and Automation into China's Manufacturing Sector - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Redwood Software Named a Strong Performer in Independent Robotic Process Automation (RPA) Report - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Boeing ramps up automation, innovation as it readies 737MAX | The ... - The Seattle Times - February 15th, 2017 [February 15th, 2017]
- Robots and AI are coming for our jobs, but can augmentation save us from automation? - Digital Trends - February 15th, 2017 [February 15th, 2017]
- The Impact of Bad Data in Automation: Why Quality Management is Critical - R & D Magazine - February 16th, 2017 [February 16th, 2017]
- Automation: Are We Empowering Human Interaction Or Displacing It? - Business 2 Community - February 16th, 2017 [February 16th, 2017]
- Life in the Fast LaneAutomation with Software-Defined Intelligence - InfoWorld - February 16th, 2017 [February 16th, 2017]
- Luddite Lefty Journalists Apparently Think Workplace Automation is Conservatives' Fault [VIDEO] - Daily Caller - February 16th, 2017 [February 16th, 2017]
- Will automation define the future of network technology? - TechTarget - February 16th, 2017 [February 16th, 2017]
- Editorial: Improving automation - The Motorship - February 17th, 2017 [February 17th, 2017]
- TigerText Unveils Role-based Scheduling Automation, Amazon Alexa integration - HIT Consultant - February 17th, 2017 [February 17th, 2017]
- 89% people want automation at workplace: Adobe - Economic Times - February 18th, 2017 [February 18th, 2017]
- Delta veers to EV parts, automation - Bangkok Post - February 18th, 2017 [February 18th, 2017]
- Robotic process automation makes nearshore outsourcing more ... - CIO - February 18th, 2017 [February 18th, 2017]
- The working-class job that Trump could save from automation - Washington Post - February 18th, 2017 [February 18th, 2017]
- China must be ready for automation - Basic Income News - February 18th, 2017 [February 18th, 2017]
- Bill Gates Says Robots Should Be Taxed Like Workers - Fortune - February 18th, 2017 [February 18th, 2017]
- Trump and automation challenge India's IT industry - VentureBeat - February 18th, 2017 [February 18th, 2017]
- Both Trump and Automation Are Challenging India's IT Industry - Fortune - February 20th, 2017 [February 20th, 2017]
- 89% people want automation at workplace: Adobe - ETCIO.com - February 20th, 2017 [February 20th, 2017]