Training interactive robots may one day be an easy job for everyone, even those without programming expertise. Roboticists are developing automated robots that can learn new tasks solely by observing humans. At home, you might someday show a domestic robot how to do routine chores. In the workplace, you could train robots like new employees, showing them how to perform many duties.
Making progress on that vision, MIT researchers have designed a system that lets these types of robots learn complicated tasks that would otherwise stymie them with too many confusing rules. One such task is setting a dinner table under certain conditions.
At its core, the researchers Planning with Uncertain Specifications (PUnS) system gives robots the humanlike planning ability to simultaneously weigh many ambiguous and potentially contradictory requirements to reach an end goal. In doing so, the system always chooses the most likely action to take, based on a belief about some probable specifications for the task it is supposed to perform.
In their work, the researchers compiled a dataset with information about how eight objects a mug, glass, spoon, fork, knife, dinner plate, small plate, and bowl could be placed on a table in various configurations. A robotic arm first observed randomly selected human demonstrations of setting the table with the objects. Then, the researchers tasked the arm with automatically setting a table in a specific configuration, in real-world experiments and in simulation, based on what it had seen.
To succeed, the robot had to weigh many possible placement orderings, even when items were purposely removed, stacked, or hidden. Normally, all of that would confuse robots too much. But the researchers robot made no mistakes over several real-world experiments, and only a handful of mistakes over tens of thousands of simulated test runs.
The vision is to put programming in the hands of domain experts, who can program robots through intuitive ways, rather than describing orders to an engineer to add to their code, says first author Ankit Shah, a graduate student in the Department of Aeronautics and Astronautics (AeroAstro) and the Interactive Robotics Group, who emphasizes that their work is just one step in fulfilling that vision. That way, robots wont have to perform preprogrammed tasks anymore. Factory workers can teach a robot to do multiple complex assembly tasks. Domestic robots can learn how to stack cabinets, load the dishwasher, or set the table from people at home.
Joining Shah on the paper are AeroAstro and Interactive Robotics Group graduate student Shen Li and Interactive Robotics Group leader Julie Shah, an associate professor in AeroAstro and the Computer Science and Artificial Intelligence Laboratory.
Bots hedging bets
Robots are fine planners in tasks with clear specifications, which help describe the task the robot needs to fulfill, considering its actions, environment, and end goal. Learning to set a table by observing demonstrations, is full of uncertain specifications. Items must be placed in certain spots, depending on the menu and where guests are seated, and in certain orders, depending on an items immediate availability or social conventions. Present approaches to planning are not capable of dealing with such uncertain specifications.
A popular approach to planning is reinforcement learning, a trial-and-error machine-learning technique that rewards and penalizes them for actions as they work to complete a task. But for tasks with uncertain specifications, its difficult to define clear rewards and penalties. In short, robots never fully learn right from wrong.
The researchers system, called PUnS (for Planning with Uncertain Specifications), enables a robot to hold a belief over a range of possible specifications. The belief itself can then be used to dish out rewards and penalties. The robot is essentially hedging its bets in terms of whats intended in a task, and takes actions that satisfy its belief, instead of us giving it a clear specification, Ankit Shah says.
The system is built on linear temporal logic (LTL), an expressive language that enables robotic reasoning about current and future outcomes. The researchers defined templates in LTL that model various time-based conditions, such as what must happen now, must eventually happen, and must happen until something else occurs. The robots observations of 30 human demonstrations for setting the table yielded a probability distribution over 25 different LTL formulas. Each formula encoded a slightly different preference or specification for setting the table. That probability distribution becomes its belief.
Each formula encodes something different, but when the robot considers various combinations of all the templates, and tries to satisfy everything together, it ends up doing the right thing eventually, Ankit Shah says.
Following criteria
The researchers also developed several criteria that guide the robot toward satisfying the entire belief over those candidate formulas. One, for instance, satisfies the most likely formula, which discards everything else apart from the template with the highest probability. Others satisfy the largest number of unique formulas, without considering their overall probability, or they satisfy several formulas that represent highest total probability. Another simply minimizes error, so the system ignores formulas with high probability of failure.
Designers can choose any one of the four criteria to preset before training and testing. Each has its own tradeoff between flexibility and risk aversion. The choice of criteria depends entirely on the task. In safety critical situations, for instance, a designer may choose to limit possibility of failure. But where consequences of failure are not as severe, designers can choose to give robots greater flexibility to try different approaches.
With the criteria in place, the researchers developed an algorithm to convert the robots belief the probability distribution pointing to the desired formula into an equivalent reinforcement learning problem. This model will ping the robot with a reward or penalty for an action it takes, based on the specification its decided to follow.
In simulations asking the robot to set the table in different configurations, it only made six mistakes out of 20,000 tries. In real-world demonstrations, it showed behavior similar to how a human would perform the task. If an item wasnt initially visible, for instance, the robot would finish setting the rest of the table without the item. Then, when the fork was revealed, it would set the fork in the proper place. Thats where flexibility is very important, Ankit Shah says. Otherwise it would get stuck when it expects to place a fork and not finish the rest of table setup.
Next, the researchers hope to modify the system to help robots change their behavior based on verbal instructions, corrections, or a users assessment of the robots performance. Say a person demonstrates to a robot how to set a table at only one spot. The person may say, do the same thing for all other spots, or, place the knife before the fork here instead, Ankit Shah says. We want to develop methods for the system to naturally adapt to handle those verbal commands, without needing additional demonstrations.
See the original post:
Showing robots how to do your chores - The MIT Tech
- Robotics Academy - December 14th, 2016 [December 14th, 2016]
- KUKA Robotics | KUKA AG - December 14th, 2016 [December 14th, 2016]
- Robotics - The Great Courses - December 22nd, 2016 [December 22nd, 2016]
- Robotics - reddit - January 11th, 2017 [January 11th, 2017]
- Chatham Robotics Goes Undefeated and Moves On to State Championship - TAPinto.net - February 7th, 2017 [February 7th, 2017]
- Meridian robotics team gears up for Idaho FRC Regional - KBOI-TV - February 7th, 2017 [February 7th, 2017]
- Local robotics students headed to World Championship tournament - KOLO - February 7th, 2017 [February 7th, 2017]
- Report: Nearshoring favors robotics, will require heavy capital investment - Supply Chain Dive - February 7th, 2017 [February 7th, 2017]
- Belding hosts largest robotics competition in history of event - Greenville Daily News - February 7th, 2017 [February 7th, 2017]
- First Tech Challenge: High schools battle in robotics competition - The Journal News | LoHud.com - February 7th, 2017 [February 7th, 2017]
- Robotics Team Takes Home Trophy at Lego Competition - Patch.com - February 7th, 2017 [February 7th, 2017]
- OHS robotics club dazzles McKinley students - Southernminn.com - February 7th, 2017 [February 7th, 2017]
- Toyota Industries Acquires Warehouse Robotics Developer - Wall Street Journal - February 7th, 2017 [February 7th, 2017]
- South High wins Volvo's robotics tournament - Herald-Mail Media - February 7th, 2017 [February 7th, 2017]
- Belding hosts robotics competition - Sentinel-Standard - February 7th, 2017 [February 7th, 2017]
- CMS robotics program soars - SW News Media - February 7th, 2017 [February 7th, 2017]
- Update On The Megatrend of Robotics - CTOvision (blog) - February 7th, 2017 [February 7th, 2017]
- 33C3: Edible Soft Robotics - Hackaday - February 7th, 2017 [February 7th, 2017]
- Shopping robots on the march in Ocado - BBC News - February 7th, 2017 [February 7th, 2017]
- Keller students Starstruck on robotics - Fort Worth Star Telegram - February 7th, 2017 [February 7th, 2017]
- Our obsession with robots keeps getting creepier - New York Post - February 7th, 2017 [February 7th, 2017]
- Rethink Robotics makes its workplace bots easier to train and redeploy - TechCrunch - February 7th, 2017 [February 7th, 2017]
- Donation will cover costs for Sequim robotic competition - Peninsula Daily News - February 8th, 2017 [February 8th, 2017]
- Derby Middle School robotics club competes at high school competition - The Derby Informer - February 8th, 2017 [February 8th, 2017]
- Raspberry Pi-powered arm: This kit aims to make robotics simple enough for kids - TechRepublic - February 8th, 2017 [February 8th, 2017]
- WPI Robotics Team Has a Mission with Mars | News | WPI - WPI News - February 8th, 2017 [February 8th, 2017]
- Rehab robotics field promises to return control, mobility to aging population - ScienceBlog.com (blog) - February 8th, 2017 [February 8th, 2017]
- Rethink's Robots Get Massive Software Upgrade, Rodney Brooks So Excited - IEEE Spectrum - February 8th, 2017 [February 8th, 2017]
- Robotics: A robot that flies like a bat : Nature : Nature Research - Nature.com - February 9th, 2017 [February 9th, 2017]
- Robotics teams at CCS stay busy at tournaments - Imperial Republican - February 9th, 2017 [February 9th, 2017]
- Rethink Robotics rethinks its software | ZDNet - ZDNet - February 9th, 2017 [February 9th, 2017]
- Hartland robotics teams take on the FIRST Tech challenge at state competition - LC Sussex Sun - February 9th, 2017 [February 9th, 2017]
- Home-schooled students studying robotics - Valencia County News Bulletin - February 9th, 2017 [February 9th, 2017]
- Agility Robotics Introduces Cassie, a Dynamic and Talented Robot Delivery Ostrich - IEEE Spectrum - February 9th, 2017 [February 9th, 2017]
- Memphis robotics team headed to Super-Regionals - New Baltimore Voice Newspapers - February 10th, 2017 [February 10th, 2017]
- Patriot Robotics Alliance upsets Brentwood Academy Alliances - Clarksville Now - February 10th, 2017 [February 10th, 2017]
- Raptor legs & human hips: Giant leap for walking robots - RT - February 10th, 2017 [February 10th, 2017]
- How drones and robotics may shape the future of conflict under President Trump - PRI - February 10th, 2017 [February 10th, 2017]
- Robotics teams wins at state meet - The Citizen.com - February 10th, 2017 [February 10th, 2017]
- Ford Bets $1B on Startup Founded by Waymo, Uber Vets - ABC News - February 10th, 2017 [February 10th, 2017]
- South Beach robotics squad advances to super regionals - The Daily World - February 11th, 2017 [February 11th, 2017]
- Personal robotics the next technological revolution: Dr Vivian Balakrishnan - Channel NewsAsia - February 11th, 2017 [February 11th, 2017]
- This bipedal robot could deliver your packages one day - The Verge - The Verge - February 11th, 2017 [February 11th, 2017]
- Robotics event offers lesson in teamwork - Lewiston Morning Tribune (subscription) - February 12th, 2017 [February 12th, 2017]
- Essex County Freeholders Honor Livingston Robotics Club Teams - TAPinto.net - February 12th, 2017 [February 12th, 2017]
- College Town: WPI Robotics team aims for $1M NASA prize - Worcester Telegram - February 12th, 2017 [February 12th, 2017]
- Alice Shaw robotics team building invention to save wolves | Local ... - Lompoc Record - February 12th, 2017 [February 12th, 2017]
- Ford invests $1B in robotics startup in driverless car quest - CBS News - February 12th, 2017 [February 12th, 2017]
- Freshman Caldwell team takes first place in Regional Robotics Tournament - Idaho Press-Tribune - February 12th, 2017 [February 12th, 2017]
- What went seriously wrong with Lily Robotics - VentureBeat - February 12th, 2017 [February 12th, 2017]
- Face off: Marion students compete in robotics competition - The Exponent Telegram (press release) (registration) - February 12th, 2017 [February 12th, 2017]
- Robotics Competition slated for Monday - San Angelo Standard Times - February 13th, 2017 [February 13th, 2017]
- Cornerstone Prep robotics team brings home trophy in first year - MDJOnline.com - February 13th, 2017 [February 13th, 2017]
- Center Grove robotics team headed to state competition - Daily Journal - February 13th, 2017 [February 13th, 2017]
- Hundreds piled into a Fort Mill gym. They cheered. They competed. They drove robots. - The Herald - February 13th, 2017 [February 13th, 2017]
- My Turn: Arts education paved the way for girls' robotics win - AZCentral.com - February 13th, 2017 [February 13th, 2017]
- Young Alberta engineers face off in robotics showdown - CBC.ca - February 13th, 2017 [February 13th, 2017]
- Cougar robotics team advances to Super-Regionals - Times Bulletin - Times Bulletin - February 13th, 2017 [February 13th, 2017]
- South Carroll Robotics teams compete at Maryland State Robotics Competition - Carroll County Times - February 13th, 2017 [February 13th, 2017]
- Cave Spring High School's Robotics Club wins in the First Tech ... - Roanoke Times - February 13th, 2017 [February 13th, 2017]
- FIRST Robotics Competition - Wikipedia - February 13th, 2017 [February 13th, 2017]
- Designing robots to look more like ostriches can solve a key problem for our future biped overlords - Quartz - February 14th, 2017 [February 14th, 2017]
- More than 1000 high school students expected to Battlefield HS robotics tournament - PotomacLocal.com - February 14th, 2017 [February 14th, 2017]
- Event to look at Scotland's pivotal role in robotics - The Scotsman - February 14th, 2017 [February 14th, 2017]
- Kennett Coders to compete in NH State Robotics Championships on Saturday - Conway Daily Sun - February 14th, 2017 [February 14th, 2017]
- Are there enough robots? - Robotics Tomorrow (press release) - February 15th, 2017 [February 15th, 2017]
- Girl Scouts of Southern Illinois robotics team makes state tournament - Alton Telegraph - February 15th, 2017 [February 15th, 2017]
- Intuition Robotics raised $6 million for its ElliQ elder care assistant robot - TechCrunch - February 15th, 2017 [February 15th, 2017]
- Richmond robotics team gears up for districts - New Baltimore Voice Newspapers - February 15th, 2017 [February 15th, 2017]
- Microsoft lets you crash drones and robots in its new real world simulator - The Verge - February 15th, 2017 [February 15th, 2017]
- Makeblock's Lego-like 'Neuron' teaches kids robotics and code - Engadget - February 15th, 2017 [February 15th, 2017]
- West Ridge robotics team maneuvers into national championship - Austin American-Statesman - February 15th, 2017 [February 15th, 2017]
- Immokalee High team set for robotics state championships Friday - Naples Daily News - February 16th, 2017 [February 16th, 2017]
- What has Robotics got in store for our future? - RTE.ie - February 16th, 2017 [February 16th, 2017]
- Uber Is Becoming a Robotics Company, CEO Says - Yahoo News - February 16th, 2017 [February 16th, 2017]
- 3Doodler's new kits help kids craft their own robots - Engadget - Engadget - February 16th, 2017 [February 16th, 2017]
- Magnetic Control Could Help Robots Navigate Inside Your Body - IEEE Spectrum - February 16th, 2017 [February 16th, 2017]
- Boston's new hub, MassRobotics, is like a WeWork for robotics startups - TechCrunch - February 16th, 2017 [February 16th, 2017]
- 3Doodler announces a robotics kit, Star Trek and Powerpuff Girls ... - TechCrunch - February 17th, 2017 [February 17th, 2017]
- Chart: Are Robots Replacing High-Cost Workers? - Seeking Alpha - February 17th, 2017 [February 17th, 2017]