The multiverse of science fiction is populated by robots that are indistinguishable from humans. They are usually smarter, faster, and stronger than us. They seem capable of doing any job imaginable, from piloting a starship and battling alien invaders to taking out the trash and cooking a gourmet meal.
The reality, of course, is far from fantasy. Aside from industrial settings, robots have yet to meet The Jetsons. The robots the public are exposed to seem little more than over-sized plastic toys, pre-programmed to perform a set of tasks without the ability to interact meaningfully with their environment or their creators.
To paraphrase PayPal co-founder and tech entrepreneur Peter Thiel, we wanted cool robots, instead we got 140 characters and Flippy the burger bot. But scientists are making progress to empower robots with the ability to see and respond to their surroundings just like humans.
Some of the latest developments in that arena were presented this month at the annual Robotics: Science and Systems Conference in Cambridge, Massachusetts. The papers drilled down into topics that ranged from how to make robots more conversational and help them understand language ambiguities to helping them see and navigate through complex spaces.
Ben Burchfiel, a graduate student at Duke University, and his thesis advisor George Konidaris, an assistant professor of computer science at Brown University, developed an algorithm to enable machines to see the world more like humans.
In the paper, Burchfiel and Konidaris demonstrate how they can teach robots to identify and possibly manipulate three-dimensional objects even when they might be obscured or sitting in unfamiliar positions, such as a teapot that has been tipped over.
The researchers trained their algorithm by feeding it 3D scans of about 4,000 common household items such as beds, chairs, tables, and even toilets. They then tested its ability to identify about 900 new 3D objects just from a birds eye view. The algorithm made the right guess 75 percent of the time versus a success rate of about 50 percent for other computer vision techniques.
In an email interview with Singularity Hub, Burchfiel notes his research is not the first to train machines on 3D object classification. How their approach differs is that they confine the space in which the robot learns to classify the objects.
Imagine the space of all possible objects, Burchfiel explains. That is to say, imagine you had tiny Legos, and I told you [that] you could stick them together any way you wanted, just build me an object. You have a huge number of objects you could make!
The infinite possibilities could result in an object no human or machine might recognize.
To address that problem, the researchers had their algorithm find a more restricted space that would host the objects it wants to classify. By working in this restricted spacemathematically we call it a subspacewe greatly simplify our task of classification. It is the finding of this space that sets us apart from previous approaches.
Meanwhile, a pair of undergraduate students at Brown University figured out a way to teach robots to understand directions better, even at varying degrees of abstraction.
The research, led by Dilip Arumugam and Siddharth Karamcheti, addressed how to train a robot to understand nuances of natural language and then follow instructions correctly and efficiently.
The problem is that commands can have different levels of abstraction, and that can cause a robot to plan its actions inefficiently or fail to complete the task at all, says Arumugam in a press release.
In this project, the young researchers crowdsourced instructions for moving a virtual robot through an online domain. The space consisted of several rooms and a chair, which the robot was told to manipulate from one place to another. The volunteers gave various commands to the robot, ranging from general (take the chair to the blue room) to step-by-step instructions.
The researchers then used the database of spoken instructions to teach their system to understand the kinds of words used in different levels of language. The machine learned to not only follow instructions but to recognize the level of abstraction. That was key to kickstart its problem-solving abilities to tackle the job in the most appropriate way.
The research eventually moved from virtual pixels to a real place, using a Roomba-like robot that was able to respond to instructions within one second 90 percent of the time. Conversely, when unable to identify the specificity of the task, it took the robot 20 or more seconds to plan a task about 50 percent of the time.
One application of this new machine-learning technique referenced in the paper is a robot worker in a warehouse setting, but there are many fields that could benefit from a more versatile machine capable of moving seamlessly between small-scale operations and generalized tasks.
Other areas that could possibly benefit from such a system include things from autonomous vehicles to assistive robotics, all the way to medical robotics, says Karamcheti, responding to a question by email from Singularity Hub.
These achievements are yet another step toward creating robots that see, listen, and act more like humans. But dont expect Disney to build a real-life Westworld next to Toon Town anytime soon.
I think were a long way off from human-level communication, Karamcheti says. There are so many problems preventing our learning models from getting to that point, from seemingly simple questions like how to deal with words never seen before, to harder, more complicated questions like how to resolve the ambiguities inherent in language, including idiomatic or metaphorical speech.
Even relatively verbose chatbots can run out of things to say, Karamcheti notes, as the conversation becomes more complex.
The same goes for human vision, according to Burchfiel.
While deep learning techniques have dramatically improved pattern matchingGoogle can find just about any picture of a cattheres more to human eyesight than, well, meets the eye.
There are two big areas where I think perception has a long way to go: inductive bias and formal reasoning, Burchfiel says.
The former is essentially all of the contextual knowledge people use to help them reason, he explains. Burchfiel uses the example of a puddle in the street. People are conditioned or biased to assume its a puddle of water rather than a patch of glass, for instance.
This sort of bias is why we see faces in clouds; we have strong inductive bias helping us identify faces, he says. While it sounds simple at first, it powers much of what we do. Humans have a very intuitive understanding of what they expect to see, [and] it makes perception much easier.
Formal reasoning is equally important. A machine can use deep learning, in Burchfiels example, to figure out the direction any river flows once it understands that water runs downhill. But its not yet capable of applying the sort of human reasoning that would allow us to transfer that knowledge to an alien setting, such as figuring out how water moves through a plumbing system on Mars.
Much work was done in decades past on this sort of formal reasoning but we have yet to figure out how to merge it with standard machine-learning methods to create a seamless system that is useful in the actual physical world.
Robots still have a lot to learn about being human, which should make us feel good that were still by far the most complex machines on the planet.
Image Credit: Alex Knightvia Unsplash
View original post here:
How Robots Are Getting Better at Making Sense of the World - Singularity Hub
- Downloads - Singularity Viewer - December 25th, 2016 [December 25th, 2016]
- What is Singularity (the)? - Definition from WhatIs.com - January 5th, 2017 [January 5th, 2017]
- When Electronic Witnesses Are Everywhere, No Secret's Safe - Singularity Hub - February 7th, 2017 [February 7th, 2017]
- Report: AMD Ryzen Performance in Ashes of the Singularity Benchmark - PC Perspective - February 7th, 2017 [February 7th, 2017]
- Do you believe in the Singularity? - Patheos (blog) - February 7th, 2017 [February 7th, 2017]
- Editorial Note From the Singularity Hub Team - Singularity Hub - February 7th, 2017 [February 7th, 2017]
- Discover the Most Advanced Industrial Technologies at Exponential Manufacturing - Singularity Hub - February 7th, 2017 [February 7th, 2017]
- 10th Letter looks at nature in the time of the Singularity - Creative Loafing Atlanta - February 7th, 2017 [February 7th, 2017]
- Donald Trump Is the Singularity - Bloomberg View - Bloomberg.com - Bloomberg - February 7th, 2017 [February 7th, 2017]
- Wearable Devices Can Actually Tell When You're About to Get Sick - Singularity Hub - February 7th, 2017 [February 7th, 2017]
- AMD 8-core Ryzen benchmark show up on Ashes Of The Singularity ... - VR-Zone - February 8th, 2017 [February 8th, 2017]
- Robot Cars Can Teach Themselves How to Drive in Virtual Worlds - Singularity Hub - February 8th, 2017 [February 8th, 2017]
- Physicists Unveil Blueprint for a Quantum Computer the Size of a Soccer Field - Singularity Hub - February 10th, 2017 [February 10th, 2017]
- How Robots Helped Create 100000 Jobs at Amazon - Singularity Hub - February 10th, 2017 [February 10th, 2017]
- Ready to Change the World? Apply Now for Singularity University's 2017 Global Solutions Program - Singularity Hub - February 10th, 2017 [February 10th, 2017]
- Singularity Containers for Science, Reproducibility, and HPC - Linux.com (blog) - February 10th, 2017 [February 10th, 2017]
- Families Finally Hear From Completely Paralyzed Patients Via New Mind-Reading Device - Singularity Hub - February 12th, 2017 [February 12th, 2017]
- artificial intelligence: the fear of a technological singularity ... - ETtech.com - February 13th, 2017 [February 13th, 2017]
- Holograms Aren't The Stuff of Science Fiction Anymore - Singularity Hub - February 15th, 2017 [February 15th, 2017]
- How the World Has Changed From 1917 to 2017 - Singularity Hub - February 16th, 2017 [February 16th, 2017]
- Preparing for the Singularity - Inverse - February 16th, 2017 [February 16th, 2017]
- Our Health Data Can Save Lives, But We Have to Be Willing to Share - Singularity Hub - February 17th, 2017 [February 17th, 2017]
- Ashes of the Singularity merges with standalone expansion Escalation, no upgrade fee - PCGamesN - February 17th, 2017 [February 17th, 2017]
- Just Stand Inside this Room and it Will Wirelessly Charge Your Phone - Singularity Hub - February 18th, 2017 [February 18th, 2017]
- AMD bundles Ashes of the Singularity with FX processors ahead of Ryzen's launch - PCWorld - February 18th, 2017 [February 18th, 2017]
- Ashes of the Singularity: Escalation being merged with the original game - PC Invasion (blog) - February 18th, 2017 [February 18th, 2017]
- Singularity - GameSpot - February 20th, 2017 [February 20th, 2017]
- The roots of technological singularity can be traced backed to the Stone Age - Wired.co.uk - February 20th, 2017 [February 20th, 2017]
- Jide's new OS is like an Android version of Windows 10's Continuum - The Verge - February 22nd, 2017 [February 22nd, 2017]
- Jide Announces Remix Singularity: The Continuum Alternative for Android - XDA Developers (blog) - February 22nd, 2017 [February 22nd, 2017]
- New Tech Makes Brain Implants Safer and Super Precise - Singularity Hub - February 23rd, 2017 [February 23rd, 2017]
- One Android company wants to use smartphones to make PCs truly dead - BGR - February 23rd, 2017 [February 23rd, 2017]
- Remix tries its hand at the mobile-desktop hybrid OS with Singularity - Android Police - February 23rd, 2017 [February 23rd, 2017]
- Financial Leaders: Make Your Mark on the Future at Exponential Finance - Singularity Hub - February 23rd, 2017 [February 23rd, 2017]
- Remix Singularity is Jide's Android answer to Windows Continuum - SlashGear - February 24th, 2017 [February 24th, 2017]
- AMD Radeon RX 580 Ashes of the Singularity Benchmarks Leaked 4K, Ryzen Combo, CrossFire and More! - Wccftech - February 24th, 2017 [February 24th, 2017]
- Damon Wayans Jr. Joins FX Sci-Fi Comedy Singularity - Den of Geek US - February 24th, 2017 [February 24th, 2017]
- After Man? From Singularity to Specificity - Peace Research Institute Oslo (PRIO) (press release) (blog) - February 24th, 2017 [February 24th, 2017]
- Why the Potential of Augmented Reality Is Greater Than You Think - Singularity Hub - February 24th, 2017 [February 24th, 2017]
- Damon Wayans Jr In Evan Goldberg & Seth Rogen AI comedy - /FILM - February 24th, 2017 [February 24th, 2017]
- Ashes of Singularity: Escalation Gets an Update - CGMagazine - February 24th, 2017 [February 24th, 2017]
- Google Updates: Scuba, Singularity, SMS and suing - The INQUIRER - February 24th, 2017 [February 24th, 2017]
- Singularity Art Show Tonight In San Francisco! - February 25th, 2017 [February 25th, 2017]
- Stardock celebrate v2.1 of Ashes of the Singularity: Escalation with a ... - PCGamesN - February 27th, 2017 [February 27th, 2017]
- Video: AI Is Getting Smarter, Says Singularity University's Neil ... - Wall Street Journal (subscription) (blog) - February 28th, 2017 [February 28th, 2017]
- This Neural Probe Is So Thin, The Brain Doesn't Know It's There - Singularity Hub - March 1st, 2017 [March 1st, 2017]
- Citizen Science Means Anyone Could Discover Planet NineEven You - Singularity Hub - March 1st, 2017 [March 1st, 2017]
- Singularity University establishes new organisation in Denmark - Ministry of Foreign Affairs of Denmark - March 1st, 2017 [March 1st, 2017]
- Singularity University opening organisation in Denmark - The Copenhagen Post - Danish news in english - March 1st, 2017 [March 1st, 2017]
- Does Zapping Your Brain Actually Help You Learn Faster? - Singularity Hub - March 2nd, 2017 [March 2nd, 2017]
- What You Need to Know About Elon Musk's Plan to Fly People to the Moon - Singularity Hub - March 2nd, 2017 [March 2nd, 2017]
- Singularity: Explain It to Me Like I'm 5-Years-Old - Futurism - Futurism - March 3rd, 2017 [March 3rd, 2017]
- Singularity for PC Reviews - Metacritic - March 4th, 2017 [March 4th, 2017]
- Singularity (mathematics) - Wikipedia - March 4th, 2017 [March 4th, 2017]
- See How This House Was 3D Printed in Just 24 Hours - Singularity Hub - March 6th, 2017 [March 6th, 2017]
- NYC's Metrograph theater is running a sci-fi film series featuring Blade Runner, Ex Machina, and Metropolis - The Verge - March 8th, 2017 [March 8th, 2017]
- 3 Exciting Biotech Trends to Watch Closely in 2017 - Singularity Hub - March 9th, 2017 [March 9th, 2017]
- New Burger Robot Will Take Command of the Grill in 50 Fast Food Restaurants - Singularity Hub - March 9th, 2017 [March 9th, 2017]
- Are These Giant Neurons the Seat Of Consciousness in the Brain? - Singularity Hub - March 10th, 2017 [March 10th, 2017]
- How Fully Synthetic Complex Life Just Got a Lot Closer - Singularity Hub - March 12th, 2017 [March 12th, 2017]
- Singularity University launches inaugural Canada Summit | BetaKit - BetaKit - April 8th, 2017 [April 8th, 2017]
- Singularity - Everything2.com - April 8th, 2017 [April 8th, 2017]
- Singularity (Game) - Giant Bomb - April 8th, 2017 [April 8th, 2017]
- Ashes of the Singularity: Escalation on Steam - April 8th, 2017 [April 8th, 2017]
- Approaching the World of Collaboration Singularity - CommsTrader - June 6th, 2017 [June 6th, 2017]
- Berkeley Lab's Open-Source Spinoff Serves Science | Berkeley Lab - Lawrence Berkeley National Laboratory - June 7th, 2017 [June 7th, 2017]
- Beyond Politics: Innovating for a Sustainable Future - Singularity Hub - June 7th, 2017 [June 7th, 2017]
- Tune Into the Future of Fintech at Exponential Finance This Week - Singularity Hub - June 7th, 2017 [June 7th, 2017]
- Experts Weigh in on AI and the Singularity - Futurism - June 7th, 2017 [June 7th, 2017]
- Singularity | Mass Effect Wiki | Fandom powered by Wikia - June 7th, 2017 [June 7th, 2017]
- Quantum Computers Will Analyze Every Financial Model at Once - Singularity Hub - June 8th, 2017 [June 8th, 2017]
- Deloitte and Singularity University Extend Their Relationship To ... - PR Newswire (press release) - June 8th, 2017 [June 8th, 2017]
- Ashes of the Singularity: Escalation 2.3 update adds a new campaign today - PC Gamer - June 8th, 2017 [June 8th, 2017]
- Singularity and Docker | Singularity - June 8th, 2017 [June 8th, 2017]
- Ashes of the Singularity gets a new fully-voiced campaign - PCGamesN - June 9th, 2017 [June 9th, 2017]
- At Exponential Finance, the Singularity University Explores Visionary Applications of Blockchains - Crypto Insider (press release) (blog) - June 9th, 2017 [June 9th, 2017]
- Get It While It's Hot: Why Fintech Is a Goldmine for Investors - Singularity Hub - June 10th, 2017 [June 10th, 2017]
- Forget Police Sketches: Researchers Perfectly Reconstruct Faces by Reading Brainwaves - Singularity Hub - June 14th, 2017 [June 14th, 2017]
- Singularity Summit comes to SA | IT-Online - IT-Online - June 16th, 2017 [June 16th, 2017]
- These 7 Disruptive Technologies Could Be Worth Trillions of Dollars - Singularity Hub - June 17th, 2017 [June 17th, 2017]