Over the holidays, I went for a drive with a Tesla. With, not in, because the car was doing the driving.
Hearing about autonomous vehicles is one thing; experiencing it was something entirely different. When the parked Model S calmly drove itself out of the garage, I stood gaping in awe, completely mind-blown.
If this years Consumer Electronics Show is any indication, self-driving cars are zooming into our lives, fast and furious. Aspects of automation are already in useTeslas Autopilot, for example, allows cars to control steering, braking and switching lanes. Elon Musk, CEO of Tesla, has gone so far as to pledge that by 2018, you will be able to summon your car from across the countryand itll drive itself to you.
So far, the track record for autonomous vehicles has been fairly impressive. According to a report from the National Highway Traffic Safety Administration, Teslas crash rate dropped by about 40% after turning on their first-generation Autopilot system. This week, with the introduction of gen two to newer cars equipped with the necessary hardware, Musk is aiming to cut the number of accidents by another whopping 50 percent.
But when self-driving cars mess up, we take note. Last year, a Tesla vehicle slammed into a white truck while Autopilot was engagedapparently confusing it with the bright, white skyresulting in the companys first fatality.
So think about this: would you entrust your life to a robotic machine?
For anyone to even start contemplating yes, the cars have to be remarkably safe fully competent in day-to-day driving, and able to handle any emergency traffic throws their way.
Unfortunately, those edge cases also happen to be the hardest problems to solve.
To interact with the world, autonomous cars are equipped with a myriad of sensors. Googles button-nosed Waymo car, for example, relies on GPS to broadly map out its surroundings, then further captures details using its cameras, radar and laser sensors.
These data are then fed into software that figures out what actions to take next.
As with any kind of learning, the more scenarios the software is exposed to, the better the self-driving car learns.
Getting that data is a two-step process: first, the car has to drive thousands of hours to record its surroundings, which are used as raw data to build 3D maps. Thats why Google has been steadily taking their cars out on field tripssome two million miles to datewith engineers babysitting the robocars to flag interesting data and potentially take over if needed.
This is followed by thousands of hours of labelingthat is, manually annotating the maps to point out roads, vehicles, pedestrians and other subjects. Only then can researchers feed the dataset, so-called labeled data, into the software for it to start learning the basics of a traffic scene.
The strategy works, but its agonizingly slow, tedious and the amount of experience that the cars get is limited. Since emergencies tend to fall into the category of unusual and unexpected, it may take millions of miles before the car encounters dangerous edge cases to test its softwareand of course, put both car and human at risk.
An alternative, increasingly popular approach is to bring the world to the car.
Recently, Princeton researchers Ari Seff and Jianxiong Xiao realized that instead of manually collecting maps, they could tap into a readily available repertoire of open-sourced 3D maps such as Google Street View and OpenStreetMap. Although these maps are messy and in some cases can have bizarre distortions, they offer a vast amount of raw data that could be used to construct datasets for training autonomous vehicles.
Manually labeling that data is out of the question, so the team built a system that can automatically extract road featuresfor example, how many lanes there are, if theres a bike lane, what the speed limit is and whether the road is a one-way street.
Using a powerful technique called deep learning, the team trained their AI on 150,000 Street View panoramas, until it could confidently discard artifacts and correctly label any given street attribute. The AI performed so well that it matched humans on a variety of labeling tasks, but at much faster speed.
The automated labeling pipeline introduced here requires no human intervention, allowing it to scale with these large-scale databases and maps, concluded the authors.
With further improvement, the system could take over the labor-intensive job of labeling data. In turn, more data means more learning for autonomous cars and potentially much faster progress.
This would be a big win for self-driving technology, says Dr. John Leonard, a professor specializing in mapping and automated driving at MIT.
Other researchers are eschewing the real world altogether, instead turning to hyper-realistic gaming worlds such as Grand Theft Auto V.
For those not in the know, GTA V lets gamers drive around the convoluted roads of a city roughly one-fifth the size of Los Angeles. Its an incredibly rich world the game boasts 257 types of vehicles and 7 types of bikes that are all based on real-world models. The game also simulates half a dozen kinds of weather conditions, in all giving players access to a huge range of scenarios.
Its a total data jackpot. And researchers are noticing.
In a study published in mid-2016, Intel Labs teamed up with German engineers to explore the possibility of mining GTA V for labeled data. By looking at any road scene in the game, their system learned to classify different objects in the roadcars, pedestrians, sidewalks and so onthus generating huge amounts of labeled data that can then be fed to self-driving cars.
Of course, datasets extracted from games may not necessarily reflect the real world. So a team from the University of Michigan trained two algorithms to detect vehicles one using data from GTA V, the other using real-world imagesand pitted them against each other.
The result? The game-trained algorithm performed just as well as the one trained with real-life images, although it needed about 100 times more training data to reach the performance of the real-world algorithmnot a problem, since generating images in games is quick and easy.
But its not just about datasets. GTA V and other hyper-realistic virtual worlds also allow engineers to test their cars in uncommon but highly dangerous scenarios that they may one day encounter.
In virtual worlds, AIs can tackle a variety of traffic hazardssliding on ice, hitting a wall, avoiding a deerwithout worry. And if the cars learn how to deal with these edge cases in simulations, they may have a higher chance of surviving one in real life.
So far, none of the above systems have been tested on physical self-driving cars.
But with the race towards full autonomy at breakneck speed, its easy to see companies incorporating these systems to give themselves an upper edge.
Perhaps more significant is that these virtual worlds represent a subtle shift towards the democratization of self-driving technology. Most of them are open-source, in that anyone can hop onboard to create and test their own AI solutions for autonomous cars.
And who knows, maybe the next big step towards full autonomy wont be made inside Tesla, Waymo, or any other tech giant.
It could come from that smart kid next door.
Image Credit: Shutterstock
See more here:
Robot Cars Can Teach Themselves How to Drive in Virtual Worlds - Singularity Hub
- Singularity Future Technology Ltd (SGLY) is up 43.55% Tuesday In Premarket Trading - InvestorsObserver - March 18th, 2024 [March 18th, 2024]
- This Week's Awesome Tech Stories From Around the Web (Through March 16) - Singularity Hub - March 18th, 2024 [March 18th, 2024]
- Palia reaches over 3m players in six months thanks to "invaluable" Switch partnership - GamesIndustry.biz - March 18th, 2024 [March 18th, 2024]
- Beyond the Singularity: Exploring the Fusion of AI and Art - Hong Kong Standard - March 18th, 2024 [March 18th, 2024]
- Your Comprehensive Guide to Telos Staking Success | by Pizza Singularity Sapphire | Feb, 2024 - Medium - February 20th, 2024 [February 20th, 2024]
- BTS' Kim Taehyung's 'Singularity' Performance Featured in Harvard Professor's Book - BNN Breaking - February 20th, 2024 [February 20th, 2024]
- Title: Understanding the Singularity: Unveiling the Future of Humanity - Medium - December 12th, 2023 [December 12th, 2023]
- What happens at the center of a black hole? - Astronomy Magazine - December 12th, 2023 [December 12th, 2023]
- IBM Is Planning to Build Its First Fault-Tolerant Quantum Computer by 2029 - Singularity Hub - December 12th, 2023 [December 12th, 2023]
- 22 Laws of Singularity And How You Can Apply Them To Live A Better Life - Medium - December 12th, 2023 [December 12th, 2023]
- Singularity: Here's When Humanity Will Reach It, New Data Shows - March 31st, 2023 [March 31st, 2023]
- sentinelOne expands singularity marketplace with new SOAR, insider threat, training, and prioritization integrations - ZAWYA - March 31st, 2023 [March 31st, 2023]
- Reaching the Singularity May be Humanitys Greatest and Last ... - March 4th, 2023 [March 4th, 2023]
- Singularity: Explain It to Me Like I'm 5-Years-Old - Futurism - March 4th, 2023 [March 4th, 2023]
- SINGULARITY FUTURE TECHNOLOGY LTD. : Notice of Delisting or Failure to Satisfy a Continued Listing Rule or Standard; Transfer of Listing, Change in... - March 4th, 2023 [March 4th, 2023]
- Apple co-founder Steve Wozniak on Artificial Intelligence: Not worried about The Singularity, well still be in control - MacDailyNews - February 12th, 2023 [February 12th, 2023]
- Cauchy principal value - Wikipedia - January 4th, 2023 [January 4th, 2023]
- Singularity Future Technology Ltd. (SGLY) Stockholder Notice: Robbins LLP Reminds Investors of the Class Action Against Singularity Future Technology... - December 14th, 2022 [December 14th, 2022]
- ROSEN, A LEADING LAW FIRM, Encourages Singularity Future Technology Ltd. f/k/a Sino-Global Shipping America Ltd. Investors to Secure Counsel Before... - December 12th, 2022 [December 12th, 2022]
- Singularity (mathematics) - Wikipedia - November 23rd, 2022 [November 23rd, 2022]
- GitHub: Where the world builds software GitHub - November 21st, 2022 [November 21st, 2022]
- Review: The Singularities, by John Banville - The New York Times - October 25th, 2022 [October 25th, 2022]
- We need to manage AI better as we are approaching the Creative Singularity - RedShark News - October 15th, 2022 [October 15th, 2022]
- This Week's Awesome Tech Stories From Around the Web (Through October 15) - Singularity Hub - October 15th, 2022 [October 15th, 2022]
- Ferguson: A second helping of QB play from Thanksgiving weekend - CFL.ca - October 15th, 2022 [October 15th, 2022]
- Kanimozhi slams Union govt over conducting CGL exams in only Hindi and English - The News Minute - October 15th, 2022 [October 15th, 2022]
- New Bayonetta 3 Trailer Reveals An In-Universe Singularity, And Lots Of Witches - Gameranx - October 13th, 2022 [October 13th, 2022]
- Singularity Future Technology Announces Receipt of Nasdaq Notice of Delisting and Intention to Request Hearing - Yahoo Finance - October 13th, 2022 [October 13th, 2022]
- Six Recent Discoveries That Have Changed How We Think About Human Origins - Singularity Hub - October 13th, 2022 [October 13th, 2022]
- This AI Uses a Scan of Your Retina to Predict Your Risk of Heart Disease - Singularity Hub - October 13th, 2022 [October 13th, 2022]
- The Moon May Have Formed Just Hours After Earth Collided With a Protoplanet - Singularity Hub - October 13th, 2022 [October 13th, 2022]
- UK HealthCare hosting 2 nationally esteemed guests for 60th anniversary symposium - UKNow - October 13th, 2022 [October 13th, 2022]
- Why Transcend Fund believes the opportunity for game investments is only getting bigger - VentureBeat - October 13th, 2022 [October 13th, 2022]
- Austin Powers References in This Fool, Ramy, Bros - Vulture - October 13th, 2022 [October 13th, 2022]
- Bayonetta 3 Everything You Need to Know About this Bewitching Beat em Up - Wccftech - October 8th, 2022 [October 8th, 2022]
- Longtermism: The Future Is VastWhat Does This Mean for Our Own Life? - Singularity Hub - October 8th, 2022 [October 8th, 2022]
- Ohio creates elections integrity office while voter fraud is already 'exceedingly rare' - ideastream - October 8th, 2022 [October 8th, 2022]
- Elon Musk Warns of World War III - TheStreet - October 8th, 2022 [October 8th, 2022]
- Durga reminds us of our collective obligations - Daily Pioneer - October 8th, 2022 [October 8th, 2022]
- Glitch in the algorithm - The Bucknellian - October 8th, 2022 [October 8th, 2022]
- As the Robot Fry Cook Takes Over the Kitchen - Walter Bradley Center for Natural and Artificial Intelligence - October 8th, 2022 [October 8th, 2022]
- The Singularity Image Format (SIF) Selected as a Finalist in the HPCwire Readers' Choice Awards - PR Web - October 6th, 2022 [October 6th, 2022]
- The Singularity Image Format (SIF) Selected as a Finalist in the HPCwire Readers' Choice Awards - Benzinga - October 6th, 2022 [October 6th, 2022]
- The Singularity of the Dual Mandate - Federal Reserve Bank of San Francisco - October 6th, 2022 [October 6th, 2022]
- What Is the Quirk Singularity Doomsday Theory in My Hero Academia? Explained - Twinfinite - October 6th, 2022 [October 6th, 2022]
- Introduction to week 4 of Tekedia Mini-MBA: Exponential Technologies and Singularity - Tekedia - October 6th, 2022 [October 6th, 2022]
- A $500 Million International Project Will Create the Most Detailed Map of the Brain Ever - Singularity Hub - October 6th, 2022 [October 6th, 2022]
- There Are Cheaper, More Sustainable Ways Than Desalination to Meet Our Water Needs - Singularity Hub - October 6th, 2022 [October 6th, 2022]
- #3DStartup: Unlimited Tomorrow and its 3D Printed Bionic Prosthetic Arm - 3Dnatives - October 6th, 2022 [October 6th, 2022]
- First As Parody, Then As Free Speech: The Onion Goes To The Supreme Court. It's About As Awesome As You'd Suspect. - Above the Law - October 6th, 2022 [October 6th, 2022]
- 10 Hot Cyber Threat Intelligence Tools And Services In 2022 - CRN - October 6th, 2022 [October 6th, 2022]
- Nintendo comes out strong with its offering of upcoming titles - The UML Connector - October 6th, 2022 [October 6th, 2022]
- The metaverses evolutionary roots could aid its success | Mint - Mint - October 6th, 2022 [October 6th, 2022]
- The Tech That Will Push VR to the Limits of the Human Eye - Singularity Hub - September 27th, 2022 [September 27th, 2022]
- Super-Earths Are Bigger and More Habitable Than Earth, and Astronomers Are Discovering More of the Billions They Think Are Out There - Singularity Hub - September 27th, 2022 [September 27th, 2022]
- Scientists Have Long Dreamed of a Memory Prosthesis. The First Human Trials Look Promising - Singularity Hub - September 27th, 2022 [September 27th, 2022]
- NASA's DART Spacecraft Will Smack an Asteroid at 14,000 MPH Todayand You Can Watch - Singularity Hub - September 27th, 2022 [September 27th, 2022]
- Why You Should Read This: 'The Gold Coast' - Alta Magazine - September 27th, 2022 [September 27th, 2022]
- The Multitude of Stromae - Mail and Guardian - September 27th, 2022 [September 27th, 2022]
- Warhammer 40,000: Space Marine is Getting a Location-based VR Experience Next Year - Road to VR - September 27th, 2022 [September 27th, 2022]
- What the pandemic taught us about teaching (On the Other Hand) - Montclair Local - September 27th, 2022 [September 27th, 2022]
- Where to get the Boom Sniper in Fortnite Chapter 3 Season 4 - The Nerd Stash - September 27th, 2022 [September 27th, 2022]
- Machine learning has predicted the winners of the Worlds - CyclingTips - September 27th, 2022 [September 27th, 2022]
- Vaonis Vespera Review: Easy To Use But with Underwhelming Results - PetaPixel - September 27th, 2022 [September 27th, 2022]
- The biggest problem with gravity and quantum physics - Big Think - September 27th, 2022 [September 27th, 2022]
- V gets inked on his butt cheek? BTS star spills the details about his friendship tattoo - Zoom TV - September 27th, 2022 [September 27th, 2022]
- Robots & Humans: Are we heading towards Singularity? - INDIAai - September 20th, 2022 [September 20th, 2022]
- This Week's Awesome Tech Stories From Around the Web (Through September 17) - Singularity Hub - September 20th, 2022 [September 20th, 2022]
- A Swedish Company Wants to Transform Offshore Wind With Vertical-Axis Turbines - Singularity Hub - September 20th, 2022 [September 20th, 2022]
- Decarbonizing the Energy Sector by 2050 Could Save the World $12 Trillion - Singularity Hub - September 20th, 2022 [September 20th, 2022]
- This Sleek Solar Car Goes 600 Miles on a Charge and Is Gearing Up for Production - Singularity Hub - September 20th, 2022 [September 20th, 2022]
- Meta Built an AI That Can Guess the Words You're Hearing by Decoding Your Brainwaves - Singularity Hub - September 20th, 2022 [September 20th, 2022]
- Gory Throwback FPS 'Prodeus' Exits Early Access This Thursday, Launching for PC and Consoles [Trailer] - Bloody Disgusting - September 20th, 2022 [September 20th, 2022]
- Meet the New Vespera Telescope From Vaonis - Universe Today - September 20th, 2022 [September 20th, 2022]
- Of God and Machines - The Atlantic - September 20th, 2022 [September 20th, 2022]
- Humans Destroyed Forests for Thousands of Years. We Can Become the First Generation to Expand Them - Singularity Hub - September 20th, 2022 [September 20th, 2022]
- Intel Core i9-13900K beats the 12900K by +10% in CPU-bound games - KitGuru - September 20th, 2022 [September 20th, 2022]
- INVESTIGATION ALERT: The Schall Law Firm Encourages Investors in Singularity Future Technology Ltd. with Losses of $100000 to Contact the Firm -... - August 15th, 2022 [August 15th, 2022]
- How To Open Singularity Rock in Tower of Fantasy - Attack of the Fanboy - August 15th, 2022 [August 15th, 2022]
- Intel i9-13900K Tested in Ashes Of The Singularity, Offers Neglible Increments in Performance - Appuals - August 15th, 2022 [August 15th, 2022]