As self-driving cars edge closer to production, the race to develop autonomous systems that can handle the driving anytime and anywhere is hotting up. Along with the big names, smaller players are pushing to nail the formula with their own kits that would convert existing cars into autonomous ones. One such company is AImotive, and we paid a visit to its Mountain View, California office to chat with senior team member Lorant Pocsveiler about how self-driving cars see, understand and react to the world around them.
Join more than 500 New Atlas Plus subscribers who read our newsletter and website without ads.
It's just US$19 a year.
Just like any human driver, an autonomous car needs to see what's happening around it. The team at AImotive believes, because the roads are designed for humans, the first self-driving cars will need to be vision-based.
"We use a camera-first approach here," Lorant Pocsveiler tells New Atlas. He's sitting in the conference room of the company's US offices, a house in Mountain View converted for business use. "We think in an environment such as [our current road setup], which has been designed around humans with visual cues in mind... the camera-first approach has the best chance to identify things. It's a very rich source of information."
Cameras mounted to the roof, nose and tail of the car (with radar as a backup) work to build a picture of what's going on, essentially acting as a set of eyes and ears. Different players in the self-driving game are taking varying approaches, with many utilizing expensive Lidar, but the team at AImotive is designing a system to work with any sensors that meet its basic resolution guidelines, making it easier for manufacturers to match the software with their own hardware.
Being able to see what's happening is one thing, being able to interpret it is another. In the AImotive car, the recognition engine breaks down raw information from the sensors and feeds it through special segmentation software, which is tasked with identifying various objects. Although it's able to handle up to 100 different object classes, the system currently uses just 25.
For every frame captured on camera, the software is able to create a list of what it's seeing, with details regarding size, distance and angle in relation to the car. This is all displayed on the in-car screen, which gives each different class a unique colour. Information from the cameras and sensors is overlaid with data from the location engine, which uses regular GPS data to build a clearer picture of where the car is.
"The location engine's main role is to figure out where the car is" Pocveiler says. "We have to know where the car is precisely. GPS is the starting point for that, however GPS might not be precise enough."
Check out AImotive object recognition at work in the video above.
"In order to improve the location data, we also use landmarks," Pocveiler continues. "This is all about highlighting the precise position of certain traffic signs and signals. We know where a certain traffic sign should be, what the precise position is, then we figure the position of the car by measuring the distance and direction from that object. This improves the precision of where the car is."
Just as we trust what our eyes perceive over the little map on our dashboard, AImotive is building a vision-first system, meaning navigation data is there to confirm what the cameras are seeing. Obviously, it's also important the car knows what roads to take when users program a destination.
Once it knows what everything is, the car needs to plot a course. At AImotive, that task falls to the motion engine. It calculates the historical path of objects (where they've been), their current location and, using this data, where they're likely to head next. As you'd imagine, the system is constantly recalculating what it expects the cars and pedestrians around it to do, just as regular drivers are always watching the traffic around them for cues as to what's coming.
With all this data in place, the car can actually go about plotting a path through the chaos. Once again, data about where the car wants to go can be displayed live on an in-car screen, complete with a moving arrow.
With all the thinking done, the car needs to actually put thoughts or plans into action. Once all this information has been processed, all the AImotive system needs to do is electronically apply inputs to the steering, gas and brakes through its control engine.
We weren't able to see the car driving itself on our visit the company doesn't have a driverless testing license in California yet but we did get to see some footage of it working in a simulation (more on that later). Perhaps the highest praise we can heap on the display is that, if you hadn't been told there was no driver behind the wheel, you'd have no idea.
Obviously, this is complicated to put into action. Everything we've described needs to happen hundreds (or thousands) of times every second, and it needs to happen perfectly. There is no room for error and no room for teething problems when it's jostling with notoriously pushy Californian drivers. The software relies on perfectly calibrated cameras and sensors, too, something handled by yet another AI element of the AImotive package. In spite of this, AImotive is bullish about the potential of its system.
"I would say by the end of this year, on a technology level, a highway scenario would be in place," Pocveiler tells New Atlas. In other words, the system could be able to comfortably drive on the highway driving within twelve months. "By the end of next year we could have a city scenario covered." Just to be clear, that doesn't mean the system will be installed in a working autonomous car anytime soon, but the software capability is likely to be there.
That potential, and the rapid rate of development, is the result of constant testing, both in the real world and using an in-house simulator. Rather than focusing on covering millions of on-road testing miles like Waymo or Uber, the team at AImotive has put together an in-house simulation system that is able to put the car through its paces around the clock.
Perhaps more importantly, no humans are put into the line of fire during testing, and almost any scenario can be simulated. Want to know how the car will react if an elephant wanders onto the interstate? You can do that. Curious about what happens when two cars have an accident in front of you? Load it up and see what happens.
It's this level of research and development that will be integral to bringing self-driving cars to our roads. If you're keen on driving, that day might be a sad one, but when they do arrive, at least you'll have an idea what's happening under the hood.
Read the original post:
Anatomy of autonomy: A look at how self-driving cars think - New Atlas
- Chocolate Artistry [Last Updated On: August 17th, 2024] [Originally Added On: April 4th, 2010]
- La Cabeza Circuitoide [Last Updated On: August 17th, 2024] [Originally Added On: April 5th, 2010]
- Stuntkid: Anatomically Correct [Last Updated On: August 17th, 2024] [Originally Added On: April 5th, 2010]
- "The Secret Museum" Exhibition Opening, Observatory, This Saturday, April 10, 7-10 PM [Last Updated On: April 6th, 2010] [Originally Added On: April 6th, 2010]
- "The Secret Museum" Exhibition Opening, Observatory, This Saturday, April 10, 7-10 PM [Last Updated On: August 17th, 2024] [Originally Added On: April 6th, 2010]
- Flat Surgery [Last Updated On: August 17th, 2024] [Originally Added On: April 7th, 2010]
- Job Opportunities at the Medical Museion, University of Copenhagen [Last Updated On: April 9th, 2010] [Originally Added On: April 9th, 2010]
- "The Secret Museum" Exhibition Opening, Observatory, TONIGHT! April 10, 7-10 PM [Last Updated On: April 10th, 2010] [Originally Added On: April 10th, 2010]
- Animal Body Worlds at the Neunkirchen Zoo, Saarland, Germany [Last Updated On: April 11th, 2010] [Originally Added On: April 11th, 2010]
- Congress for Curious People: Lectures Begin Tomorrow Night at the Coney Island Museum! [Last Updated On: April 12th, 2010] [Originally Added On: April 12th, 2010]
- Job Opportunities at the Medical Museion, University of Copenhagen [Last Updated On: August 17th, 2024] [Originally Added On: April 12th, 2010]
- Animal Body Worlds at the Neunkirchen Zoo, Saarland, Germany [Last Updated On: August 17th, 2024] [Originally Added On: April 12th, 2010]
- "The Secret Museum" Exhibition Opening, Observatory, TONIGHT! April 10, 7-10 PM [Last Updated On: August 17th, 2024] [Originally Added On: April 12th, 2010]
- Anatomic Fashion Friday: Skeleton Bodysuit [Last Updated On: August 17th, 2024] [Originally Added On: April 12th, 2010]
- Diabetes Ads [Last Updated On: August 17th, 2024] [Originally Added On: April 12th, 2010]
- Anatomia del corpo humano [Last Updated On: August 17th, 2024] [Originally Added On: April 13th, 2010]
- "The Brading Collection of Taxidermy, Waxworks, Costume and Similar Items," Duke's Auction House, Dorset, April 13th (Today!) [Last Updated On: August 17th, 2024] [Originally Added On: April 14th, 2010]
- Anatomy Pillow [Last Updated On: August 17th, 2024] [Originally Added On: April 14th, 2010]
- A Brief History of Automata, An Illustrated Lecture and Demonstration by Mike Zohn, Obscura Antiques and Oddities, TONIGHT! Coney Island Museum [Last Updated On: April 14th, 2010] [Originally Added On: April 14th, 2010]
- "The Brading Collection of Taxidermy, Waxworks, Costume and Similar Items," Duke's Auction House, Dorset, April 13th (Today!) [Last Updated On: April 15th, 2010] [Originally Added On: April 15th, 2010]
- A Brief History of Automata, An Illustrated Lecture and Demonstration by Mike Zohn, Obscura Antiques and Oddities, TONIGHT! Coney Island Museum [Last Updated On: August 17th, 2024] [Originally Added On: April 15th, 2010]
- Hip Pockets [Last Updated On: August 17th, 2024] [Originally Added On: April 15th, 2010]
- "A History of Taxidermy: Art, Science and Bad Taste," An Illustrated Presentation By Dr. Pat Morris, Congress for Curious People, Coney Island Museum [Last Updated On: August 17th, 2024] [Originally Added On: April 16th, 2010]
- “Wild Anatomy” by Rachel “Thirsty Fly” Caldwell [Last Updated On: August 17th, 2024] [Originally Added On: April 16th, 2010]
- Charles Wilson Peale and the Birth of the American Museum, Coney Island Museum, Tonight!!! [Last Updated On: April 16th, 2010] [Originally Added On: April 16th, 2010]
- "The Congress for Curious People," Epic 2-Day Symposium Begins Tomorrow!!! [Last Updated On: April 16th, 2010] [Originally Added On: April 16th, 2010]
- "A History of Taxidermy: Art, Science and Bad Taste," An Illustrated Presentation By Dr. Pat Morris, Congress for Curious People, Coney Island Museum [Last Updated On: April 17th, 2010] [Originally Added On: April 17th, 2010]
- Charles Wilson Peale and the Birth of the American Museum, Coney Island Museum, Tonight!!! [Last Updated On: August 17th, 2024] [Originally Added On: April 17th, 2010]
- "The Congress for Curious People," Epic 2-Day Symposium Begins Tomorrow!!! [Last Updated On: August 17th, 2024] [Originally Added On: April 17th, 2010]
- Anatomic Fashion Friday: Lady Grey Jewelry [Last Updated On: August 17th, 2024] [Originally Added On: April 17th, 2010]
- "Stuffed Animals and Pickled Heads" Book and Lecture by Stephen Asma, Thursday April 22, Observatory [Last Updated On: August 17th, 2024] [Originally Added On: April 20th, 2010]
- "The Silken Web: The Erotic World of Paris, 1920-1946," Mel Gordon Lecture at Observatory, Tomorrow April 20th [Last Updated On: August 17th, 2024] [Originally Added On: April 20th, 2010]
- Marylin Monroe Exposed [Last Updated On: August 17th, 2024] [Originally Added On: April 20th, 2010]
- The Dance of Death, 1919, Attributed to Josef Fenneker [Last Updated On: April 20th, 2010] [Originally Added On: April 20th, 2010]
- "Stuffed Animals and Pickled Heads" Book and Lecture by Stephen Asma, Thursday April 22, Observatory [Last Updated On: April 21st, 2010] [Originally Added On: April 21st, 2010]
- "The Silken Web: The Erotic World of Paris, 1920-1946," Mel Gordon Lecture at Observatory, Tomorrow April 20th [Last Updated On: April 21st, 2010] [Originally Added On: April 21st, 2010]
- The Dance of Death, 1919, Attributed to Josef Fenneker [Last Updated On: August 17th, 2024] [Originally Added On: April 21st, 2010]
- Military Docs Pluck Live Shell From Soldier’s Head [Last Updated On: August 17th, 2024] [Originally Added On: April 21st, 2010]
- "The Rogue Taxidermy Kunstkammer," The Minnesota Association of Rogue Taxidermists, La Luz de Jesus, Los Angeles [Last Updated On: August 17th, 2024] [Originally Added On: April 22nd, 2010]
- "Museums, Monsters and the Moral Imagination" Lecture by Stephen Asma, Tonight!, Observatory [Last Updated On: April 22nd, 2010] [Originally Added On: April 22nd, 2010]
- "The Rogue Taxidermy Kunstkammer," The Minnesota Association of Rogue Taxidermists, La Luz de Jesus, Los Angeles [Last Updated On: April 23rd, 2010] [Originally Added On: April 23rd, 2010]
- "Museums, Monsters and the Moral Imagination" Lecture by Stephen Asma, Tonight!, Observatory [Last Updated On: August 17th, 2024] [Originally Added On: April 23rd, 2010]
- Feminal Artery [Last Updated On: August 17th, 2024] [Originally Added On: April 23rd, 2010]
- Anatomic Fashion Friday: Penis Trousers [Last Updated On: August 17th, 2024] [Originally Added On: April 24th, 2010]
- The First Full Facial Transplant [Last Updated On: August 17th, 2024] [Originally Added On: April 26th, 2010]
- "Anatomical Art: Dissection to Illustration," Exhibition Curated by Marie Dauenheimer, Arlington, Virginia [Last Updated On: April 26th, 2010] [Originally Added On: April 26th, 2010]
- "Anatomical Art: Dissection to Illustration," Exhibition Curated by Marie Dauenheimer, Arlington, Virginia [Last Updated On: August 17th, 2024] [Originally Added On: April 27th, 2010]
- John C. Miller [Last Updated On: August 17th, 2024] [Originally Added On: April 27th, 2010]
- "Three Unique Medical Museums in Northern Italy," Lecture by Marie Dauenheimer, Observatory, Saturday May 1 [Last Updated On: August 17th, 2024] [Originally Added On: April 28th, 2010]
- This Is Spinal Tape [Last Updated On: August 17th, 2024] [Originally Added On: April 28th, 2010]
- "Excellent Old-School Science Models," Life Magazine Photo Gallery [Last Updated On: April 28th, 2010] [Originally Added On: April 28th, 2010]
- "Three Unique Medical Museums in Northern Italy," Lecture by Marie Dauenheimer, Observatory, Saturday May 1 [Last Updated On: April 29th, 2010] [Originally Added On: April 29th, 2010]
- "Excellent Old-School Science Models," Life Magazine Photo Gallery [Last Updated On: August 17th, 2024] [Originally Added On: April 29th, 2010]
- Ventricle Vase [Last Updated On: August 17th, 2024] [Originally Added On: April 29th, 2010]
- "Imaging / Imagining the Skeleton," Symposium, Tomorrow, Friday, April 30, 1:00-4pm, CUNY Graduate Center [Last Updated On: August 17th, 2024] [Originally Added On: April 30th, 2010]
- Synthetic Being [Last Updated On: August 17th, 2024] [Originally Added On: April 30th, 2010]
- Tomorrow Night at Observatory! "Three Unique Medical Museums in Northern Italy," Lecture by Marie Dauenheimer [Last Updated On: April 30th, 2010] [Originally Added On: April 30th, 2010]
- "Imaging / Imagining the Skeleton," Symposium, Tomorrow, Friday, April 30, 1:00-4pm, CUNY Graduate Center [Last Updated On: May 1st, 2010] [Originally Added On: May 1st, 2010]
- Tomorrow Night at Observatory! "Three Unique Medical Museums in Northern Italy," Lecture by Marie Dauenheimer [Last Updated On: August 17th, 2024] [Originally Added On: May 1st, 2010]
- UIC’s Biomedical Visualization Program on CBS [Last Updated On: August 17th, 2024] [Originally Added On: May 1st, 2010]
- Kim Joon [Last Updated On: August 17th, 2024] [Originally Added On: May 1st, 2010]
- Head of Discovery and Engagement, Wellcome Library, Employment Opportunity [Last Updated On: August 17th, 2024] [Originally Added On: May 3rd, 2010]
- Talking While Driving [Last Updated On: August 17th, 2024] [Originally Added On: May 3rd, 2010]
- "Experimenting with Death: An Introduction to Terror Management Theory," Lecture, Observatory, Thursday May 6 [Last Updated On: August 17th, 2024] [Originally Added On: May 3rd, 2010]
- Skin Drawings [Last Updated On: August 17th, 2024] [Originally Added On: May 4th, 2010]
- Kabinett des Grotesken ("Cabinet of the Grotesque"), Berliner Medizinhistorisches Museum der Charité, Spiegel Online [Last Updated On: May 4th, 2010] [Originally Added On: May 4th, 2010]
- Head of Discovery and Engagement, Wellcome Library, Employment Opportunity [Last Updated On: May 5th, 2010] [Originally Added On: May 5th, 2010]
- "Experimenting with Death: An Introduction to Terror Management Theory," Lecture, Observatory, Thursday May 6 [Last Updated On: May 5th, 2010] [Originally Added On: May 5th, 2010]
- Kabinett des Grotesken ("Cabinet of the Grotesque"), Berliner Medizinhistorisches Museum der Charité, Spiegel Online [Last Updated On: August 17th, 2024] [Originally Added On: May 5th, 2010]
- WAD Magazine [Last Updated On: August 17th, 2024] [Originally Added On: May 5th, 2010]
- "The Saddest Object in the World," An Illustrated Meditation, Observatory, Friday, May 7th [Last Updated On: August 17th, 2024] [Originally Added On: May 6th, 2010]
- "An Atlas of Topographical Anatomy after Plane Sections of Frozen Bodies," Christian Wilhelm Braune, 1877 [Last Updated On: August 17th, 2024] [Originally Added On: May 6th, 2010]
- The Taxidermy of Mr. Walter Potter and his Museum of Curiosities, Melissa Milgrom [Last Updated On: August 17th, 2024] [Originally Added On: May 6th, 2010]
- Industrial Strength Lungs [Last Updated On: August 17th, 2024] [Originally Added On: May 6th, 2010]
- The Taxidermy of Mr. Walter Potter and his Museum of Curiosities, Melissa Milgrom [Last Updated On: May 6th, 2010] [Originally Added On: May 6th, 2010]
- Tonight!!! "Experimenting with Death: An Introduction to Terror Management Theory," Lecture, Observatory [Last Updated On: May 6th, 2010] [Originally Added On: May 6th, 2010]
- Original Fritz Kahn Posters and Key Booklet, Sotheby's Vintage Posters Auction, May 13 [Last Updated On: May 6th, 2010] [Originally Added On: May 6th, 2010]
- "The Saddest Object in the World," An Illustrated Meditation, Observatory, Friday, May 7th [Last Updated On: May 7th, 2010] [Originally Added On: May 7th, 2010]
- "An Atlas of Topographical Anatomy after Plane Sections of Frozen Bodies," Christian Wilhelm Braune, 1877 [Last Updated On: May 7th, 2010] [Originally Added On: May 7th, 2010]
- Tonight!!! "Experimenting with Death: An Introduction to Terror Management Theory," Lecture, Observatory [Last Updated On: August 17th, 2024] [Originally Added On: May 7th, 2010]