Carmeras engineers want real-time updates to the maps theyre building for autonomous vehicles. They also want to map every road in the world.
Unfortunately, doing both isnt possible.
Carmera builds its maps using LiDAR, a sensing method that measures distances using pulsating lasers, as well as RGB color scans, GPS data and inertial measurements. But those high-precision instruments only accomplish half the job. The maps still need to be maintained, and this startup found a distinct way to do it: sticking mobile phones onto vehicle fleets and letting them collect video data as they travel around.
Voila: crowdsourced maps.
But all that data has to be processed through edge or cloud computing. For a handful of cities, its doable. For the entire earth, it gets a little pricey.
It would take hundreds of millions of dollars to process once, Ethan Sorrelgreen, Carmeras chief product officer, said. And youd have to process it every day.
As Carmera works to usher in the adoption of autonomous vehicles, Sorrelgreens team performs an ongoing balancing act of speed, scale and cost.
Autonomous vehicles rely on a combination of cameras and sensors to navigate. Adding a base map, like the ones Carmera generates, helps a vehicle better understand its location, anticipate the road ahead and plan its course.
A vehicle driving behind a large truck, for example, may not be able to see an approaching stoplight. By referencing a base map, it could still know the stoplight is there. Base maps could also make autonomous vehicles less vulnerable to bad actors who try to trick the cars cameras.
Both functions are a draw for companies working on self-driving technology. Carmeras customers include Voyage, a driverless ride-hailing service operating in retirement communities, and Toyota.
Signing a large original equipment manufacturerlike Toyota was a big win for a startup like Carmera. But working with OEMs came with problems, as well. Specifically: The cost of processing an outrageous amount of data.
Analysis paralysis kills you when youre a startup.
Theres this general attitude that cloud processing is free, and you basically can process as much data as you want to, Sorrelgreen said. When we were working with smaller mobility-as-a-service companies, this wasnt as much of an issue. But when we started working with major automakers and looking at continent-scale or world-scale maps, our existing paradigm for processing data needed to change.
Sorrelgreen, Carmera CTO Justin Day and a couple of senior engineers sat down in a room to decide what to do. Their goal, he said, was to walk out with a potential solution as quickly as possible.
Analysis paralysis kills you when youre a startup, Sorrelgreen said. Implement something and then make it better, as opposed to trying to come up with the perfect idea up front.
Two weeks later, they had a plan. Within a quarter, they were using three critical questions to help build the most accurate maps possible at the lowest cost.
Why arent self-driving cars here yet?The Big Questions Keeping Driverless Cars Off the Road
At first, the engineers at Carmera tried to build theirown hardware to mount on fleets and process video data. But after six months of product development, they made an important discovery.
We realized we were just building a mobile phone, Sorrelgreen said.
With that realization, they shifted gears and started looking for the best cellphone for their purposes. A more advanced model would make data processing easier, but it would also drive the cost up. They decided to save money on the hardware side.
We have to get really, really smart about how we break the problem down, because we cant just throw the latest and greatest technology at it.
We dont use the latest Galaxy mobile phone to do data processing, Sorrelgreen said. Were using five-year-old, little Motoralas that are very, very old in terms of todays technology, and that means were using processors that are nowhere near as fast as what you can get.
Given that limitation, the team is continually experimenting with how best to allocate the phones processing power. In other words, how robust can their modeling get before it requires an expensive hardware upgrade?
We try to keep the phones super simple so we can deploy them on more cars, Carmera senior engineer Alana Ohno said. But weve played around with attaching more machine learning onto the phone.
Not all the data the companys cameras collect is worthwhile to process, and building a reliable computer vision model on an oldfangled mobile phone is no easy task.
We have to get really, really smart about how we break the problem down, because we cant just throw the latest and greatest technology at it, Sorrelgreen said.
The model, for instance, must be able to identify pertinent objects, like orange traffic cones that indicate road work. But running an object classifier algorithm in real time on the phones would be impossible. So the team created a few layers of algorithms to help determine what gets processed on the phone itself and what gets sent to the cloud for further analysis.
For example, if a phone has four cores, one may process a thread of key frames in the video data, hunting for the color orange. Once it finds the color, it sends that frame to a second core, which runs a rudimentary object classifier. If the algorithm determines that video data may contain objects of value like traffic cones the data is uploaded to the cloud.
Other threads look through video for diamond-shaped road signs or color combinations that could be traffic lights. But these naive classifiers even the one that hunts for the color orange dont always get it right.
Once it found us a Tropicana orange juice delivery truck, Sorrelgreen said. There was a lot of orange, but they were actual oranges.
That, however, isnt a bad thing. Carmeras developers optimized the algorithms for false positives. A fresh map is a safe map, Sorrelgreen said, and reviewing too many details is far better than missing an important one especially when your clients are major automakers.
The cloud processing system in charge of reviewing those details is known at Carmera as the cortex, and aptly so. It acts like a brain, sifting through sensory data from the mobile phones and determining whats important enough to receive further review, and what that review should look like. If video from one phone indicates a roadblock, the cortex may request a few additional frames from other vehicles in the same area. And sending single frames, instead of more video, saves processing power.
With machine learning models, you can never really test with 100 percent accuracy.
Like any other brain, the cortex uses a variety of variables to make its decisions. Data from a rarely-traveled road carries more weight than that from a busy city street, for instance, so the system collects observations each time a car passes through a less-traversedarea.
An observations potential impact on traffic plays a role, as well. If a car-camera picks up a concrete barrier, that obstruction is likely to be there for a while, and the cortex knows it doesnt need to collect data on that area again right away. Traffic cones, however, could be gone in a day, so the system will check in more frequently.
Lastly, the system prioritizes detection over clearance. That means discovering new impactful events is more important than noticing when old ones are cleared away.
Carmera built the cortex to be intelligent. Nonetheless, it still needs some help from human brains. Before new data is integrated into the companys maps, it gets passed to an operations team member for final review.
The work the human does is meant to be very, very simple, but its also really important because with machine learning models, you can never really test with 100 percent accuracy, Ohno said.
Are you getting the most from your data team?How Data Scientists and Engineers Can Work Better Together
As the Carmera team selected candidates for algorithmic review or details of value to map users some were common sense. The color orange, for example, is a good thing to watch for while youre driving. Others, however, came from customer feedback.
Its not that the customer is always right, but the customer always has more information.
Some companies, Ohno said, want to avoid roads with construction or police activity altogether because their sensors arent equipped to navigate those obstructions. Others want their maps to display every relevant detail, down to metal manhole covers.
Its not that the customer is always right, but the customer always has more information, and you should feed that into your development, Sorrelgreen said. Whether theyre right or not about whether you should be implementing something, theyre close to the problem and know what their needs are.
Going forward, Carmera will continue to tweak its algorithms daily, he said. Each new customer will come with its own needs and constraints, starting the product teams three-pronged approach back at step one.
Its a challenge, but Sorrelgreen isnt too worried. The company is preparing for demand at a global scale, he said, because Carmeras maps give self-driving vehicles an important safety feature that sensors do not: wisdom.
In order to give an autonomous vehicle a sort of intuition, you need to give it this rich, very detailed information from which to make those inferences.
Originally posted here:
Mapping the World In Real Time (On a Budget) - Built In
- ISSCC 2024: Inside AMD's Zen 4cThe Area-Optimized Cloud Computing Core - News - All About Circuits - February 26th, 2024 [February 26th, 2024]
- Huawei Cloud: Infrastructure of Choice for AI with 10 Systematic Innovations Unveiled in MWC Barcelona 2024 - Morningstar - February 26th, 2024 [February 26th, 2024]
- Cybersecurity fears drive a return to on-premise infrastructure from cloud computing - Help Net Security - February 26th, 2024 [February 26th, 2024]
- Cybersecurity fears drive a return to on-premise infrastructure from cloud computing - HealthLeaders Media - February 26th, 2024 [February 26th, 2024]
- Huawei Cloud: Infrastructure of Choice for AI with 10 Systematic Innovations Unveiled in MWC Barcelona 2024 - PR Newswire - February 26th, 2024 [February 26th, 2024]
- South Korea Boosts Cloud Computing with $91.5 Million Investment to Propel AI and SaaS Innovation - BNN Breaking - February 26th, 2024 [February 26th, 2024]
- Science ministry to invest 121.9 bln won in cloud computing industry - Yonhap News Agency - February 26th, 2024 [February 26th, 2024]
- Why Microsoft is spending billions on AI and cloud computing in Europe - ITPro - February 26th, 2024 [February 26th, 2024]
- Universities Migrate Research Computing to the Cloud - EdTech Magazine: Focus on K-12 - February 26th, 2024 [February 26th, 2024]
- Top Cloud Computing Skills You Need to Know in 2024 - Simplilearn - February 26th, 2024 [February 26th, 2024]
- Best Cloud Tools of 2024: Unleash Maximum Productivity - Simplilearn - February 26th, 2024 [February 26th, 2024]
- Real-time Analytics News for the Week Ending February 24 - RTInsights - February 26th, 2024 [February 26th, 2024]
- Synadia Raises $25 Million Series B Funding to Meet Massive Demand for Multi-cloud and Edge Computing Driven by AI - PR Newswire - February 26th, 2024 [February 26th, 2024]
- CEO Outlook 2024: 20 Solution Providers On The Cloud Moment - CRN - February 26th, 2024 [February 26th, 2024]
- DigitalOcean beats expectations under the helm of new CEO Paddy Srinivasan - SiliconANGLE News - February 26th, 2024 [February 26th, 2024]
- Securing Kubernetes in a Cloud Native World - The New Stack - February 26th, 2024 [February 26th, 2024]
- How to Build a Chat Interface using Gradio & Vultr Cloud GPU SitePoint - SitePoint - February 26th, 2024 [February 26th, 2024]
- Microsoft to invest $2.1bn in cloud and AI infrastructure in Spain - DatacenterDynamics - February 26th, 2024 [February 26th, 2024]
- Stannah looks to enterprise cloud software to lift IT systems - ComputerWeekly.com - February 26th, 2024 [February 26th, 2024]
- AI vendor finds opportunity amid AI computing problem - TechTarget - February 26th, 2024 [February 26th, 2024]
- Nvidia Worth More Than Alphabet, Amazon - 24/7 Wall St. - February 26th, 2024 [February 26th, 2024]
- VIB spearheads banking innovation with deployment of Temenos Banking Platform on AWS cloud - VnExpress International - February 26th, 2024 [February 26th, 2024]
- Why These 7 Cloud Computing Stocks Should be on Your Radar in 2024 - InvestorPlace - December 25th, 2023 [December 25th, 2023]
- IBM to Buy Software AG's Cloud Computing and AI Assets for $2.3BN - Investopedia - December 25th, 2023 [December 25th, 2023]
- Pass the AWS Certified Cloud Practitioner Certification in One Week - Medium - December 25th, 2023 [December 25th, 2023]
- 3 Cloud Computing Stocks You'll Regret Not Buying Soon: December Edition - InvestorPlace - December 25th, 2023 [December 25th, 2023]
- Cloud Computing Market Predicted to Hit US$1,266.4 Billion by 2028 - TechiExpert.com - December 25th, 2023 [December 25th, 2023]
- AWS chief Adam Selipsky talks generative AI, Amazon's investment in Anthropic and cloud cost-cutting - Omaha World-Herald - December 25th, 2023 [December 25th, 2023]
- Mangata Networks and Microsoft Partner on AI-enabled Edge Cloud Connectivity - AiThority - December 25th, 2023 [December 25th, 2023]
- Democratization of Cloud vs AI: A Case Study - Medium - December 25th, 2023 [December 25th, 2023]
- 5 Drivers Behind the Growth of the GPU Cloud Computing Market - Visual Capitalist - December 25th, 2023 [December 25th, 2023]
- Report: AWS to reorganize sales teams amid slowing cloud revenue growth - SiliconANGLE News - December 25th, 2023 [December 25th, 2023]
- Don't underestimate vulnerabilities in the cloud. Adopt hybrid to stay protected - Best Enterprise Data Storage Software ... - Solutions Review - December 25th, 2023 [December 25th, 2023]
- Innovations, disruptions, transformations expected in 2024 Intelligent CIO Middle East - Intelligent CIO - December 25th, 2023 [December 25th, 2023]
- IBM makes $2B+ deal to add more AI, cloud computing solutions - WRAL TechWire - December 25th, 2023 [December 25th, 2023]
- How to Select the Right Industry Cloud for Your Business - How to Select the Right Industry Cloud for Your Business - InformationWeek - December 25th, 2023 [December 25th, 2023]
- Cloud Computing Market Set to Reach US$1,266.4 Billion by 2028 - Analytics Insight - December 25th, 2023 [December 25th, 2023]
- Cisco to Acquire Isovalent to Secure Cloud-Native Networking - Channel E2E - December 25th, 2023 [December 25th, 2023]
- Cloud-native applications: Unlocking the potential of scalability and agility - ETCIO - December 25th, 2023 [December 25th, 2023]
- Year-in-Review: 2023 Was a Turning Point for Microservices - The New Stack - December 25th, 2023 [December 25th, 2023]
- If AI is the future, radiology needs to look to the cloud - Health Imaging - December 25th, 2023 [December 25th, 2023]
- AI and Cloud: The Proving Ground for Regulatory Resilience in 2024 - Finextra - December 25th, 2023 [December 25th, 2023]
- Cognata Redefines Sensor Suite Selection Processes Through Digital Twin-based Sensor Simulation and Cloud ... - PR Newswire - December 25th, 2023 [December 25th, 2023]
- Microsoft and Amazon the focus of cloud computing probe - Proactive Investors USA - October 5th, 2023 [October 5th, 2023]
- Cloud cover benefits of being on the cloud - The Actuary - October 5th, 2023 [October 5th, 2023]
- AI, Cloud Computing among 36 FREE Online Courses Now ... - Philippine Information Agency - October 5th, 2023 [October 5th, 2023]
- Amazon Web Services isn't trying to win the A.I. race. It wants to own the road. - Slate - July 31st, 2023 [July 31st, 2023]
- The Machines Behind the FinOps Curtain: Operationalizing Your Strategy with AI - ITPro Today - July 31st, 2023 [July 31st, 2023]
- Strengthening security in a multi-SaaS cloud environment - TechCrunch - July 31st, 2023 [July 31st, 2023]
- Oracle Introduces First Cloud Native Secure Cloud Computing ... - PR Newswire - July 31st, 2023 [July 31st, 2023]
- The Power of Cloud Computing: How it's Transforming Database ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- From Headquarters to the Edge: The Future of Cloud in the Defense ... - MeriTalk - July 31st, 2023 [July 31st, 2023]
- 6 Cloud Computing Companies Navigating the Digital Storm in 2023 - GovCon Wire - July 31st, 2023 [July 31st, 2023]
- Government Cloud Computing Market Size, Status and Business ... - University City Review - July 31st, 2023 [July 31st, 2023]
- Cloud Computing in Education Market Forecast, 2023-2029: The ... - University City Review - July 31st, 2023 [July 31st, 2023]
- Global Cloud Computing IaaS In Life Science Market Size and ... - University City Review - July 31st, 2023 [July 31st, 2023]
- What is the Relationship Between IoT and Cloud Computing? - Analytics Insight - July 31st, 2023 [July 31st, 2023]
- How Data Center Interconnect Platforms are Shaping the Future of ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- Revolutionizing IoT: How 5G and Cloud Computing are ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- The Future of Cloud Computing: Database as a Service (DBaaS) in ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- Overcoming Data Privacy Challenges in the European Cloud ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- The Future of Telemedicine in India: How Cloud Computing is ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- Multi-Cloud and Hybrid Cloud: What is the Difference? - Analytics Insight - July 31st, 2023 [July 31st, 2023]
- A New Era of Data Management: The Growing Importance of Global ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- From niche to necessity: GFT's vision for cloud computing ... - Business Leader - July 31st, 2023 [July 31st, 2023]
- ERP, Cloud Computing And Digital Transformation - CIOReview - July 31st, 2023 [July 31st, 2023]
- UMD Smith Offers New January Start Date for MS in Information ... - Newswise - July 31st, 2023 [July 31st, 2023]
- The Impact of Global White-box Server Adoption on Cloud ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- Global Application Transformation: Unlocking the Potential of Cloud ... - Fagen wasanni - July 31st, 2023 [July 31st, 2023]
- BFSI Sector and Asia-Pacific Spearhead the Rapid Growth of Cloud ... - GlobeNewswire - July 31st, 2023 [July 31st, 2023]
- Amazon is investing another $7.8B in Ohio-based cloud computing operations, state leaders say - The Associated Press - June 28th, 2023 [June 28th, 2023]
- Google Cloud Platform: Everything you need to know about Google's suite of cloud computing services - Android Police - June 28th, 2023 [June 28th, 2023]
- Amazon is investing another $7.8B in Ohio-based cloud computing ... - Wilmington News Journal, OH - June 28th, 2023 [June 28th, 2023]
- 11 Key Executives in the Cloud Computing Industry in 2023 - Executive Gov - June 28th, 2023 [June 28th, 2023]
- 10 Multi-Cloud Myths Debunked: Exposing the Facts - TechFunnel - June 28th, 2023 [June 28th, 2023]
- How MTN and Microsoft will transform business operations with ... - TheCable - June 28th, 2023 [June 28th, 2023]
- The Power of Cloud Computing: Revolutionizing Business and IT ... - Tech Critter - June 28th, 2023 [June 28th, 2023]
- FTC Collecting Comments On Cloud Computing, CCIA Offers Input ... - Computer and Communications Industry Association - June 28th, 2023 [June 28th, 2023]
- How AI and Cloud Computing Are Revolutionizing the Insurance ... - Techopedia - June 28th, 2023 [June 28th, 2023]
- HPE Discover final analysis: Navigating the cloud computing ... - SiliconANGLE News - June 28th, 2023 [June 28th, 2023]