One of the iPhones set to be released this year will have some impressive augmented reality capability according to a report by Fast Company.
According to the report, one of the upcoming Apple iPhones will be fitted with a 3D depth camera attached on its back. This world-facing 3D scanner will offer users better augmented reality experiences. The feature has been rumored for years and this must be the year it finally comes to fruition. The Fast Company report quotes Apple-related sources.
The rear-facing camera will be a laser, sensor and a software system and it will work on the time-of-flight principle. A time-of-flight sensor sends out a light pulse and then measures the time it takes for the pulse to reach the object and travel back to the camera sensor. Using the principle, the camera is able to measure the rooms and objects in 3D.
The detailed and accurate depth information captured by the time-of-flight camera allows for the creation of new photo as well as video effects. It also provides much improved AR experiences.
Apple has been working on a rear-facing (world-facing) 3D camera for two years now and rumors had been rife that it would be installed on some of the previous iPhone launches. For close to two years, it was one of the features on the shortlist of tech analysts as next in line to be added to the iPhones. This has not materialized, however. From these reports, the feature is in the design and we will see it later in the year if COVID-19 outbreak doesnt interfere with Apples production schedules and launch plans.
Apple is purchasing the laser needed for the working of the new 3D time-of-flight camera from Lumentum, which is based in San Jose. This is the same company supplying the laser used in iPhones front-facing 3D cameras.
Some manufacturers have already incorporated rear-facing depth cameras into their smartphones. Samsungs Galaxy S20+, Galaxy S20 Ultra and the Galaxy Note 10+ already have the 3D depth cameras. So do a constellation of other Android-based smartphones. It is hoped that Apple will bring out new novel ways of leveraging the time-of-flight camera technology to enable new user experiences. Going by past experience, Apple is also more likely to be showy in how it brands and markets the 3D camera/AR experiences.
iPhones already have the front-facing depth cameras (TrueDepth). These are mainly used in FaceID security feature as well as in some of Apples fun messaging effects like Animoji.
Last year, Apple launched the iPhone 11 Pro and the iPhone 11 Pro Max which feature three camera lenses on the back: a 12-megapixel wide angle camera, a 12-megapixel 2X telephoto lens as well as a 12-megapixel ultra-wide-angle lens. All these three lenses give end users a breadth of photo-taking options but the 3D depth camera would provide depth information thereby taking it a notch higher.
The main depth effect that is currently available in the iPhone is its Portrait mode. This provides the photos with a bokeh effect. This blurs the background layer and positions the foreground subject in a sharp focus.
The 3D depth camera will add the depth data that allows for the creation of better-looking bokeh effect and makes it easier to more accurately distinguish the foreground from the background layers. It also adds additional depth layers that blur or focus. This functionality could make it possible to in the future adjust the layers of photos that are blurry and the ones that are now focused after editing mode.
3D mapping could also be used together with the photo software features of the iPhone. The 3D depth camera will have the biggest impact on the quality of the AR apps. Apples ARKit framework for building Augmented Reality apps was released three years ago although it is yet to pick up with consumers. The depth information enabled by the 3D sensing allows for greater accuracy in the functionality of the apps as they are able to more precisely place objects in space. This is likely to result in very powerful app functionality.
Apple is also building an Augmented Reality app for iOS 14 that will make it possible for users to point their smartphones at items in Apple Stores and Starbucks and they will subsequently see digital information about the items displayed around those items via the phone screen.
The rear-facing 3D cameras also allow users to create content that is easily shareable on social media. The phones camera and software can, for example, be used to share images of one interacting with holographic projections of celebrities or even animals. This is not so different from the functionality of the Holo app developed by 8i. With depth data, however, it can deliver much improved experiences. For instance, with depth sensing, it could show the feet of the hologram relative to the tabletop, in a very convincing way.
The 3D camera technology in Samsung phones powers AR features such as Live Focus that enables the user to blur out backgrounds in still images and videos thereby placing an emphasis on the image in the foreground. There is also the Quick Measure feature that can be used in approximating the dimensions, area and volume in the camera frame. Apples depth sensing camera feature may follow a similar path by highlighting features that can be activated by the rear-facing 3D camera.
AR on smartphones unlocks lots of opportunities but there is always the limitation of awkwardly viewing the AR effects via a smartphone screen held in front of the users face. The better AR experience would be via normal-looking AR glasses or headsets which Apple is reportedly silently working on. In the future, this might be Apples primary spatial computing device.
Continued here:
New iPhone to be Released This Year to Have a Rear-Facing 3D Camera - Virtual Reality Times
- UNL program using virtual reality to enhance research - KOLN - May 13th, 2024 [May 13th, 2024]
- 3D augmented reality with regular glasses | Stanford News - Stanford University News - May 13th, 2024 [May 13th, 2024]
- LG Display's Research Results on OLEDoS for VR Selected as Distinguished Paper at SID Display Week 2024 - PR Newswire - May 13th, 2024 [May 13th, 2024]
- Full-colour 3D holographic augmented-reality displays with metasurface waveguides - Nature.com - May 13th, 2024 [May 13th, 2024]
- The Future of Onboarding: Inside Serviceplan's VR-Based Employee Integration | LBBOnline - Little Black Book - LBBonline - May 13th, 2024 [May 13th, 2024]
- Virtual reality space experience returns to Silver Street Studios - Houston Chronicle - May 13th, 2024 [May 13th, 2024]
- Rain Technology to Unveil New Anamorphic-XR Optical Engine at Display Week 2024 - Display Daily - May 13th, 2024 [May 13th, 2024]
- Virtual reality used as a tool for brain health at assisted living center - Eyewitness News 3 - May 13th, 2024 [May 13th, 2024]
- Virtual Reality in Gaming Market to Reach US$75 Billion by 2028 - Analytics Insight - May 13th, 2024 [May 13th, 2024]
- Disney+ to release VR Marvel series exclusively for Apple Vision Pro - CyberNews.com - May 13th, 2024 [May 13th, 2024]
- Startup aimed at VR entertainment in cars files for insolvency - PhoneArena - May 13th, 2024 [May 13th, 2024]
- After Decades of Promise, the Virtual Reality Era Has Finally Arrived - Kiplinger's Personal Finance - May 13th, 2024 [May 13th, 2024]
- Hahnville senior signs with virtual reality gaming company - St. Charles Herald Guide - May 13th, 2024 [May 13th, 2024]
- Sandbox VR Forges Franchise Partnership with Apparel Group to Pioneer Virtual Reality in the Middle East - Business Wire - May 13th, 2024 [May 13th, 2024]
- Best VR games in 2024 - TechRadar - May 13th, 2024 [May 13th, 2024]
- Researchers rely on Virtual Reality as a complementary therapy for eating disorders - MIXED Reality News - May 13th, 2024 [May 13th, 2024]
- Beyond therapy: Virtual reality shows promise in fighting depression - Medical Xpress - May 13th, 2024 [May 13th, 2024]
- Apparel Group And Sandbox VR Announce Partnership - Retail & Leisure International - Retail & Leisure International - May 13th, 2024 [May 13th, 2024]
- Batman returns to VR - theSun - May 13th, 2024 [May 13th, 2024]
- Virtual Reality Shows Promise in Treating Depression - Neuroscience News - May 13th, 2024 [May 13th, 2024]
- Augmented And Virtual Reality in Manufacturing Market Size, Share And Growth Analysis For 2024-2033 - EIN News - May 13th, 2024 [May 13th, 2024]
- Sandbox VR Announces U.S. Franchise Initiative and International Deal - Franchise Times - May 13th, 2024 [May 13th, 2024]
- MINI Mixed Reality Experience: Driving into the Future. - BMW Press - May 13th, 2024 [May 13th, 2024]
- Virtual reality project will allow users to witness October 7 first hand - The Jewish Chronicle - May 13th, 2024 [May 13th, 2024]
- Spin Rhythm XD getting PlayStation and VR ports this summer - Niche Gamer - May 13th, 2024 [May 13th, 2024]
- Students at the Hong Kong University of Science and Technology use virtual reality headsets in class - Islander News.com - May 13th, 2024 [May 13th, 2024]
- SFU SIAT researcher uses virtual reality to help teen mental health - Simon Fraser University News - May 13th, 2024 [May 13th, 2024]
- The Navy Brings Training to the Fleet With VR - ATD - May 13th, 2024 [May 13th, 2024]
- Manchester Airport launches gaming area with virtual reality escape room Business Traveller - Business Traveller - May 13th, 2024 [May 13th, 2024]
- Can virtual reality help ease the end of life? - Universit de Montral - May 13th, 2024 [May 13th, 2024]
- Fans still waiting for a virtual reality view of the Buffalo Bills' new ... - Buffalo News - November 28th, 2023 [November 28th, 2023]
- Immerse yourself in new, augmented worlds - University of Miami: News@theU - November 28th, 2023 [November 28th, 2023]
- Who are the leading innovators in vehicle digital twins for the ... - just-auto.com - November 28th, 2023 [November 28th, 2023]
- How Virtual and Augmented Reality Are Redefining Construction - TimesTech - November 28th, 2023 [November 28th, 2023]
- Virtualware Appoints VRARA's John A Cunningham to Advisory Board - XR Today - November 28th, 2023 [November 28th, 2023]
- University Project Aims to Dissolve Borders Between Virtual and ... - XR Today - November 28th, 2023 [November 28th, 2023]
- Are real cadavers better than virtual ones? - Slate - November 28th, 2023 [November 28th, 2023]
- Samsung Glasses could be the name of a new pair of Samsung ... - TechRadar - November 28th, 2023 [November 28th, 2023]
- The Best Augmented Reality Accessories for AR Immersion - XR Today - November 28th, 2023 [November 28th, 2023]
- The best VR apps for 2022 | Digital Trends - February 18th, 2023 [February 18th, 2023]
- What is virtual reality? - TechTarget - February 18th, 2023 [February 18th, 2023]
- Forget the metaverse, Sony's PlayStation VR2 will make you a virtual reality believer again - British GQ - February 18th, 2023 [February 18th, 2023]
- Time to play! New virtual reality gaming coming to Northern Virginia - WUSA9.com - January 31st, 2023 [January 31st, 2023]
- Virtual reality training content launched for footwear and leather sector - The Hindu - January 31st, 2023 [January 31st, 2023]
- Texas A&M researchers are using multisensory virtual reality to help NASA astronauts - KAGSTV.com - January 31st, 2023 [January 31st, 2023]
- Hollywoods Virtual Reality Guru and American Millionaire Expanded His Soccer Portfolio to Europe With a Deal Worth $940 Million - EssentiallySports - January 8th, 2023 [January 8th, 2023]
- TikTok owner ByteDance takes first step into virtual reality with ... - December 26th, 2022 [December 26th, 2022]
- Virtual Reality inspires students to think about long-term careers - Turn to 10 - December 21st, 2022 [December 21st, 2022]
- Virtual Reality Arcade with Best VR Game Experiences - Main Event - December 12th, 2022 [December 12th, 2022]
- Virtual Reality - reddit - November 16th, 2022 [November 16th, 2022]
- The Future Of Virtual Reality (VR) - Forbes - November 16th, 2022 [November 16th, 2022]
- Virtual Reality (VR) For Professional Workflows | NVIDIA - October 28th, 2022 [October 28th, 2022]
- Virtual reality in fiction - Wikipedia - October 28th, 2022 [October 28th, 2022]
- Meta will release a new consumer-grade VR headset next year - TechCrunch - October 28th, 2022 [October 28th, 2022]
- Virtual Reality [VR] Market Size & Share | Forecast Report, 2029 - October 25th, 2022 [October 25th, 2022]
- Virtual Reality in the Healthcare Industry - VISUALISE - October 25th, 2022 [October 25th, 2022]
- Virtual Reality vs. Augmented Reality vs. Mixed Reality - Intel - October 25th, 2022 [October 25th, 2022]
- Applications Of Virtual Reality - Virtual Reality Society - October 25th, 2022 [October 25th, 2022]
- The Global Augmented Reality & Virtual Reality In Manufacturing Market size is expected to reach $27.9 billion by 2028, rising at a market growth... - October 25th, 2022 [October 25th, 2022]
- We Met in Virtual Reality Explores the Potential of the Metaverse - Seven Days - October 19th, 2022 [October 19th, 2022]
- What If the Metaverse Is Better Without Virtual Reality? - WIRED - October 19th, 2022 [October 19th, 2022]
- XRHealth and HTC Introduce The First Distraction Therapy Virtual Reality Platform to Improve Patient Experience During Painful or Anxiety Provoking... - October 19th, 2022 [October 19th, 2022]
- Department of Corrections Introduces Virtual Reality Technology to Augment Programming for Incarcerated Parents and Their Children - Pennsylvania... - October 19th, 2022 [October 19th, 2022]
- Arden Bendler Browning conquers virtual reality, Luve More LC + Thinkers Makers Society, and opportunity - theartblog.org - October 19th, 2022 [October 19th, 2022]
- How Virtual or Augmented Reality Can Help Your Packaging Line - Packaging Digest - October 19th, 2022 [October 19th, 2022]
- A marriage of virtual reality and physical therapy: Immergo Labs emerges from its UCSC roots - Lookout Santa Cruz - October 19th, 2022 [October 19th, 2022]
- Senior living residents explore the world through virtual reality - Rocky Mountain PBS - October 19th, 2022 [October 19th, 2022]
- Orthopedic Residency Program and PrecisionOS Team up For Exclusive 3-Year Collaboration: Virtual Reality Development and Curriculum Integration - PR... - October 19th, 2022 [October 19th, 2022]
- 6 Insightful Construction XR Cases to Read in 2022 - XR Today - October 19th, 2022 [October 19th, 2022]
- Video footage emerges from an MMA event that put virtual reality users into the thick of the fighting action - Yahoo News - October 19th, 2022 [October 19th, 2022]
- Carmack: Theres a bunch that Im grumpy about in virtual reality - Ars Technica - October 19th, 2022 [October 19th, 2022]
- The Peripheral Co-Creator on the Shows Line Between Reality & Virtual Reality - TV Insider - October 19th, 2022 [October 19th, 2022]
- Clarkson's Dr. Dana Barry Gave a Presentation at International Conference in Italy - Clarkson University News - October 19th, 2022 [October 19th, 2022]
- Apple VR glove with finger- and hand-tracking patent hints at companion accessories for the "Reality Pro" headset - Notebookcheck.net - October 19th, 2022 [October 19th, 2022]
- Virtual reality spectacle of 2010 sockeye run returns to Shuswap Salmon Arm Observer - Salmon Arm Observer - October 19th, 2022 [October 19th, 2022]
- The virtual reality push brings together Microsoft, Meta and the art of war - Stuff - October 19th, 2022 [October 19th, 2022]
- What Is Virtual Reality All About? - Oculus VR - September 20th, 2022 [September 20th, 2022]
- What Is Virtual Reality? | Tech & Learning - September 20th, 2022 [September 20th, 2022]
- 10 Advantages And Disadvantages Of Virtual Reality (2022) - September 20th, 2022 [September 20th, 2022]
- Insights on the Tactile Virtual Reality Global Market Research Report to 2027 - Growing Advancements in Virtual Reality Products & Rising... - September 20th, 2022 [September 20th, 2022]