On Tuesday, Patently Apple posted a granted patent report titled "Apple wins Patent for a unique lighting system designed to assist a user's eyes adjust from a bright environment to a dark VR Headset" and vice versa. The original title of the patent was " Electronic device with adaptive lighting system." The image below is from Apple's granted patent.
Today the US Patent & Trademark Office published a patent application from Apple that relates to adaptive displays for head-mounted devices, that shares the same foundation as the patent granted to Apple on Tuesday. The title of this patent is close but different: " Electronic Device with Adaptive Display." The focus in this patent is on the adaptive display and not necessarily the lighting system.
Apple's introduction of the patent is the same presented in the granted patent as follows:
"Head-mounted devices such as virtual reality glasses and augmented reality glasses use displays to generate images to a user.
If care is not taken, a head-mounted device may be cumbersome and tiring to wear. The images on the display may appear too dark and washed out when the user first puts the head-mounted device on his or her head. The user may experience dazzle or discomfort when transitioning out of a virtual reality viewing experience. The dynamic range of a head-mounted display may be perceived as insufficient depending on the adaptation state of the user's eyes."
Apple's latest patent application covers control circuitry in an electronic device that may estimate a brightness adaptation state of the user that is wearing the electronic device. The control circuitry may adjust a brightness of the display based on the user's adaptation state. This may include, for example, optimizing a brightness range of the display for the current adaptation state of the user, adjusting a brightness range of the display to have a desired effect on the user's adaptation state (e.g., to help "guide" the user's current adaptation state to a different adaptation state), adjusting a brightness range at certain periods of time to boost the perceived dynamic range of the display, adjusting brightness in some regions of an image differently than in other regions of an image to account for the user's adaptation state, and/or taking other actions based on the estimated adaptation state of the user.
The control circuitry may gather ambient light information from an ambient light sensor, may gather physiological attributes of a user such as blink rate, pupil size, and eye openness from a camera, and may gather gaze position information from gaze detection circuitry. Gaze position may be combined with image data (e.g., frames of display data that are being displayed on the display) to determine the average pixel luminance at a location on the display that aligns with the user's gaze position. Based on this information, the control circuitry may determine a brightness adaptation state of the user.
When a user first turns on the display of the electronic device, the user may be bright-adapted (due to the ambient light in the room where the electronic device is located). The control circuitry may account for this adaptation state by starting at a first brightness level and gradually reducing the brightness of the display to a second brightness level. By the time the second brightness level is reached, the user may be dark-adapted.
When a video ends or a user exits a video playing mode and enters a home screen on the display, the control circuitry may increase the brightness of the display gradually to increase the user's adaptation level. This helps avoid dazzle or discomfort when the user takes off the electronic device and is greeted with a brightly lit room.
The control circuitry may also use adaptation state information to increase the perceived dynamic range of the display and to selectively adjust the brightness of portions of an image based on where the user is looking.
Apple's patent FIG. 1 below is a diagram of an illustrative head-mounted device such as a VR Headset, though smartglasses could apply; FIG. 3 is a diagram showing how a tone mapping circuitry may use information about a user's adaptation state to implement content-luminance-to-display-luminance mappings.
Apple's patent FIG. 6 below is a graph showing how a display may temporarily be optimized for an adaptation state that is different from that of the user's to gradually increase the user's adaptation level before the user transitions out of a virtual reality experience; FIG. 7 is a graph showing how the brightness of a display may be adjusted before and after a large brightness increase to enhance the perceived dynamic range of the display.
Apple's patent FIG. 9 above is a flow chart of illustrative operations involved in using a head-mounted device with a display.
Tuesday's granted patent and today's patent application (not a continuation patent) are covering the same project from different perspectives. For instance, today's patent adds more emphasis on the display and gaze detection in five patent claims. In Apple's patent claims #2 and #3 below state the following:
(Claim #2): "The electronic device defined in claim 1 further comprising gaze detection circuitry that determines a gaze position, wherein the control circuitry is configured to adjust the brightness of the virtual reality content based on the gaze position."
(Claim #3): "The electronic device defined in claim 2 wherein the control circuitry is configured to determine an average pixel brightness at a location on the display that aligns with the gaze position."
To dig deeper into the details of today's Apple's patent application number 20210134245, click here.
Considering that this is a patent application, the timing of such a product to market is unknown at this time.
Read the original here:
- UNL program using virtual reality to enhance research - KOLN - May 13th, 2024 [May 13th, 2024]
- 3D augmented reality with regular glasses | Stanford News - Stanford University News - May 13th, 2024 [May 13th, 2024]
- LG Display's Research Results on OLEDoS for VR Selected as Distinguished Paper at SID Display Week 2024 - PR Newswire - May 13th, 2024 [May 13th, 2024]
- Full-colour 3D holographic augmented-reality displays with metasurface waveguides - Nature.com - May 13th, 2024 [May 13th, 2024]
- The Future of Onboarding: Inside Serviceplan's VR-Based Employee Integration | LBBOnline - Little Black Book - LBBonline - May 13th, 2024 [May 13th, 2024]
- Virtual reality space experience returns to Silver Street Studios - Houston Chronicle - May 13th, 2024 [May 13th, 2024]
- Rain Technology to Unveil New Anamorphic-XR Optical Engine at Display Week 2024 - Display Daily - May 13th, 2024 [May 13th, 2024]
- Virtual reality used as a tool for brain health at assisted living center - Eyewitness News 3 - May 13th, 2024 [May 13th, 2024]
- Virtual Reality in Gaming Market to Reach US$75 Billion by 2028 - Analytics Insight - May 13th, 2024 [May 13th, 2024]
- Disney+ to release VR Marvel series exclusively for Apple Vision Pro - CyberNews.com - May 13th, 2024 [May 13th, 2024]
- Startup aimed at VR entertainment in cars files for insolvency - PhoneArena - May 13th, 2024 [May 13th, 2024]
- After Decades of Promise, the Virtual Reality Era Has Finally Arrived - Kiplinger's Personal Finance - May 13th, 2024 [May 13th, 2024]
- Hahnville senior signs with virtual reality gaming company - St. Charles Herald Guide - May 13th, 2024 [May 13th, 2024]
- Sandbox VR Forges Franchise Partnership with Apparel Group to Pioneer Virtual Reality in the Middle East - Business Wire - May 13th, 2024 [May 13th, 2024]
- Best VR games in 2024 - TechRadar - May 13th, 2024 [May 13th, 2024]
- Researchers rely on Virtual Reality as a complementary therapy for eating disorders - MIXED Reality News - May 13th, 2024 [May 13th, 2024]
- Beyond therapy: Virtual reality shows promise in fighting depression - Medical Xpress - May 13th, 2024 [May 13th, 2024]
- Apparel Group And Sandbox VR Announce Partnership - Retail & Leisure International - Retail & Leisure International - May 13th, 2024 [May 13th, 2024]
- Batman returns to VR - theSun - May 13th, 2024 [May 13th, 2024]
- Virtual Reality Shows Promise in Treating Depression - Neuroscience News - May 13th, 2024 [May 13th, 2024]
- Augmented And Virtual Reality in Manufacturing Market Size, Share And Growth Analysis For 2024-2033 - EIN News - May 13th, 2024 [May 13th, 2024]
- Sandbox VR Announces U.S. Franchise Initiative and International Deal - Franchise Times - May 13th, 2024 [May 13th, 2024]
- MINI Mixed Reality Experience: Driving into the Future. - BMW Press - May 13th, 2024 [May 13th, 2024]
- Virtual reality project will allow users to witness October 7 first hand - The Jewish Chronicle - May 13th, 2024 [May 13th, 2024]
- Spin Rhythm XD getting PlayStation and VR ports this summer - Niche Gamer - May 13th, 2024 [May 13th, 2024]
- Students at the Hong Kong University of Science and Technology use virtual reality headsets in class - Islander News.com - May 13th, 2024 [May 13th, 2024]
- SFU SIAT researcher uses virtual reality to help teen mental health - Simon Fraser University News - May 13th, 2024 [May 13th, 2024]
- The Navy Brings Training to the Fleet With VR - ATD - May 13th, 2024 [May 13th, 2024]
- Manchester Airport launches gaming area with virtual reality escape room Business Traveller - Business Traveller - May 13th, 2024 [May 13th, 2024]
- Can virtual reality help ease the end of life? - Universit de Montral - May 13th, 2024 [May 13th, 2024]
- Fans still waiting for a virtual reality view of the Buffalo Bills' new ... - Buffalo News - November 28th, 2023 [November 28th, 2023]
- Immerse yourself in new, augmented worlds - University of Miami: News@theU - November 28th, 2023 [November 28th, 2023]
- Who are the leading innovators in vehicle digital twins for the ... - just-auto.com - November 28th, 2023 [November 28th, 2023]
- How Virtual and Augmented Reality Are Redefining Construction - TimesTech - November 28th, 2023 [November 28th, 2023]
- Virtualware Appoints VRARA's John A Cunningham to Advisory Board - XR Today - November 28th, 2023 [November 28th, 2023]
- University Project Aims to Dissolve Borders Between Virtual and ... - XR Today - November 28th, 2023 [November 28th, 2023]
- Are real cadavers better than virtual ones? - Slate - November 28th, 2023 [November 28th, 2023]
- Samsung Glasses could be the name of a new pair of Samsung ... - TechRadar - November 28th, 2023 [November 28th, 2023]
- The Best Augmented Reality Accessories for AR Immersion - XR Today - November 28th, 2023 [November 28th, 2023]
- The best VR apps for 2022 | Digital Trends - February 18th, 2023 [February 18th, 2023]
- What is virtual reality? - TechTarget - February 18th, 2023 [February 18th, 2023]
- Forget the metaverse, Sony's PlayStation VR2 will make you a virtual reality believer again - British GQ - February 18th, 2023 [February 18th, 2023]
- Time to play! New virtual reality gaming coming to Northern Virginia - WUSA9.com - January 31st, 2023 [January 31st, 2023]
- Virtual reality training content launched for footwear and leather sector - The Hindu - January 31st, 2023 [January 31st, 2023]
- Texas A&M researchers are using multisensory virtual reality to help NASA astronauts - KAGSTV.com - January 31st, 2023 [January 31st, 2023]
- Hollywoods Virtual Reality Guru and American Millionaire Expanded His Soccer Portfolio to Europe With a Deal Worth $940 Million - EssentiallySports - January 8th, 2023 [January 8th, 2023]
- TikTok owner ByteDance takes first step into virtual reality with ... - December 26th, 2022 [December 26th, 2022]
- Virtual Reality inspires students to think about long-term careers - Turn to 10 - December 21st, 2022 [December 21st, 2022]
- Virtual Reality Arcade with Best VR Game Experiences - Main Event - December 12th, 2022 [December 12th, 2022]
- Virtual Reality - reddit - November 16th, 2022 [November 16th, 2022]
- The Future Of Virtual Reality (VR) - Forbes - November 16th, 2022 [November 16th, 2022]
- Virtual Reality (VR) For Professional Workflows | NVIDIA - October 28th, 2022 [October 28th, 2022]
- Virtual reality in fiction - Wikipedia - October 28th, 2022 [October 28th, 2022]
- Meta will release a new consumer-grade VR headset next year - TechCrunch - October 28th, 2022 [October 28th, 2022]
- Virtual Reality [VR] Market Size & Share | Forecast Report, 2029 - October 25th, 2022 [October 25th, 2022]
- Virtual Reality in the Healthcare Industry - VISUALISE - October 25th, 2022 [October 25th, 2022]
- Virtual Reality vs. Augmented Reality vs. Mixed Reality - Intel - October 25th, 2022 [October 25th, 2022]
- Applications Of Virtual Reality - Virtual Reality Society - October 25th, 2022 [October 25th, 2022]
- The Global Augmented Reality & Virtual Reality In Manufacturing Market size is expected to reach $27.9 billion by 2028, rising at a market growth... - October 25th, 2022 [October 25th, 2022]
- We Met in Virtual Reality Explores the Potential of the Metaverse - Seven Days - October 19th, 2022 [October 19th, 2022]
- What If the Metaverse Is Better Without Virtual Reality? - WIRED - October 19th, 2022 [October 19th, 2022]
- XRHealth and HTC Introduce The First Distraction Therapy Virtual Reality Platform to Improve Patient Experience During Painful or Anxiety Provoking... - October 19th, 2022 [October 19th, 2022]
- Department of Corrections Introduces Virtual Reality Technology to Augment Programming for Incarcerated Parents and Their Children - Pennsylvania... - October 19th, 2022 [October 19th, 2022]
- Arden Bendler Browning conquers virtual reality, Luve More LC + Thinkers Makers Society, and opportunity - theartblog.org - October 19th, 2022 [October 19th, 2022]
- How Virtual or Augmented Reality Can Help Your Packaging Line - Packaging Digest - October 19th, 2022 [October 19th, 2022]
- A marriage of virtual reality and physical therapy: Immergo Labs emerges from its UCSC roots - Lookout Santa Cruz - October 19th, 2022 [October 19th, 2022]
- Senior living residents explore the world through virtual reality - Rocky Mountain PBS - October 19th, 2022 [October 19th, 2022]
- Orthopedic Residency Program and PrecisionOS Team up For Exclusive 3-Year Collaboration: Virtual Reality Development and Curriculum Integration - PR... - October 19th, 2022 [October 19th, 2022]
- 6 Insightful Construction XR Cases to Read in 2022 - XR Today - October 19th, 2022 [October 19th, 2022]
- Video footage emerges from an MMA event that put virtual reality users into the thick of the fighting action - Yahoo News - October 19th, 2022 [October 19th, 2022]
- Carmack: Theres a bunch that Im grumpy about in virtual reality - Ars Technica - October 19th, 2022 [October 19th, 2022]
- The Peripheral Co-Creator on the Shows Line Between Reality & Virtual Reality - TV Insider - October 19th, 2022 [October 19th, 2022]
- Clarkson's Dr. Dana Barry Gave a Presentation at International Conference in Italy - Clarkson University News - October 19th, 2022 [October 19th, 2022]
- Apple VR glove with finger- and hand-tracking patent hints at companion accessories for the "Reality Pro" headset - Notebookcheck.net - October 19th, 2022 [October 19th, 2022]
- Virtual reality spectacle of 2010 sockeye run returns to Shuswap Salmon Arm Observer - Salmon Arm Observer - October 19th, 2022 [October 19th, 2022]
- The virtual reality push brings together Microsoft, Meta and the art of war - Stuff - October 19th, 2022 [October 19th, 2022]
- What Is Virtual Reality All About? - Oculus VR - September 20th, 2022 [September 20th, 2022]
- What Is Virtual Reality? | Tech & Learning - September 20th, 2022 [September 20th, 2022]
- 10 Advantages And Disadvantages Of Virtual Reality (2022) - September 20th, 2022 [September 20th, 2022]
- Insights on the Tactile Virtual Reality Global Market Research Report to 2027 - Growing Advancements in Virtual Reality Products & Rising... - September 20th, 2022 [September 20th, 2022]