Editors Note: Valve has started shipping the prototypeKnuckles controllersto select VR developers in limited quantities. UploadVR hasnt gotten its hands on a pair just yet, so weve reached out to the development community to see what they think. This article is a contribution from Denny Unger, Co-Founder, CEO, and Creative Director of Cloudhead Games, the studio behind The Gallery: Episode 1 The Call of the Starseed and Episode 2 Heart of the Emberstone.
User interfaces in virtual reality start with your hands. We know that now with the Oculus Touch and the HTC Vive, but even when VR was simply a screen strapped to your head many felt that hands were the future. We began to develop The Gallery on the first Oculus devkit with the Razer Hydra (a Sixense technology) to deliver surrogate hand tracking and body presence back in 2013. And when Valve invited Cloudhead and the first wave of developers to see what would eventually be known as the Vive, Valve showed a commitment to that same vision. Now Valve has invited us and a new wave of developers to begin working with their latest prototypethe SteamVR Knuckles, a wearable VR controller that tracks not just your hand, but each finger too.
Back in 2014, we didnt realize exactly how accurate SteamVR tracking wasthe whole notion of roomscale VR was almost incomprehensible. Up until that point, there was still some motion latency in VR, so you never felt completely attached to the actions in your hands. But once the SteamVR Lighthouses started tracking objects in a 3D space, it was a deep and immediate connection of, Holy crap, thats actually my hand in VR.
Our goal then was to deliver an experience where the player doesnt have to think about the controller, and has only natural, gestural interactions. We wanted to demonstrate why this kind of inputyour hands themselveswas meaningful. When we received our first Vive devkit (wired at the time) we were taping them to our hands in order to feel more immersed, and we even spoke to Valve about crude ways they could strap the controller on.
Those early Vive prototypes already showed an incredible level of fidelity, capable of measuring the tiniest fraction of a movement. Its like the Moores Law of motion control; each incremental improvement in tracking brings with it new possibilities. So as soon as you have that kind of fidelity with your hands in VR, you need your fingers to be more purely represented. And thats what the Oculus Touch started to do by bringing capacitive, gestural input to the controller.
Where Touch differs from what the Knuckles offer, however, is that youre still pushing a binary button in the end; Touch feels more grounded in traditional gamepad design. Specifically, you always feel like youre holding something with buttonsand that works perfectly for gun games and sword games. But the Knuckles take that further by removing the abstractions of first-gen VR inputs. Even though it looks like a more complicated device, its actually a much simpler one.
With the Knuckles, youre not holding a controller; it simply straps to your hand and rests in your palm. If you relax your hand into a natural flex, the controller stays put and keeps tracking your fingers. If you reach out to grab an object in VR, your hand wraps around the base of the controller, giving a tangible feeling of grabbing something. That physicality is something you dont get from data gloves, or vision based inputs without any device, and that feeling can then be fine-tuned with haptic feedback. Plus, youre not passing around a sweaty data glove between your friends.
When reaching out to an object with the Knuckles, Im not thinking about the controller Im holding in my hand, because Im not holding one. Im not thinking about how to use my fingers either, because theyre not assigned to a button press. Im not even thinking about my hand, and thats where the magic comes inIm just thinking about grabbing the object, as I would in real life. That entire grasping motion is represented in VR, whether I pinch with two fingers, scoop with my hand, or close my fist around it. The Knuckles track your fingers by the distance they are from the base of the controller (your palm), and represent that movement in VR. Its second nature.
As developers, when we receive prototype hardware like the SteamVR Knuckles, it makes us want to push the capabilities. In the past, thats meant radically rethinking our stack of interactions and locomotion systemsvirtually redesigning the game. Weve written about what these kinds of changes have meant for The Gallery in the past, but the long story short is that new controllers like the Knuckles arent just affecting the complexity of interactions. We now have new possibilities for game mechanics and design that havent and couldnt have been done before. Its to be seen how these controllers will impact Heart of the Emberstone in September, but theyll be a core focus in designing Episode 3.
Think of an interface-heavy app like Tilt Brush. Dials can be intuitive, but using your fingers is organic. Theres a possibility for gestural movements to call functions and navigate dense data; there could be an entire language built out of using your hands to manipulate paint brushes and pencils and sizes and colors. Once you take the mental load of an interface off the playeronce they stop thinking about the controlleryou can leverage that partition into experiential design and organic controls.
The kind of technology that the SteamVR Knuckles offer is not just impactful to the future of input in gaming, but also the future of output. I can go to a social VR space and point to something, or offer a peace sign, or tell somebody to hang loose without having to think about it. The controller doesnt guess your gesture, or snap to a new position, it represents your fingers based on the distance it calculates. The more natural and intuitive the interface, the less we think about hardware. And the less we fixate on hardware, the more present we can be in VR.
Prior to the Knuckles, hardware developers were looking for something that would be more broadly accepted by the general public. Something that resembled a Wiimote, like the Vive wands, or something that when put together resembled a gamepad, like the Touch controllers, meant that VR input was familiar. Strapping an alien device to your hand in first-gen VR would have been too much too fast. But I think it took the evolution of those two controllers to get VR to the point where the public could be comfortable with the idea of a controller strapped to your hand.
There are so many moments in life in which using your hands is a vital part of the experience. There are implications for education and communicationwith audiences who dont generally understand videogame controllersbecause the SteamVR Knuckles open the door to that broader audience. These are pick-up-and-play controllers where you dont have to think about the input, you just reach out and interact in virtual space.
User interface in virtual reality starts with your hands. And once users are empowered in that way, and dont have to be told how to use the technology, the next generation of virtual reality is here.
This is a guest post not produced by the UploadVR staff. Its a contribution submitted by Denny Unger, theCo-Founder, CEO, and Creative Director of Cloudhead Games.No compensation was exchanged for the creation of this content.
Tagged with: Knuckles, prototype, valve
See the original post:
Hands-On With Valve's Knuckles Prototype Controllers - UploadVR
- Mind uploading - 01 - November 8th, 2009 [November 8th, 2009]
- Mind uploading - 02 - November 8th, 2009 [November 8th, 2009]
- A new way to battle Mexican drug cartels - KLTV - March 8th, 2010 [March 8th, 2010]
- Mobile Health Screening Units Visit Lowe's Workers - International Supermarket News - March 8th, 2010 [March 8th, 2010]
- The quintessential sewing machine - Business Mirror - March 8th, 2010 [March 8th, 2010]
- The Future of Windows - Technologizer (blog) - March 8th, 2010 [March 8th, 2010]
- SEO Press Release Distribution Site Online PR News Celebrates 10000 Active Users - Online PR News (press release) - March 8th, 2010 [March 8th, 2010]
- Utilizing Online Mailing Services – Make the Most of Direct Marketing - RisMedia.com (press release) - March 8th, 2010 [March 8th, 2010]
- Carr's first look at 'Extreme' home - KLTV - March 8th, 2010 [March 8th, 2010]
- Should you advertise on iPhones? - Smart Company (blog) - March 8th, 2010 [March 8th, 2010]
- Review: Mega Man 10 - Destructoid - March 8th, 2010 [March 8th, 2010]
- Had I World Enough, and Time - Institute for Ethics and Emerging Technologies - March 8th, 2010 [March 8th, 2010]
- Unicast Continues Innovative Technology Enhancements With Latest Release of ... - CNNMoney.com (press release) - March 16th, 2010 [March 16th, 2010]
- Facebook scouts for 'passionate' India head - Economic Times - March 16th, 2010 [March 16th, 2010]
- SXSW: YouTube Launches Partner Program for Indie Bands - Wired News - March 17th, 2010 [March 17th, 2010]
- Wider Still and Wider! - Bangkok Post - March 17th, 2010 [March 17th, 2010]
- P2P Versus The World - Rampage - March 17th, 2010 [March 17th, 2010]
- Yakuza 3 - The MMOMFG Review - MMOMFG (blog) - March 17th, 2010 [March 17th, 2010]
- Behind the musings: The annotated high schools column - Chicago Tribune (blog) - March 17th, 2010 [March 17th, 2010]
- Jihad Jane, YouTube, and Me - David Horowitz's NewsReal Blog (blog) - March 17th, 2010 [March 17th, 2010]
- Justin Bieber Releases 'U Smile,' Announces Summer Tour Dates - MTV.com - March 17th, 2010 [March 17th, 2010]
- FCC announces National Broadband Plan - VentureBeat - March 17th, 2010 [March 17th, 2010]
- Image hosting on the cheap: a look at three free services - Ars Technica - March 17th, 2010 [March 17th, 2010]
- Content Management: Secrets of the Trade - Formtek Blog (blog) - March 17th, 2010 [March 17th, 2010]
- FCC's National Broadband Plan: There is a dark side - ZDNet - March 17th, 2010 [March 17th, 2010]
- 5 Reasons Old Media Should Buy Facebook - AllFacebook (blog) - March 17th, 2010 [March 17th, 2010]
- "Steal It" and Other Internal YouTube Emails from Viacom's Copyright Suit - Fast Company - March 19th, 2010 [March 19th, 2010]
- Now cafes in monument premises for tourists during CWG - Sify - March 19th, 2010 [March 19th, 2010]
- Google-Viacom court papers leave a lot to the imagination - FierceOnlineVideo - March 19th, 2010 [March 19th, 2010]
- FCC's broadband plan: A possible dream - Washington Post (blog) - March 19th, 2010 [March 19th, 2010]
- The Importance of Using Social Networking for Business; Part I – Facebook - IPWatchdog.com - March 19th, 2010 [March 19th, 2010]
- Recording YouTube Videos - Acoustic Guitar - March 19th, 2010 [March 19th, 2010]
- Who's using location-based social networking? - KC Free Press - March 20th, 2010 [March 20th, 2010]
- iPhone will continue to beckon BlackBerry owners - CNET - March 20th, 2010 [March 20th, 2010]
- Rain leaves its mark on Azalea Trail events - KLTV - March 21st, 2010 [March 21st, 2010]
- Viacom v. YouTube/Google: A Piracy Case in Their Own Words - DailyFinance - March 21st, 2010 [March 21st, 2010]
- Getting a look at next high-tech | Philadelphia Inquirer | 03/22/2010 - Philadelphia Inquirer - March 22nd, 2010 [March 22nd, 2010]
- Sprint chews on Apple while lauding 4G Overdrive hotspot - The Tech Herald - March 22nd, 2010 [March 22nd, 2010]
- 'Repo Men' contest -- the nationwide chase is almost over - Los Angeles Times (blog) - March 22nd, 2010 [March 22nd, 2010]
- Viacom vs. YouTube/Google: A Piracy Case in Their Own Words - DailyFinance - March 22nd, 2010 [March 22nd, 2010]
- These iPhone apps will help make March Madness a little more sane - Appolicious - March 22nd, 2010 [March 22nd, 2010]
- Eye-Fi Pro X2 cards have arrived, and you probably want one - tuaw.com (blog) - March 23rd, 2010 [March 23rd, 2010]
- Pharmacist shows who wins, loses with health care bill - KLTV - March 23rd, 2010 [March 23rd, 2010]
- High-Tech Texts! - The Campus Slate - March 24th, 2010 [March 24th, 2010]
- CTIA WIRELESS 2010: Samsung's New Galaxy Brings 4" AMOLED Screen, Social Hub ... - Marketnews.ca - March 24th, 2010 [March 24th, 2010]
- Google must follow Chinese rules or leave - China Daily - March 24th, 2010 [March 24th, 2010]
- Jay-Z Short Documentary 'NY-Z' Premieres Online - MTV.com - March 24th, 2010 [March 24th, 2010]
- DAs clash over Mineola sex ring appeal - KLTV - March 25th, 2010 [March 25th, 2010]
- iSilo for iPhone - BusinessWeek - March 26th, 2010 [March 26th, 2010]
- Questions Abound as "New START" Agreement is Completed - Global Security Newswire - March 26th, 2010 [March 26th, 2010]
- What will Apple do next in mobile services? - Mobile Entertainment - March 26th, 2010 [March 26th, 2010]
- How much is too much to pay for health care? - Anchorage Daily News - March 27th, 2010 [March 27th, 2010]
- The Future of Smartphones: 4G and Beyond - Entrepreneur - March 27th, 2010 [March 27th, 2010]
- Uploading and uplifting: sharing big data files - Earthtimes (press release) - March 28th, 2010 [March 28th, 2010]
- Verizon Blasts 'Outdated' FCC Broadband Plan - NewsFactor Network - March 28th, 2010 [March 28th, 2010]
- Web Host Layered Tech Offers Mezeo-Powered Cloud Storage - Web Host Industry Review - March 29th, 2010 [March 29th, 2010]
- Dropbox: Now one more reason to want a Nexus One - ZDNet (blog) - March 30th, 2010 [March 30th, 2010]
- Exaflood: Politicians Prop Up Dinosaurs, Ignore Cutting Edge Technology - NewsBlaze (press release) - March 30th, 2010 [March 30th, 2010]
- Instructions - Washington Post - March 30th, 2010 [March 30th, 2010]
- Uploading for Life Extension Will Be Valid - Institute for Ethics and Emerging Technologies - March 31st, 2010 [March 31st, 2010]
- 'Glee's' MySpace Auditions: What Not To Sing - Wall Street Journal (blog) - March 31st, 2010 [March 31st, 2010]
- Memeo iPad Reader: Like the GDrive on your iPad (only different) - ZDNet (blog) - April 1st, 2010 [April 1st, 2010]
- Why are pipe bomb 'how to' videos legal? Answer is alarming - KLTV - April 1st, 2010 [April 1st, 2010]
- Trip to Haiti inspiration for East Texas teen - KLTV - April 1st, 2010 [April 1st, 2010]
- Jason Kilar Leads Hulu To Profitability, But Will He Stay On At Hulu? - TVbytheNumbers - April 2nd, 2010 [April 2nd, 2010]
- Layers for IPad Adds Online Gallery, Pro Options - PC World - April 2nd, 2010 [April 2nd, 2010]
- Shane Dawson, YouTube's Comic for the Under-30 Set - New York Times - April 2nd, 2010 [April 2nd, 2010]
- Hands-On With the Apple iPad — and Your Questions - Wired News - April 4th, 2010 [April 4th, 2010]
- FedEx Simplifies International Shipping with FedEx Electronic Trade Documents - MarketWatch (press release) - April 6th, 2010 [April 6th, 2010]
- Cacoo Lets Multiple Users Create Designs Collaboratively And In Real-time - TechCrunch (blog) - April 7th, 2010 [April 7th, 2010]
- Comcast: Your New Overlord - ITworld.com - April 7th, 2010 [April 7th, 2010]
- Bloggers Photograph Food, We Get Hungry - Switched (blog) - April 7th, 2010 [April 7th, 2010]
- Apple suggests only the iPhone can fingerprint songs - Geek.com - April 7th, 2010 [April 7th, 2010]
- Senior with mental challenges killed along highway - KLTV - April 7th, 2010 [April 7th, 2010]
- Book a Cruise and "Flip" Over a Free Camcorder - CruiseCritic.co.uk - April 8th, 2010 [April 8th, 2010]
- Creation Myths: what the argument that the iPad's not for creating content ... - Huffington Post (blog) - April 8th, 2010 [April 8th, 2010]
- Want market share? Make a brain claim - Marketing Web - April 8th, 2010 [April 8th, 2010]
- 10 Ways World of Warcraft - OUPblog (blog) - April 8th, 2010 [April 8th, 2010]
- Check-in to Foursquare: Latest social media service lands in SW Florida - Naples Daily News - April 8th, 2010 [April 8th, 2010]
- Apple iPhone OS 4 Announcement Makes Users Feel "Finally!" - HULIQ - April 8th, 2010 [April 8th, 2010]