I recently had the privilege of experiencing the Microsoft HoloLens firsthand. With much anticipation and excitement, I managed to put the headset on -- but near immediately encountered my first hiccup.
You see, I'd seen numerous videos of the product demonstrated, users being able to reach out their hands and manipulate 3D objects in front of them, create environments in their living room, etc. However, when I had put on the HoloLens for the first time, what I immediately realised was that I had no idea how to interact with the 'screen in front of me'. "How do I select that object?" I asked the gentleman hosting the demo.
AR & VR introduces a new generation of interactivity and content. Along with this it brings the demand of newer, better and more intuitive ways to interact with this medium.
In 2007 (long after it was thought by many that touchscreen technology had well an truely matured), Apple revolutionised the not only the smartphone landscape, but in fact User Interfaces as we know it -- by setting a totally new standard in how users interact with touch screens.
In my opinion the next revolution of 'User Interfaces' won't be just dependant on a single tech such as voice (including NLP), touch, eye-tracking or physical gesture s- but a combination of those, along with AI, to allow us to interact with machines how we want, intuitively. "Spatial Computing" as Robert Scoble calls it. Watch this space.
What we are certain of, is that no matter the input mechanism, communication must be seamless, without delay or interruption. The natural and the realistic go hand in hand with the quality of the experience. Not only will worlds seem more immersive, they will also be less likely to make us puke.