The Hololens uses a natural user interface that allows you to use your voice, hand gestures and gaze to interact with holograms and applications.
You can access Cortana, the Hololens virtual assistant at any time by saying "Hey Cortana". Cortana can take photos, record video or open and close applications.
Your gaze is represented by a white dot in the center of your field of view and is used whenever an accurate interaction is required (such as closing a window or 'clicking' on an object. Microsoft calls this interaction Gaze-and-Commit. You can imagine your gaze as being a bit like a holographic mouse pointer that is controlled by moving and tilting your head.
You can also interact with holograms and applications using hand gestures. You can practice these gestures by launching the Learn Gestures app from the windows home screen.
Fologram works with 5 different gesture events: Bloom, Ready, Tap, Hold and Drag.
Some important things to remember about gestures:
- The Hololens will track your hand within the "Gesture Frame" - anywhere within the on-board camera's field of view (fov). For reliable detection of gestures it is best to hold your hand in front of the device.
- Gestures are detected by the short range depth camera on the HoloLens. The Hololens uses the silhouette of your hand to detect gestures. It cannot see fingers obscured by your hand!
- The position of your hand is not accurate and is rarely used for directly interacting with holograms (e.g. grabbing and moving a hologram). Gaze is usually used for precise interaction.
- It can be easy to trigger the 'Bloom' gesture accidentally by opening a hand within the Gesture Frame. If you find that you are often exiting the Fologram application unintentionally, it is probably because you are performing an activity that requires frequent use of your hands. Consider trying to perform these activities outside of the gesture frame where possible, or be careful not to make silhouettes that look like a 'Bloom'.