A gestural user interface allows users to interact with a device through hand or body movements instead of traditional hardware methods like touchscreens, buttons, or mice. Gestural interfaces are designed to feel so intuitive, that they are almost ‘invisible’ to the user. Gestures can increase accessibility and productivity for the user, by allowing hands free operation of devices.
The objective of this project is to produce a gestural language for the video control portion of Netflix iPad app. Using an onboarding sequence, the design will introduce and teach this gestural language to users within the relevant context. The project's focus is on designing effective signifiers and echo and semantic feedback mechanisms for an interactive system.
"Smoke and mirrors" prototyping demonstrates the concept and user flow, providing a visual representation of the end product, even though the technical functionality is not fully implemented. This project included Wizard of Oz prototypes executed through animations done using Figma and Adobe After Effects.
Gestural interface for Netflix can be a useful hands free option for when users multi task, such as eating while watching or relaxing while watching. For the viewers eye comfort screens are usually kept at an arms length distance while watching, which is why gestures can be useful so they perform video controls without having to change their comfortable position.
<aside> 💡 The user will encounter the onboarding sequence when using this feature for the first time. The onboarding elements include a video demonstration of the hand performing the gesture, and a text description. This approach is chosen because icons alone might be difficult for the user to understand in a 3D context. The onboarding process also provides instructions regarding the post-onboarding interface appearance- by pointing out where to find the echo/semantic feedback and what the icons associated with specific actions look like.
</aside>
Pause: Raise palm to screen for about 2 seconds to pause the video at any time.
Play: Close fingers into a fist and place your thumb on top, towards the screen to play the video.
Rewind: Move thumb to the left