Faze: Tab switching & Window switching with Gaze & Facial gestures


Alternative text - include a link to the PDF!

Related Projects


Creator/Artist: Varun Vikash Karthikeyan

Category: Interaction Design

Document: P1 Project

Batch: 2016-2020

Source: India,   IDC IIT Bombay

Period:  2019-onwards

Medium: Report pdf

Supervisor: Prof. Dr. Michael Kipp


Detailed Description

In an attempt to explore the domain of using the face as a modality for desktop control, in this project, we use gaze input and facial gestures (tilt head, raise eyebrows, lean backwards) for two common desktop control operations: tab switching (within application) and window switching (between application). A working prototype was built using an eye tracker to collect gaze input and a face detection library to detect facial gestures, both connected to a custom-built dummy desktop, and some initial response was taken by showing it to a few people.