ProjectedAssistant
- What
- A system that throws a voice assistant's graphical interface onto a wall or desk with a projector.
- Why
- A voice-only assistant has no way to hand over a list or a table, and a fixed screen only works if you walk to it.
- How
- Kinect v2 finds the person and the surface, Arduino PWM steers the projector, and the display lands where it can be seen. Built in WPF (C#) and evaluated with a Wizard of Oz study and NASA-TLX.
- New
- The display follows the person, so using the assistant is no longer tied to wherever the speaker sits.
Abstract
Our implementation scenario has a room-scale face tracker and a projection display.
Spatial dependency of visual interface can degrade the advantage of voice commands.
Voice command of virtual assistance can be utilized whether the user can see the device or not. However, this advantage may get degraded by the spatial dependency of its visual interface based on how the display is placed from its user. Therefore, we suggest a graphic display of a virtual assistant with an adaptable screen projection. Our graphic display showed a 26% shorter task time comparing to the fixed laptop display. Our display also showed 2.7 times lower physical demands and 1.45 times lower mental demand from the NASA TLX questionnaire.