Chatbot with Touch and Graphics
At a glance
- What
- An interaction technique (TwG) that carries emotion and turn-taking to a chatbot through touch.
- Why
- Chatbots have been treated in terms of natural language processing for text conversation, leaving little means to convey a user's emotion or manage whose turn it is.
- How
- Users send emotion and hand over the turn by touching a graphic interface; a Wizard of Oz study evaluated the resulting experience.
- New
- Emotional expression improved over conventional text-only chatbot interaction, and turn-taking became more natural.
What was built
A chatbot interface that carries emotion and conversational turn through the fingertips rather than through words. Touching a graphic element on screen is the emotional utterance, and the same gesture hands the turn back — splitting apart the two jobs a single text field had been doing at once.
A Wizard of Oz apparatus was built alongside it for evaluation: replies appear automatic to the participant but are supplied by a human behind the screen, so natural-language-processing quality never leaks into the interaction measurements.
Presentations & Awards
- DGIST UGRP group research showcase — DGIST UGRP Excellence Prize
- CHI Workshop at "CUI@CHI: Mapping Grand Challenges for the Conversational User Interface Community" (2020)
- ACM CUI Posters & Demos — a presentation separate from the CUI@CHI workshop.