Skip to main navigation Skip to search Skip to main content

UEQManager: A Non-intrusive and Real-time System for Recognizing and Managing UEQ in Multilingual Voice Assistants

  • Entong Gao
  • , Haisu Yuan
  • , Hanyu Zhong
  • , Ruiqing Yuan
  • , Zhe Chen*
  • *Corresponding author for this work
  • Beihang University
  • Peking University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

User experience quality (UEQ) plays a critical role in multilingual intelligent voice assistant (VA), where real-time feedback directly affect interaction experience. However, current UEQ evaluation methods primarily depend on surveys, posing limitations for dynamic and user-centered adaptation. We propose a non-intrusive real-time system, UEQManager, for automated UEQ recognition and management. First, UEQManager incorporate interpretable deep learning models to predict UEQ in seven subdimensions. Second, leveraging LLM and expert focus group, we design adaptive interaction interface based on recognized UEQ states. Third, we implement integration system capable of real-time, non-intrusive UEQ recognition and management. We validate the effectiveness of UEQManager through a user testing experiment. Results reveal that UEQManager significantly outperformed baseline, yielding an average UEQ improvement of 27.29% over baseline and demonstrating statistical significance across all subdimensions. This work contributes a proof of concept HCI system that translates webcam gaze cues into adaptive design decisions for multilingual VAs and illustrates how designers can couple interpretable sensing with proactive interaction design.

Original languageEnglish
Title of host publicationCHI 2026 - Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
EditorsNuria Oliver, David A. Shamma, Heloisa Candello, Pablo Cesar, Pedro Lopes, Alessandro Bozzon, Thomas Kosch, Vera Liao, Xiaojuan Ma, Valentino Artizzu, Fiona Draxler, Gustavo Lopez, Anke V. Reinschluessel, Xin Tong, Phoebe O. Toups Dugas
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400722783
DOIs
StatePublished - 13 Apr 2026
Externally publishedYes
Event2026 CHI Conference on Human Factors in Computing Systems, CHI 2026 - Barcelona, Spain
Duration: 13 Apr 202617 Apr 2026

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2026 CHI Conference on Human Factors in Computing Systems, CHI 2026
Country/TerritorySpain
CityBarcelona
Period13/04/2617/04/26

Keywords

  • Adaptive Interface
  • Automated Recognition
  • Human-Centered AI
  • Real-time System
  • User Experience Quality
  • Voice Assistant

Fingerprint

Dive into the research topics of 'UEQManager: A Non-intrusive and Real-time System for Recognizing and Managing UEQ in Multilingual Voice Assistants'. Together they form a unique fingerprint.

Cite this