Journal article
Path Modeling of Visual Attention, User Perceptions, and Behavior Change Intentions in Conversations With Embodied Agents in VR
Computer animation and virtual worlds, v 36(3), e70028
May 2025
Abstract
ABSTRACT
This study examines how subtitles and image visualizations influence gaze behavior, working alliance, and behavior change intentions in virtual health conversations with ECAs. Visualizations refer to images on a 3D model TV and text on a virtual whiteboard, both reinforcing key content conveyed by the ECA. Using a 2 ×$$ \times $$ 2 factorial design, participants were randomly assigned to one of four conditions: no subtitles or visualizations (Control), subtitles only (SUB), visualizations only (VIS), or both subtitles and visualizations (VISSUB). Structural equation path modeling showed that SUB and VIS individually reduced gaze toward the ECA, whereas VISSUB moderated this reduction, resulting in less gaze loss than the sum of either condition alone. Gaze behavior was positively associated with working alliance, and perceptions of enjoyment and appropriateness influenced engagement, which in turn predicted behavior change intentions. VIS was negatively associated with behavior change intentions, suggesting that excessive visual input may introduce cognitive trade‐offs.
This study investigates how multimodal design features like subtitles and visualizations affect user attention, perceptions, gaze behavior and motivation in virtual health conversations with Embodied Conversational Agents (ECAs). Conducted in immersive VR, participants interacted with a virtual health coach delivering guidance on healthy eating. Results from path modeling revealed that visual attention to the ECA was linked to stronger working alliance and behavior change intentions, while excessive visual input introduced trade‐offs in engagement and persuasion.
Metrics
2 Record Views
Details
- Title
- Path Modeling of Visual Attention, User Perceptions, and Behavior Change Intentions in Conversations With Embodied Agents in VR
- Creators
- Sagar A. Vankit (Corresponding Author) - Clemson UniversityVivian Genaro Motti - George Mason UniversityTiffany D. Do - Drexel UniversitySamaneh Zamanifard - Clemson UniversityDeyrel Diaz - Clemson UniversityAndrew T. Duchowski - Clemson UniversityBart P. Knijnenburg - Clemson UniversityMatias Volonte - Clemson University
- Publication Details
- Computer animation and virtual worlds, v 36(3), e70028
- Publisher
- Wiley
- Number of pages
- 10
- Resource Type
- Journal article
- Language
- English
- Academic Unit
- Computer Science (Computing)
- Web of Science ID
- WOS:001512330400001
- Scopus ID
- 2-s2.0-105008740514
- Other Identifier
- 991022060153704721
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Collaboration types
- Domestic collaboration
- Web of Science research areas
- Computer Science, Software Engineering