English
Related papers

Related papers: Test2VA: Reusing GUI Test Cases for Voice Assistan…

200 papers

Nowadays, mobile applications are essential tools for everyday life, providing users with anytime, anywhere access to up-to-date information, communication, and entertainment. Needless to say, hardware limitations and the diverse needs of…

Human-Computer Interaction · Computer Science 2025-09-29 Pawel Weichbroth , Tomasz Szot

Conventional Voice Assistants (VAs) rely on traditional language models to discern user intent and respond to their queries, leading to interactions that often lack a broader contextual understanding, an area in which Large Language Models…

Human-Computer Interaction · Computer Science 2024-12-02 Amama Mahmood , Junxiang Wang , Bingsheng Yao , Dakuo Wang , Chien-Ming Huang

Virtual assistants have the potential to play an important role in helping users achieves different tasks. However, these systems face challenges in their real-world usability, characterized by inefficiency and struggles in grasping user…

Human-Computer Interaction · Computer Science 2024-08-15 Minh Duc Vu , Han Wang , Zhuang Li , Jieshan Chen , Shengdong Zhao , Zhenchang Xing , Chunyang Chen

Voice Assistants (VA) such as Amazon Alexa and Google Assistant are quickly and seamlessly integrating into people's daily lives. The increased reliance on VA services raises privacy concerns such as the leakage of private conversations and…

Cryptography and Security · Computer Science 2020-07-30 Song Liao , Christin Wilson , Long Cheng , Hongxin Hu , Huixing Deng

UI testing is tedious and time-consuming due to the manual effort required. Recent research has explored opportunities for reusing existing UI tests from an app to automatically generate new tests for other apps. However, the evaluation of…

Software Engineering · Computer Science 2020-11-04 Yixue Zhao , Justin Chen , Adriana Sejfia , Marcelo Schmitt Laser , Jie Zhang , Federica Sarro , Mark Harman , Nenad Medvidovic

As voice assistants (VAs) become increasingly integrated into daily life, the need for emotion-aware systems that can recognize and respond appropriately to user emotions has grown. While significant progress has been made in speech emotion…

Human-Computer Interaction · Computer Science 2025-02-24 Yong Ma , Yuchong Zhang , Di Fu , Stephanie Zubicueta Portales , Danica Kragic , Morten Fjeld

Currently, adaptive voice applications supported by voice assistants (VA) are very popular (i.e., Alexa skills and Google Home Actions). Under this circumstance, how to design and evaluate these voice interactions well is very important. In…

Human-Computer Interaction · Computer Science 2019-06-05 Xu Han , Tom Yeh

Our work addresses the challenges older adults face with commercial Voice Assistants (VAs), notably in conversation breakdowns and error handling. Traditional methods of collecting user experiences-usage logs and post-hoc interviews-do not…

Human-Computer Interaction · Computer Science 2024-09-25 Amama Mahmood , Junxiang Wang , Chien-Ming Huang

Voice assistants (VAs) are typically evaluated through task performance metrics and self-report questionnaires, but people's voices themselves carry rich paralinguistic cues that reveal affect, effort, and interaction breakdowns. We present…

Human-Computer Interaction · Computer Science 2026-03-23 Yong Ma , Xuesong Zhang , Xuedong Zhang , Natalia Bartłomiejczyk , Seungwoo Je , Adrian Holzer , Morten Fjeld , Andreas Butz

Growth of software size, lack of resources to perform regression testing, and failure to detect bugs faster have seen increased reliance on continuous integration and test automation. Even with greater hardware and software resources…

Software Engineering · Computer Science 2018-02-13 Eduard Enoiu , Mirgita Frasheri

Autonomous GUI agents interact with environments by perceiving interfaces and executing actions. As a virtual sandbox, the GUI World model empowers agents with human-like foresight by enabling action-conditioned prediction. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yuhao Zheng , Li'an Zhong , Yi Wang , Rui Dai , Kaikui Liu , Xiangxiang Chu , Linyuan Lv , Philip Torr , Kevin Qinghong Lin

On-device virtual assistants like Siri and Google Assistant are increasingly pivotal, yet their capabilities are hamstrung by a reliance on rigid, developer-dependent APIs. GUI agents offer a powerful, API-independent alternative, but their…

Artificial Intelligence · Computer Science 2025-10-22 Ho Fai Leung , Xiaoyan Xi , Fei Zuo

Recent advances in vision-language models have enabled mobile GUI agents to perceive visual interfaces and execute user instructions, but reliable prediction of action consequences remains critical for long-horizon and high-risk…

Artificial Intelligence · Computer Science 2026-05-25 Weikai Xu , Kun Huang , Yunren Feng , Jiaxing Li , Yuhan Chen , Yuxuan Liu , Zhizheng Jiang , Heng Qu , Pengzhi Gao , Wei Liu , Jian Luan , Xiaolin Hu , Bo An

Despite huge gains in performance in natural language understanding via large language models in recent years, voice assistants still often fail to meet user expectations. In this study, we conducted a mixed-methods analysis of how voice…

Human-Computer Interaction · Computer Science 2023-03-06 Amanda Baughan , Allison Mercurio , Ariel Liu , Xuezhi Wang , Jilin Chen , Xiao Ma

Nowadays, web services play a major role in the development of enterprise applications. Many such applications are now developed using a service-oriented architecture (SOA), where microservices is one of its most popular kind. A RESTful web…

Software Engineering · Computer Science 2019-01-08 Andrea Arcuri

Testbed sharing, a practice in which different researchers concurrently develop independent use cases on top of the same testbed, is ubiquitous in wireless experimental research. Its key drawback is experimental inconvenience: one must…

Networking and Internet Architecture · Computer Science 2025-09-03 Chang Liu , T. D. Khoa Le , Rahul Saini , Kishor C. Joshi , George Exarchakos

WebView is a UI widget that helps integrate web applications into the native context of Android apps. It provides powerful mechanisms for bi-directional interactions between the native-end (Java) and the web-end (JavaScript) of an Android…

Software Engineering · Computer Science 2023-06-07 Jiajun Hu , Lili Wei , Yepang Liu , Shing-Chi Cheung

Affective speech analysis is an ongoing topic of research. A relatively new problem in this field is the analysis of vocal bursts, which are nonverbal vocalisations such as laughs or sighs. Current state-of-the-art approaches to address…

Sound · Computer Science 2022-09-29 Tobias Hallmen , Silvan Mertes , Dominik Schiller , Elisabeth André

With the emergence of deep learning techniques, smartphone apps are now embedded on-device AI features for enabling advanced tasks like speech translation, to attract users and increase market competitiveness. A good interaction design is…

Human-Computer Interaction · Computer Science 2023-07-04 Jason Ching Yuen Siu , Jieshan Chen , Yujin Huang , Zhenchang Xing , Chunyang Chen

Virtual Reality (VR) is an emerging technique that provides a unique real-time experience for users. VR technologies have provided revolutionary user experiences in various scenarios (e.g., training, education, product/architecture design,…

Software Engineering · Computer Science 2022-11-04 Dhia Elhaq Rzig , Nafees Iqbal , Isabella Attisano , Xue Qin , Foyzul Hassan