English
Related papers

Related papers: Talking Spell: A Wearable System Enabling Real-Tim…

200 papers

In this paper, we present a methodology for the development of embodied conversational agents for social virtual worlds. The agents provide multimodal communication with their users in which speech interaction is included. Our proposal…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-29 D. Griol , A. Sanchis , J. M. Molina , Z. Callejas

Physically assistive robots in home environments can enhance the autonomy of individuals with impairments, allowing them to regain the ability to conduct self-care and household tasks. Individuals with physical limitations may find existing…

Robotics · Computer Science 2025-02-11 Akhil Padmanabha , Carmel Majidi , Zackory Erickson

The dialogue experience with conversational agents can be greatly enhanced with multimodal and immersive interactions in virtual reality. In this work, we present an open-source architecture with the goal of simplifying the development of…

Artificial Intelligence · Computer Science 2023-08-08 Michele Yin , Gabriel Roccabruna , Abhinav Azad , Giuseppe Riccardi

Virtual Personal Assistants like Siri have great potential but such developments hit the fundamental problem of how to make computational devices that understand human speech. Natural language understanding is one of the more disappointing…

Computation and Language · Computer Science 2021-05-25 Peter Wallis

Virtual assistants, also known as intelligent conversational systems such as Google's Virtual Assistant and Apple's Siri, interact with human-like responses to users' queries and finish specific tasks. Meanwhile, existing recommendation…

Information Retrieval · Computer Science 2019-01-08 Dimitrios Rafailidis , Yannis Manolopoulos

We will demonstrate a conversational products recommendation agent. This system shows how we combine research in personalized recommendation systems with research in dialogue systems to build a virtual sales agent. Based on new deep…

Computation and Language · Computer Science 2016-10-06 Yueming Sun , Yi Zhang , Yunfei Chen , Roger Jin

Voice has become an increasingly popular User Interaction (UI) channel, mainly contributing to the ongoing trend of wearables, smart vehicles, and home automation systems. Voice assistants such as Siri, Google Now and Cortana, have become…

Cryptography and Security · Computer Science 2017-01-18 Huan Feng , Kassem Fawaz , Kang G. Shin

Shopping plays a significant role in shaping consumer identity and social integration. However, for individuals with visual impairments, navigating in supermarkets and identifying products can be an overwhelming and challenging experience.…

Human-Computer Interaction · Computer Science 2025-09-03 Larissa R. de S. Shibata , Ankit A. Ravankar , Jose Victorio Salazar Luces , Yasuhisa Hirata

Digital technologies are reshaping how people experience their surroundings, often pulling focus toward virtual spaces and making it harder to stay present and engaged. Wearable augmented reality (AR), by embedding digital information into…

Human-Computer Interaction · Computer Science 2025-03-05 Tram Thi Minh Tran

In this paper we present the design and development of the Transhuman Ansambl, a novel interactive singing-voice interface which senses its environment and responds to vocal input with vocalisations using human voice. Designed for live…

Human-Computer Interaction · Computer Science 2024-05-07 Lucija Ivsic , Jon McCormack , Vince Dziekan

Grasping constitutes a critical challenge for visually impaired people. To address this problem, we developed a tactile bracelet that assists in grasping by guiding the user's hand to a target object using vibration commands. Here we…

Human-Computer Interaction · Computer Science 2025-04-24 Marcin Furtak , Florian Pätzold , Tim Kietzmann , Silke M. Kärcher , Peter König

People with visual impairment (PVI) must interact with a world they cannot see. Remote sighted assistance has emerged as a conversational/social support system. We interviewed participants who either provide or receive assistance via a…

Human-Computer Interaction · Computer Science 2018-12-04 Sooyeon Lee , Madison Reddie , Krish Gurdasani , Xiying Wang , Jordan Beck , Mary Beth Rosson , John M. Carroll

In this paper we present a system that detects and tracks objects and agents, computes spatial relations, and communicates those relations to the user using speech. Our system is able to detect multiple objects and agents at 30 frames per…

Robotics · Computer Science 2019-09-16 E. Akin Sisbot , Jonathan H. Connell

As voice assistants (VAs) become increasingly integrated into daily life, the need for emotion-aware systems that can recognize and respond appropriately to user emotions has grown. While significant progress has been made in speech emotion…

Human-Computer Interaction · Computer Science 2025-02-24 Yong Ma , Yuchong Zhang , Di Fu , Stephanie Zubicueta Portales , Danica Kragic , Morten Fjeld

The technology of Conversational AI has made significant advancements over the last eighteen months. As a consequence, conversational agents are likely to be deployed in the near future that are designed to pursue targeted influence…

Human-Computer Interaction · Computer Science 2024-12-30 Louis Rosenberg

Intelligent Process Automation (IPA) is an emerging technology with a primary goal to assist the knowledge worker by taking care of repetitive, routine and low-cognitive tasks. Conversational agents that can interact with users in a natural…

Computation and Language · Computer Science 2020-05-22 Alena Moiseeva , Dietrich Trautmann , Michael Heimann , Hinrich Schütze

Artificial Intelligence (AI) is revolutionizing assistive technologies. It offers innovative solutions to enhance the quality of life for individuals with visual impairments. This review examines the development, applications, and impact of…

Human-Computer Interaction · Computer Science 2025-03-21 Prudhvi Naayini , Praveen Kumar Myakala , Chiranjeevi Bura , Anil Kumar Jonnalagadda , Srikanth Kamatala

Multimodal research and applications are becoming more commonplace as Virtual Reality (VR) technology integrates different sensory feedback, enabling the recreation of real spaces in an audio-visual context. Within VR experiences, numerous…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-08 Mauricio Flores-Vargas , Enda Bates , Rachel McDonnell

The advent of cyber-physical systems, such as robots and autonomous vehicles (AVs), brings new opportunities and challenges for the domain of interaction design. Though there is consensus about the value of human-centred development, there…

Human-Computer Interaction · Computer Science 2024-06-14 Marius Hoggenmuller , Martin Tomitsch , Callum Parker , Trung Thanh Nguyen , Dawei Zhou , Stewart Worrall , Eduardo Nebot

Systems powered by artificial intelligence are being developed to be more user-friendly by communicating with users in a progressively human-like conversational way. Chatbots, also known as dialogue systems, interactive conversational…

Human-Computer Interaction · Computer Science 2020-01-03 Kennedy Ralston , Yuhao Chen , Haruna Isah , Farhana Zulkernine