English
Related papers

Related papers: Audio-Visual Understanding of Passenger Intents fo…

200 papers

Understanding passenger intents from spoken interactions and car's vision (both inside and outside the vehicle) are important building blocks towards developing contextual dialog systems for natural interactions in autonomous vehicles (AV).…

Multimedia · Computer Science 2019-10-01 Eda Okur , Shachi H Kumar , Saurav Sahay , Lama Nachman

Understanding passenger intents and extracting relevant slots are important building blocks towards developing a contextual dialogue system responsible for handling certain vehicle-passenger interactions in autonomous vehicles (AV). When…

Computation and Language · Computer Science 2019-01-16 Eda Okur , Shachi H Kumar , Saurav Sahay , Asli Arslan Esme , Lama Nachman

Understanding passenger intents and extracting relevant slots are important building blocks towards developing contextual dialogue systems for natural interactions in autonomous vehicles (AV). In this work, we explored AMIE…

Computation and Language · Computer Science 2019-04-25 Eda Okur , Shachi H Kumar , Saurav Sahay , Asli Arslan Esme , Lama Nachman

Public distrust of self-driving cars is growing. Studies emphasize the need for interpreting the behavior of these vehicles to passengers to promote trust in autonomous systems. Interpreters can enhance trust by improving transparency and…

Human-Computer Interaction · Computer Science 2025-01-14 Xuewen Luo , Fan Ding , Ruiqi Chen , Rishikesh Panda , Junnyong Loo , Shuyun Zhang

As autonomous agents, from self-driving cars to virtual assistants, become increasingly present in everyday life, safe and effective collaboration depends on human understanding of agents' intentions. Current intent communication approaches…

In this work, we use the communication of intent as a means to facilitate cooperation between autonomous vehicle agents. Generally speaking, intents can be any reliable information about its future behavior that a vehicle communicates with…

Robotics · Computer Science 2023-09-26 Nishtha Mahajan , Qi Zhang

Multi-modal AI systems will likely become a ubiquitous presence in our everyday lives. A promising approach to making these systems more interactive is to embody them as agents within physical and virtual environments. At present, systems…

As interest in autonomous driving increases, efforts are being made to meet requirements for the high-level automation of vehicles. In this context, the functionality inside the vehicle cabin plays a key role in ensuring a safe and pleasant…

Artificial Intelligence · Computer Science 2021-01-07 Yao Rong , Chao Han , Christian Hellert , Antje Loyal , Enkelejda Kasneci

The recent surge in artificial intelligence, particularly in multimodal processing technology, has advanced human-computer interaction, by altering how intelligent systems perceive, understand, and respond to contextual information (i.e.,…

Most popular goal-oriented dialogue agents are capable of understanding the conversational context. However, with the surge of virtual assistants with screen, the next generation of agents are required to also understand screen context in…

Machine Learning · Computer Science 2021-11-26 Sanchit Agarwal , Jan Jezabek , Arijit Biswas , Emre Barut , Shuyang Gao , Tagyoung Chung

Increasing autonomous vehicles (AVs) in transportation systems makes effective interactions between AVs and pedestrians indispensable. External human--machine interface (eHMI), which employs visual or auditory cues to explicitly convey…

Human-Computer Interaction · Computer Science 2026-01-01 Boya Sun , Haotian Shi , Ying Ni , Shaocheng Jia , Haoyang Liang

Improving end-users' understanding of decisions made by autonomous vehicles (AVs) driven by artificial intelligence (AI) can improve utilization and acceptance of AVs. However, current explanation mechanisms primarily help AI researchers…

Human-Computer Interaction · Computer Science 2025-05-13 Somayeh Molaei , Lionel P. Robert , Nikola Banovic

The investigation of factors contributing at making humans trust Autonomous Vehicles (AVs) will play a fundamental role in the adoption of such technology. The user's ability to form a mental model of the AV, which is crucial to establish…

Human-Computer Interaction · Computer Science 2020-07-28 Lia Morra , Fabrizio Lamberti , F. Gabriele Pratticó , Salvatore La Rosa , Paolo Montuschi

Autonomous vehicles (AVs) are poised to redefine transportation by enhancing road safety, minimizing human error, and optimizing traffic efficiency. The success of AVs depends on their ability to interpret complex, dynamic environments…

Multimedia · Computer Science 2025-07-11 Abolfazl Zarghani , Amirhossein Ebrahimi , Amir Malekesfandiari

Automotive user interface (AUI) evaluation becomes increasingly complex due to novel interaction modalities, driving automation, heterogeneous data, and dynamic environmental contexts. Immersive analytics may enable efficient explorations…

Human-Computer Interaction · Computer Science 2023-02-22 Pascal Jansen , Julian Britten , Alexander Häusele , Thilo Segschneider , Mark Colley , Enrico Rukzio

Vision and voice are two vital keys for agents' interaction and learning. In this paper, we present a novel indoor navigation model called Memory Vision-Voice Indoor Navigation (MVV-IN), which receives voice commands and analyzes multimodal…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Liqi Yan , Dongfang Liu , Yaoxian Song , Changbin Yu

As robots enter collaborative workspaces, ensuring mutual understanding between human workers and robotic systems becomes a prerequisite for trust, safety, and efficiency. In this position paper, we draw on the cooperation scenario of the…

Human-Computer Interaction · Computer Science 2025-06-19 Francesco Chiossi , Julian Rasch , Robin Welsch , Albrecht Schmidt , Florian Michahelles

Automated vehicle acceptance (AVA) has been measured mostly subjectively by questionnaires and interviews, with a main focus on drivers inside automated vehicles (AVs). To ensure that AVs are widely accepted by the public, ensuring the…

Human-Computer Interaction · Computer Science 2023-09-20 Neeraja Bhide , Nanami Hashimoto , Kazimierz Dokurno , Chris Van der Hoorn , Sascha Hoogendoorn-Lanser , Sina Nordhoff

A crucial ability of mobile intelligent agents is to integrate the evidence from multiple sensory inputs in an environment and to make a sequence of actions to reach their goals. In this paper, we attempt to approach the problem of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Chuang Gan , Yiwei Zhang , Jiajun Wu , Boqing Gong , Joshua B. Tenenbaum

Vision-based Interfaces (VIs) are pivotal in advancing Human-Computer Interaction (HCI), particularly in enhancing context awareness. However, there are significant opportunities for these interfaces due to rapid advancements in multimodal…

Human-Computer Interaction · Computer Science 2024-08-15 Yongquan Hu , Wen Hu , Aaron Quigley
‹ Prev 1 2 3 10 Next ›