English
Related papers

Related papers: AutoVis: Enabling Mixed-Immersive Analysis of Auto…

200 papers

Composite visualization represents a widely embraced design that combines multiple visual representations to create an integrated view. However, the traditional approach of creating composite visualizations in immersive environments…

Human-Computer Interaction · Computer Science 2024-08-08 Qian Zhu , Tao Lu , Shunan Guo , Xiaojuan Ma , Yalong Yang

Evaluating and ensuring the adversarial robustness of autonomous driving (AD) systems is a critical and unresolved challenge. This paper introduces MetAdv, a novel adversarial testing platform that enables realistic, dynamic, and…

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz

Autonomous graphical user interface (GUI) agents aim to facilitate task automation by interacting with the user interface without manual intervention. Recent studies have investigated eliciting the capabilities of large language models…

Computation and Language · Computer Science 2024-06-10 Zhuosheng Zhang , Aston Zhang

We investigate hybrid user interfaces (HUIs), aiming to establish a cohesive understanding and adopt consistent terminology for this nascent research area. HUIs combine heterogeneous devices in complementary roles, leveraging the distinct…

Virtual sensing aims to infer hard-to-measure quantities from accessible measurements and is central to perception and control in physical systems. Despite rapid progress from first-principle and hybrid models to modern data-driven methods…

Human-machine interfaces (HMI) facilitate communication between humans and machines, and their importance has increased in modern technology. However, traditional HMIs are often static and do not adapt to individual user preferences or…

Human-Computer Interaction · Computer Science 2023-11-08 Angela Carrera-Rivera , Daniel Reguera-Bakhache , Felix Larrinaga , Ganix Lasa

Understanding passenger intents from spoken interactions and car's vision (both inside and outside the vehicle) are important building blocks towards developing contextual dialog systems for natural interactions in autonomous vehicles (AV).…

Multimedia · Computer Science 2019-10-01 Eda Okur , Shachi H Kumar , Saurav Sahay , Lama Nachman

It is important to build a rigorous verification and validation (V&V) process to evaluate the safety of highly automated vehicles (HAVs) before their wide deployment on public roads. In this paper, we propose an interaction-aware framework…

Robotics · Computer Science 2021-02-24 Xinpeng Wang , Songan Zhang , Kuan-Hui Lee , Huei Peng

Generative Artificial Intelligence is emerging as a transformative force in the automotive industry, enabling novel applications across vehicle design, manufacturing, autonomous driving, predictive maintenance, and in vehicle user…

Robotics · Computer Science 2025-11-04 Chaitanya Shinde , Divya Garikapati

Automating GUI tasks remains challenging due to reliance on textual representations, platform-specific action spaces, and limited reasoning capabilities. We introduce Aguvis, a unified vision-based framework for autonomous GUI agents that…

Computation and Language · Computer Science 2025-05-06 Yiheng Xu , Zekun Wang , Junli Wang , Dunjie Lu , Tianbao Xie , Amrita Saha , Doyen Sahoo , Tao Yu , Caiming Xiong

Autonomous vehicles (AVs) are poised to redefine transportation by enhancing road safety, minimizing human error, and optimizing traffic efficiency. The success of AVs depends on their ability to interpret complex, dynamic environments…

Multimedia · Computer Science 2025-07-11 Abolfazl Zarghani , Amirhossein Ebrahimi , Amir Malekesfandiari

In this article, we report on the design and evaluation of an external human-machine interface (eHMI) for a real autonomous vehicle (AV), developed to operate as a shared transport pod in a pedestrianized urban space. We present insights…

Human-Computer Interaction · Computer Science 2024-06-19 Marius Hoggenmueller , Martin Tomitsch , Stewart Worrall

The automotive industry has witnessed an increasing level of development in the past decades; from manufacturing manually operated vehicles to manufacturing vehicles with a high level of automation. With the recent developments in…

Human-Computer Interaction · Computer Science 2021-11-11 Daniel Omeiza , Helena Webb , Marina Jirotka , Lars Kunze

As passengers spend more time in vehicles, the demand for non-driving related tasks (NDRTs) increases. In-car Augmented Reality (AR) has the potential to enhance passenger experiences by enabling interaction with the environment through…

Human-Computer Interaction · Computer Science 2025-02-13 Robin Connor Schramm , Ginevra Fedrizzi , Markus Sasalovici , Jann Philipp Freiwald , Ulrich Schwanecke

Interaction-aware Autonomous Driving (IAAD) is a rapidly growing field of research that focuses on the development of autonomous vehicles (AVs) that are capable of interacting safely and efficiently with human road users. This is a…

Human-Computer Interaction · Computer Science 2023-11-01 Luca Crosato , Kai Tian , Hubert P. H Shum , Edmond S. L. Ho , Yafei Wang , Chongfeng Wei

In the field of autonomous driving research, the use of immersive virtual reality (VR) techniques is widespread to enable a variety of studies under safe and controlled conditions. However, this methodology is only valid and consistent if…

Human-Computer Interaction · Computer Science 2024-07-08 Sergio. Martín Serrano , Rubén Izquierdo , Iván García Daza , Miguel Ángel Sotelo , D. Fernández Llorca

No human drives a car in a vacuum; she/he must negotiate with other road users to achieve their goals in social traffic scenes. A rational human driver can interact with other road users in a socially-compatible way through implicit…

Robotics · Computer Science 2022-11-29 Wenshuo Wang , Letian Wang , Chengyuan Zhang , Changliu Liu , Lijun Sun

Detecting a diverse range of objects under various driving scenarios is essential for the effectiveness of autonomous driving systems. However, the real-world data collected often lacks the necessary diversity presenting a long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Aqeel Anwar , Tae Eun Choe , Zian Wang , Sanja Fidler , Minwoo Park

While recent advances in deep learning have demonstrated its transformative potential, its adoption for real-world manufacturing applications remains limited. We present an Explanation User Interface (XUI) for a state-of-the-art deep…