English
Related papers

Related papers: Defining an Evaluation Method for External Human-M…

200 papers

Interpretability is a crucial aspect of machine learning models that enables humans to understand and trust the decision-making process of these models. In many real-world applications, the interpretability of models is essential for legal,…

Machine Learning · Statistics 2023-07-18 Shree Charran R , Sandipan Das Mahapatra

Usability evaluation is an essential method to support the design of effective and intuitive user interfaces (UIs). However, it commonly relies on resource-intensive, expert-driven methods, which limit its accessibility, especially for…

Software Engineering · Computer Science 2026-04-13 Sebastian Lubos , Alexander Felfernig , Damian Garber , Gerhard Leitner , Julian Schwazer , Manuel Henrich

How can multiple humans interact with multiple robots? The goal of our research is to create an effective interface that allows multiple operators to collaboratively control teams of robots in complex tasks. In this paper, we focus on a key…

Robotics · Computer Science 2021-02-02 Jayam Patel , Tyagaraja Ramaswamy , Zhi Li , Carlo Pinciroli

Human-machine interfaces (HMI) facilitate communication between humans and machines, and their importance has increased in modern technology. However, traditional HMIs are often static and do not adapt to individual user preferences or…

Human-Computer Interaction · Computer Science 2023-11-08 Angela Carrera-Rivera , Daniel Reguera-Bakhache , Felix Larrinaga , Ganix Lasa

As Large Language Models (LLMs) become increasingly integrated into real-world applications, ensuring their outputs align with human values and safety standards has become critical. The field has developed diverse alignment approaches…

In recent years, the demand for social robots has grown, requiring them to adapt their behaviors based on users' states. Accurately assessing user experience (UX) in human-robot interaction (HRI) is crucial for achieving this adaptability.…

Robotics · Computer Science 2025-08-01 Ryo Miyoshi , Yuki Okafuji , Takuya Iwamoto , Junya Nakanishi , Jun Baba

In the age of artificial intelligence (AI), providing learners with suitable and sufficient explanations of AI-based recommendation algorithm's output becomes essential to enable them to make an informed decision about it. However, the…

Human-Computer Interaction · Computer Science 2024-02-14 Hasan Abu-Rasheed , Christian Weber , Madjid Fathi

Collecting high-quality translations is crucial for the development and evaluation of machine translation systems. However, traditional human-only approaches are costly and slow. This study presents a comprehensive investigation of 11…

Computation and Language · Computer Science 2024-10-16 Zhongtao Liu , Parker Riley , Daniel Deutsch , Alison Lui , Mengmeng Niu , Apu Shah , Markus Freitag

A large body of work in behavioral fields attempts to develop models that describe the way people, as opposed to rational agents, make decisions. A recent Choice Prediction Competition (2015) challenged researchers to suggest a model that…

Machine Learning · Computer Science 2016-12-01 Gali Noti , Effi Levi , Yoav Kolumbus , Amit Daniely

Driving world models serve as a pivotal technology for autonomous driving by simulating environmental dynamics. However, existing approaches predominantly focus on future scene generation, often overlooking comprehensive 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xin Zhou , Dingkang Liang , Xiwu Chen , Feiyang Tan , Dingyuan Zhang , Hengshuang Zhao , Xiang Bai

Skillful mobile operation in three-dimensional environments is a primary topic of study in Artificial Intelligence. The past two years have seen a surge of creative work on navigation. This creative output has produced a plethora of…

The influence of machine learning (ML) is quickly spreading, and a number of recent technological innovations have applied ML as a central technology. However, ML development still requires a substantial amount of human expertise to be…

Machine Learning · Computer Science 2021-05-04 Simon Enni , Ira Assent

This survey analyzes intermediate fusion methods in collaborative perception for autonomous driving, categorized by real-world challenges. We examine various methods, detailing their features and the evaluation metrics they employ. The…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Melih Yazgan , Thomas Graf , Min Liu , Tobias Fleck , J. Marius Zoellner

The large-scale deployment of automated vehicles on public roads has the potential to vastly change the transportation modalities of today's society. Although this pursuit has been initiated decades ago, there still exist open challenges in…

Understanding details of human multimodal interaction can elucidate many aspects of the type of information processing machines must perform to interact with humans. This article gives an overview of recent findings from Linguistics…

Computation and Language · Computer Science 2020-08-10 João Ranhel , Cacilda Vilela

Due to the absence of ground truth, objective evaluation of explainability methods is an essential research direction. So far, the vast majority of evaluations can be summarized into three categories, namely human evaluation, sensitivity…

Artificial Intelligence · Computer Science 2024-05-01 Hanxiao Tan

LLM evaluation is challenging even the case of base models. In real world deployments, evaluation is further complicated by the interplay of task specific prompts and experiential context. At scale, bias evaluation is often based on short…

Computation and Language · Computer Science 2025-05-07 Jennifer Healey , Laurie Byrum , Md Nadeem Akhtar , Surabhi Bhargava , Moumita Sinha

It is important to build a rigorous verification and validation (V&V) process to evaluate the safety of highly automated vehicles (HAVs) before their wide deployment on public roads. In this paper, we propose an interaction-aware framework…

Robotics · Computer Science 2021-02-24 Xinpeng Wang , Songan Zhang , Kuan-Hui Lee , Huei Peng

Rapid advancements in driver-assistance technology will lead to the integration of fully autonomous vehicles on our roads that will interact with other road users. To address the problem that driverless vehicles make interaction through eye…

Autonomous vehicles currently suffer from a time-inefficient driving style caused by uncertainty about human behavior in traffic interactions. Accurate and reliable prediction models enabling more efficient trajectory planning could make…

Robotics · Computer Science 2023-02-21 Julian Frederik Schumann , Jens Kober , Arkady Zgonnikov