English
Related papers

Related papers: Position: Human Factors Reshape Adversarial Analys…

200 papers

We seek measurable properties of AI agents that make them better or worse teammates from the subjective perspective of human collaborators. Our experiments use the cooperative card game Hanabi -- a common benchmark for AI-teaming research.…

Human-Computer Interaction · Computer Science 2025-03-21 Ho Chit Siu , Jaime D. Peña , Yutai Zhou , Ross E. Allen

Adversarial training (AT) constructs robust neural networks by incorporating adversarial perturbations into natural data. However, it is plagued by the issue of robust overfitting (RO), which severely damages the model's robustness. In this…

Machine Learning · Computer Science 2024-07-30 Chaojian Yu , Xiaolong Shi , Jun Yu , Bo Han , Tongliang Liu

The rapid advancement of artificial intelligence (AI) systems suggests that artificial general intelligence (AGI) systems may soon arrive. Many researchers are concerned that AIs and AGIs will harm humans via intentional misuse (AI-misuse)…

Artificial Intelligence · Computer Science 2023-05-31 Catalin Mitelut , Ben Smith , Peter Vamplew

This paper examines the complex nature of cyber attacks through an analysis of the LastPass breach. It argues for the integration of human-centric considerations into cybersecurity measures, focusing on mitigating factors such as…

Human-Computer Interaction · Computer Science 2024-05-22 Niroop Sugunaraj

Today, AI is being increasingly used to help human experts make decisions in high-stakes scenarios. In these scenarios, full automation is often undesirable, not only due to the significance of the outcome, but also because human experts…

Artificial Intelligence · Computer Science 2020-01-08 Yunfeng Zhang , Q. Vera Liao , Rachel K. E. Bellamy

Artificial Intelligence (AI) agents have rapidly evolved from specialized, rule-based programs to versatile, learning-driven autonomous systems capable of perception, reasoning, and action in complex environments. The explosion of data,…

Much work in robotics has focused on "human-in-the-loop" learning techniques that improve the efficiency of the learning process. However, these algorithms have made the strong assumption of a cooperating human supervisor that assists the…

Robotics · Computer Science 2020-12-08 Jiali Duan , Qian Wang , Lerrel Pinto , C. -C. Jay Kuo , Stefanos Nikolaidis

As humans increasingly rely on multiround conversational AI for high stakes decisions, principled frameworks are needed to ensure such interactions reliably improve decision quality. We adopt a human centric view governed by two principles:…

Machine Learning · Computer Science 2026-02-25 Sima Noorani , Shayan Kiyani , Hamed Hassani , George Pappas

Despite considerable efforts on making them robust, real-world AI-based systems remain vulnerable to decision based attacks, as definitive proofs of their operational robustness have so far proven intractable. Canonical robustness…

Artificial Intelligence · Computer Science 2025-05-07 Ilias Tsingenopoulos , Vera Rimmer , Davy Preuveneers , Fabio Pierazzi , Lorenzo Cavallaro , Wouter Joosen

AI agents are increasingly deployed in ecosystems where they repeatedly interact not only with each other but also with humans. In this work, we study these human-AI ecosystems from a theoretical perspective, focusing on the classical…

Machine Learning · Computer Science 2025-12-01 Natalie Collina , Eshwar Ram Arunachaleswaran , Meena Jagadeesan

Artificial intelligence (AI) systems are increasingly used for providing advice to facilitate human decision making in a wide range of domains, such as healthcare, criminal justice, and finance. Motivated by limitations of the current…

Artificial Intelligence · Computer Science 2023-07-04 Gali Noti , Yiling Chen

Human error remains a dominant risk driver in safety-critical sectors such as nuclear power, aviation, and healthcare, where seemingly minor mistakes can cascade into catastrophic outcomes. Although decades of research have produced a rich…

Human-Computer Interaction · Computer Science 2025-07-02 Xingyu Xiao , Hongxu Zhu , Jingang Liang , Jiejuan Tong , Haitao Wang

Artificial intelligence systems increasingly involve continual learning to enable flexibility in general situations that are not encountered during system training. Human interaction with autonomous systems is broadly studied, but research…

This chapter critiques the dominant reductionist approach in AI and work studies, which isolates tasks and skills as replaceable components. Instead, it advocates for a systemic perspective that emphasizes the interdependence of tasks,…

The relationship between humans and artificial intelligence is no longer science fiction -- it's a growing reality reshaping how we live and work. AI has moved beyond research labs into everyday life, powering customer service chats,…

Artificial Intelligence · Computer Science 2025-06-17 Cosimo Spera , Garima Agrawal

People frequently face challenging decision-making problems in which outcomes are uncertain or unknown. Artificial intelligence (AI) algorithms exist that can outperform humans at learning such tasks. Thus, there is an opportunity for AI…

Artificial Intelligence · Computer Science 2018-12-27 Ravi Pandya , Sandy H. Huang , Dylan Hadfield-Menell , Anca D. Dragan

A comparison between human and Generative AI decision-making attributes in complex health services is a knowledge gap in the literature, at present. Humans may possess unique attributes beneficial to decision-making in complex health…

Human-Computer Interaction · Computer Science 2025-05-14 Nandini Doreswamy , Louise Horstmanshof

A small but growing body of work has shown that machine learning models which better align with human vision have also exhibited higher robustness to adversarial examples, raising the question: can human-like perception make models more…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Blaine Hoak , Kunyang Li , Patrick McDaniel

With the growing adoption of AI and machine learning systems in real-world applications, ensuring their fairness has become increasingly critical. The majority of the work in algorithmic fairness focus on assessing and improving the…

Machine Learning · Computer Science 2025-11-12 Eunice Chan , Hanghang Tong

Advanced reasoning models with agentic capabilities (AI agents) are deployed to interact with humans and to solve sequential decision-making problems under (approximate) utility functions and internal models. When such problems have…

Artificial Intelligence · Computer Science 2025-09-25 Daniel Jarne Ornia , Nicholas Bishop , Joel Dyer , Wei-Chen Lee , Ani Calinescu , Doyne Farmer , Michael Wooldridge