English
Related papers

Related papers: Human-in-the-loop or AI-in-the-loop? Automate or C…

200 papers

"Human-centered machine learning" (HCML) is a term that describes machine learning that applies to human-focused problems. Although this idea is noteworthy and generates scholarly excitement, scholars and practitioners have struggled to…

Machine Learning · Computer Science 2022-03-02 Stevie Chancellor

LLM-powered coding agents are reshaping the development paradigm. However, existing evaluation systems, neither traditional tests for humans nor benchmarks for LLMs, fail to capture this shift, excluding problems that require both human…

Machine learning workflow development is anecdotally regarded to be an iterative process of trial-and-error with humans-in-the-loop. However, we are not aware of quantitative evidence corroborating this popular belief. A quantitative…

Machine Learning · Computer Science 2018-05-21 Doris Xin , Litian Ma , Shuchen Song , Aditya Parameswaran

While the emergence of powerful language models along with Chain-of-thought prompting has made automation more and more omnipresent, it sometimes demonstrates its weakness in long-term or multi-step logical reasoning. For example, users…

Computation and Language · Computer Science 2023-06-26 Zefan Cai , Baobao Chang , Wenjuan Han

In AI-assisted decision-making, effective hybrid (human-AI) teamwork is not solely dependent on AI performance alone, but also on its impact on human decision-making. While prior work studies the effects of model accuracy on humans, we…

Human-Computer Interaction · Computer Science 2022-02-25 Andi Peng , Besmira Nushi , Emre Kiciman , Kori Inkpen , Ece Kamar

Imitation Learning (IL) has emerged as a powerful approach in robotics, allowing robots to acquire new skills by mimicking human actions. Despite its potential, the data collection process for IL remains a significant challenge due to the…

Robotics · Computer Science 2025-05-23 Hamidreza Kasaei , Mohammadreza Kasaei

Document layout analysis (DLA) aims to divide a document image into different types of regions. DLA plays an important role in the document content understanding and information extraction systems. Exploring a method that can use less data…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Xingjiao Wu , Tianlong Ma , Xin Li , Qin Chen , Liang He

Artificial intelligence (AI) advances and the rapid adoption of generative AI tools like ChatGPT present new opportunities and challenges for higher education. While substantial literature discusses AI in higher education, there is a lack…

General Economics · Economics 2024-02-15 Evangelos Katsamakas , Oleg V. Pavlov , Ryan Saklad

Human-in-the-loop reinforcement learning integrates human expertise to accelerate agent learning and provide critical guidance and feedback in complex fields. However, many existing approaches focus on single-agent tasks and require…

Machine Learning · Computer Science 2024-09-19 Huawen Hu , Enze Shi , Chenxi Yue , Shuocun Yang , Zihao Wu , Yiwei Li , Tianyang Zhong , Tuo Zhang , Tianming Liu , Shu Zhang

To facilitate the wider adoption of robotics, accessible programming tools are required for non-experts. Observational learning enables intuitive human skills transfer through hands-on demonstrations, but relying solely on visual input can…

Robotics · Computer Science 2025-07-29 Elena Merlo , Marta Lagomarsino , Arash Ajoudani

Recently, Large Language Models (LLMs)-based multi-agent paradigms for software engineering are introduced to automatically resolve software development tasks (e.g., from a given issue to source code). However, existing work is evaluated…

Large language models are widely deployed in high-stakes NLP tasks, yet risks such as bias, hallucination, adversarial vulnerability and unreliable generalization remain. Probe-based auditing reveals inconsistencies in model behavior.…

Computation and Language · Computer Science 2026-05-26 Most. Sharmin Sultana Samu , MD. Tanvir Ahmed Seum , Md. Rakibul Islam

As AI systems increasingly shape decision making in creative design contexts, understanding how humans engage with these tools has become a critical challenge for interactive intelligent systems research. This paper contributes a challenge…

Human-Computer Interaction · Computer Science 2025-10-29 Sean P. Walton , Ben J. Evans , Alma A. M. Rahat , James Stovold , Jakub Vincalek

Inventory control is a fundamental operations problem in which ordering decisions are traditionally guided by theoretically grounded operations research (OR) algorithms. However, such algorithms often rely on rigid modeling assumptions and…

Artificial Intelligence · Computer Science 2026-05-06 Jackie Baek , Yaopeng Fu , Will Ma , Tianyi Peng

As Artificial Intelligence (AI) becomes increasingly integrated into high-stakes domains like healthcare, effective collaboration between healthcare experts and AI systems is critical. Data-centric steering, which involves fine-tuning…

Human-Computer Interaction · Computer Science 2025-06-24 Aditya Bhattacharya , Simone Stumpf , Katrien Verbert

Surgical robot automation has attracted increasing research interest over the past decade, expecting its potential to benefit surgeons, nurses and patients. Recently, the learning paradigm of embodied intelligence has demonstrated promising…

Robotics · Computer Science 2023-06-07 Yonghao Long , Wang Wei , Tao Huang , Yuehao Wang , Qi Dou

Technological progress increasingly envisions the use of robots interacting with people in everyday life. Human-robot collaboration (HRC) is the approach that explores the interaction between a human and a robot, during the completion of a…

Robotics · Computer Science 2022-07-12 Francesco Semeraro , Alexander Griffiths , Angelo Cangelosi

Effective human-AI collaboration requires a system design that provides humans with meaningful ways to make sense of and critically evaluate algorithmic recommendations. In this paper, we propose a way to augment human-AI collaboration by…

Machine Learning · Computer Science 2022-05-03 Maria De-Arteaga , Alexandra Chouldechova , Artur Dubrawski

Human-machine complementarity is important when neither the algorithm nor the human yield dominant performance across all instances in a given domain. Most research on algorithmic decision-making solely centers on the algorithm's…

Human-Computer Interaction · Computer Science 2021-12-14 Ruijiang Gao , Maytal Saar-Tsechansky , Maria De-Arteaga , Ligong Han , Min Kyung Lee , Matthew Lease

Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity. Yet, the collaborative decision-making process between humans and AI remains underdeveloped, often falling…

Human-Computer Interaction · Computer Science 2025-04-10 Bowen Lou , Tian Lu , T. S. Raghu , Yingjie Zhang