English
Related papers

Related papers: Improving the Efficiency of Human-in-the-Loop Syst…

200 papers

We deal with the problem of localized in-video taxonomic human annotation in the video content moderation domain, where the goal is to identify video segments that violate granular policies, e.g., community guidelines on an online video…

Machine Learning · Computer Science 2022-10-19 Meghana Deodhar , Xiao Ma , Yixin Cai , Alex Koes , Alex Beutel , Jilin Chen

Owing to the advancement of deep learning, artificial systems are now rival to humans in several pattern recognition tasks, such as visual recognition of object categories. However, this is only the case with the tasks for which correct…

Machine Learning · Computer Science 2019-06-03 Xing Liu , Takayuki Okatani

Machine learning models for text classification are trained to predict a class for a given text. To do this, training and validation samples must be prepared: a set of texts is collected, and each text is assigned a class. These classes are…

Computation and Language · Computer Science 2025-08-26 Aleksandr Tsymbalov , Mikhail Khovrichev

Large language models are widely deployed in high-stakes NLP tasks, yet risks such as bias, hallucination, adversarial vulnerability and unreliable generalization remain. Probe-based auditing reveals inconsistencies in model behavior.…

Computation and Language · Computer Science 2026-05-26 Most. Sharmin Sultana Samu , MD. Tanvir Ahmed Seum , Md. Rakibul Islam

Building on existing approaches, we revisit Human-in-the-Loop Object Retrieval, a task that consists of iteratively retrieving images containing objects of a class-of-interest, specified by a user-provided query. Starting from a large…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Kawtar Zaher , Olivier Buisson , Alexis Joly

Machine learning (ML) models have been quite successful in predicting outcomes in many applications. However, in some cases, domain experts might have a judgment about the expected outcome that might conflict with the prediction of ML…

Machine Learning · Computer Science 2023-05-02 Hogun Park , Aly Megahed , Peifeng Yin , Yuya Ong , Pravar Mahajan , Pei Guo

We introduce BRIDGET, a novel human-in-the-loop system for hybrid decision-making, aiding the user to label records from an un-labeled dataset, attempting to ``bridge the gap'' between the two most popular Hybrid Decision-Making paradigms:…

Artificial Intelligence · Computer Science 2024-10-01 Federico Mazzoni , Roberto Pellungrini , Riccardo Guidotti

The goal of Machine Learning to automatically learn from data, extract knowledge and to make decisions without any human intervention. Such automatic (aML) approaches show impressive success. Recent results even demonstrate intriguingly…

Artificial Intelligence · Computer Science 2021-03-16 Andreas Holzinger , Markus Plass , Katharina Holzinger , Gloria Cerasela Crisan , Camelia-M. Pintea , Vasile Palade

In-context learning (ICL) ability has emerged with the increasing scale of large language models (LLMs), enabling them to learn input-label mappings from demonstrations and perform well on downstream tasks. However, under the standard ICL…

Computation and Language · Computer Science 2024-04-19 Yifan Wang , Qingyan Guo , Xinzhe Ni , Chufan Shi , Lemao Liu , Haiyun Jiang , Yujiu Yang

Computers are quickly gaining on us. Artificial systems are now exceeding the performance of human experts in several domains. However, we do not yet have a deep definition of expertise. This paper examines the nature of expertise and…

Artificial Intelligence · Computer Science 2022-12-21 Ron Fulbright

Expert diagnostic support systems have been extensively studied. The practical applications of these systems in real-world scenarios have been somewhat limited due to well-understood shortcomings, such as lack of extensibility. More…

Artificial Intelligence · Computer Science 2018-08-15 Murali Ravuri , Anitha Kannan , Geoffrey J. Tso , Xavier Amatriain

Reinforcement learning (RL) has experienced a second wind in the past decade. While incredibly successful in images and videos, these systems still operate within the realm of propositional tasks ignoring the inherent structure that exists…

Machine Learning · Computer Science 2025-10-21 Fateme Golivand Darvishvand , Hikaru Shindo , Sahil Sidheekh , Kristian Kersting , Sriraam Natarajan

The currently leading artificial neural network models of the visual ventral stream - which are derived from a combination of performance optimization and robustification methods - have demonstrated a remarkable degree of behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Morgan B. Talbot , Gabriel Kreiman , James J. DiCarlo , Guy Gaziv

Classification is a fundamental task in machine learning. While conventional methods-such as binary, multiclass, and multi-label classification-are effective for simpler problems, they may not adequately address the complexities of some…

Large language models (LLMs) are increasingly embedded in computer science education through AI-assisted programming tools, yet such workflows often exhibit objective drift, in which locally plausible outputs diverge from stated task…

Artificial Intelligence · Computer Science 2026-04-02 Mark Dranias , Adam Whitley

Machine learning (ML) has developed rapidly in the past few years and has successfully been utilized for a broad range of tasks, including phishing detection. However, building an effective ML-based detection system is not a trivial task,…

Machine Learning · Computer Science 2021-08-30 Rizka Purwanto , Arindam Pal , Alan Blair , Sanjay Jha

AI agents are increasingly deployed to execute tasks and make decisions within agentic workflows, introducing new requirements for safe and controlled autonomy. Prior work has established the importance of human oversight for ensuring…

Artificial Intelligence · Computer Science 2026-04-28 Edward Cheng , Jeshua Cheng

Human psychology plays an important role in organizational performance. However, understanding our employees is a difficult task due to issues such as psychological complexities, unpredictable dynamics, and the lack of data. Leveraging…

Computers and Society · Computer Science 2020-01-28 Tam N. Nguyen

Integration of human feedback plays a key role in improving the learning capabilities of intelligent systems. This comparative study delves into the performance, robustness, and limitations of imitation learning compared to traditional…

Machine Learning · Computer Science 2024-10-30 Amr Gomaa , Bilal Mahdy

Machine learning methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the APIs by major…