English
Related papers

Related papers: When and Why does a Model Fail? A Human-in-the-loo…

200 papers

In human-robot collaboration, robot errors are inevitable -- damaging user trust, willingness to work together, and task performance. Prior work has shown that people naturally respond to robot errors socially and that in social…

Robotics · Computer Science 2022-08-02 Maia Stiber , Russell Taylor , Chien-Ming Huang

We propose incorporating human labelers in a model fine-tuning system that provides immediate user feedback. In our framework, human labelers can interactively query model predictions on unlabeled data, choose which data to label, and see…

Human-Computer Interaction · Computer Science 2019-11-18 Caleb Robinson , Anthony Ortiz , Kolya Malkin , Blake Elias , Andi Peng , Dan Morris , Bistra Dilkina , Nebojsa Jojic

Advances in deep learning systems have allowed large models to match or surpass human accuracy on a number of skills such as image classification, basic programming, and standardized test taking. As the performance of the most capable…

Machine Learning · Computer Science 2024-06-10 Sarah Pratt , Seth Blumberg , Pietro Kreitlon Carolino , Meredith Ringel Morris

While deep learning models have greatly improved the performance of most artificial intelligence tasks, they are often criticized to be untrustworthy due to the black-box problem. Consequently, many works have been proposed to study the…

Computation and Language · Computer Science 2021-09-08 Lijie Wang , Hao Liu , Shuyuan Peng , Hongxuan Tang , Xinyan Xiao , Ying Chen , Hua Wu , Haifeng Wang

An image is a very effective tool for conveying emotions. Many researchers have investigated in computing the image emotions by using various features extracted from images. In this paper, we focus on two high level features, the object and…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Hye-Rin Kim , Yeong-Seok Kim , Seon Joo Kim , In-Kwon Lee

In recent years, machine learning has been adopted to complex networks, but most existing works concern about the structural properties. To use machine learning to detect phase transitions and accurately identify the critical transition…

Physics and Society · Physics 2020-01-08 Qi Ni , Ming Tang , Ying Liu , Ying-Cheng Lai

Machine learning based image classification algorithms, such as deep neural network approaches, will be increasingly employed in critical settings such as quality control in industry, where transparency and comprehensibility of decisions…

Machine Learning · Computer Science 2022-03-18 Dennis Müller , Michael März , Stephan Scheele , Ute Schmid

Large Language Models (LLM) benchmarks tell us when models fail, but not why they fail. A wrong answer on a reasoning dataset may stem from formatting issues, calculation errors, or dataset noise rather than weak reasoning. Without…

Artificial Intelligence · Computer Science 2026-02-18 Shir Ashury-Tahan , Yifan Mai , Elron Bandel , Michal Shmueli-Scheuer , Leshem Choshen

How does the brain know what is out there and what is not? Living organisms cannot rely solely on sensory signals for perception because they are noisy and ambiguous. To transform sensory signals into stable percepts, the brain uses its…

Neurons and Cognition · Quantitative Biology 2025-11-27 Alejandro Tabas , Heike Sönnichsen , Sandeep Kaur , Marco Meixner , Katharina von Kriegstein

Deep neural networks (DNNs) are shown to be promising solutions in many challenging artificial intelligence tasks. However, it is very hard to figure out whether the low precision of a DNN model is an inevitable result, or caused by…

Machine Learning · Computer Science 2019-10-01 Jiazhen Gu , Huanlin Xu , Yangfan Zhou , Xin Wang , Hui Xu , Michael Lyu

Sentiment analysis is crucial for the advancement of artificial intelligence (AI). Sentiment understanding can help AI to replicate human language and discourse. Studying the formation and response of sentiment state from well-trained…

Computation and Language · Computer Science 2020-04-23 Yanan Jia , Sony SungChu

Machine learning models are commonly tested in-distribution (same dataset); performance almost always drops in out-of-distribution settings. For HRI research, the goal is often to develop generalized models. This makes domain generalization…

Emotional concepts play a huge role in our daily life since they take part into many cognitive processes: from the perception of the environment around us to different learning processes and natural communication. Social robots need to…

Neural and Evolutionary Computing · Computer Science 2018-08-02 Pablo Barros , Emilia Barakova , Stefan Wermter

Sentiment analysis, a popular technique for opinion mining, has been used by the software engineering research community for tasks such as assessing app reviews, developer emotions in issue trackers and developer opinions on APIs. Past…

Computation and Language · Computer Science 2018-12-27 Achyudh Ram , Meiyappan Nagappan

Deep learning models are effective, yet brittle. Even carefully trained, their behavior tends to be hard to predict when confronted with out-of-distribution samples. In this work, our goal is to propose a simple yet effective solution to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Gabriela Csurka , Tyler L. Hayes , Diane Larlus , Riccardo Volpi

Understanding a program's runtime reasoning behavior, meaning how intermediate states and control flows lead to final execution results, is essential for reliable code generation, debugging, and automated reasoning. Although large language…

Software Engineering · Computer Science 2025-12-02 Mohammad Abdollahi , Khandaker Rifah Tasnia , Soumit Kanti Saha , Jinqiu Yang , Song Wang , Hadi Hemmati

The dual thinking framework considers fast, intuitive, and slower logical processing. The perception of dual thinking in vision requires images where inferences from intuitive and logical processing differ, and the latter is under-explored…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Kailas Dayanandan , Nikhil Kumar , Anand Sinha , Brejesh Lall

Reliable prediction is an essential requirement for deep neural models that are deployed in open environments, where both covariate and semantic out-of-distribution (OOD) data arise naturally. In practice, to make safe decisions, a reliable…

Machine Learning · Computer Science 2025-04-22 Fei Zhu , Zhaoxiang Zhang

A standard paradigm for sentiment analysis is to rely on a singular LLM and makes the decision in a single round under the framework of in-context learning. This framework suffers the key disadvantage that the single-turn output generated…

Computation and Language · Computer Science 2023-11-06 Xiaofei Sun , Xiaoya Li , Shengyu Zhang , Shuhe Wang , Fei Wu , Jiwei Li , Tianwei Zhang , Guoyin Wang

In large deep neural networks that seem to perform surprisingly well on many tasks, we also observe a few failures related to accuracy, social biases, and alignment with human values, among others. Therefore, before deploying these models,…

Machine Learning · Computer Science 2024-06-17 Som Sagar , Aditya Taparia , Ransalu Senanayake