English
Related papers

Related papers: Toward Auto-evaluation with Confidence-based Categ…

200 papers

Auto-annotation by ensemble of models is an efficient method of learning on unlabeled data. Wrong or inaccurate annotations generated by the ensemble may lead to performance degradation of the trained model. To deal with this problem we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Dror Simon , Miriam Farber , Roman Goldenberg

Recommender systems utilize users' historical data to learn and predict their future interests, providing them with suggestions tailored to their tastes. Calibration ensures that the distribution of recommended item categories is consistent…

Information Retrieval · Computer Science 2022-08-23 Mohammadmehdi Naghiaei , Hossein A. Rahmani , Mohammad Aliannejadi , Nasim Sonboli

Large language models (LLMs) have demonstrated impressive performance on several tasks and are increasingly deployed in real-world applications. However, especially in high-stakes settings, it becomes vital to know when the output of an LLM…

Computation and Language · Computer Science 2025-06-23 Yu-Neng Chuang , Prathusha Kameswara Sarma , Parikshit Gopalan , John Boccio , Sara Bolouki , Xia Hu , Helen Zhou

Ensuring safety in autonomous driving requires precise, real-time risk assessment and adaptive behavior. Prior work on risk estimation either outputs coarse, global scene-level metrics lacking interpretability, proposes indicators without…

Robotics · Computer Science 2025-08-06 Boyang Tian , Weisong Shi

Large reasoning models often reach correct answers through flawed intermediate steps, creating a gap between final accuracy and reasoning reliability. Existing alignment strategies address this with external verifiers or massive sampling,…

Artificial Intelligence · Computer Science 2026-05-11 Kejia Chen , Jiawen Zhang , Yihong Wu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song , Ruoxi Jia

Identification of affective and attentional states of individuals within groups is difficult to obtain without disrupting the natural flow of collaboration. Recent work from our group used a retrospect cued recall paradigm where…

Human-Computer Interaction · Computer Science 2025-07-03 Sifatul Anindho , Videep Venkatesha , Nathaniel Blanchard

Machine learning models provide statistically impressive results which might be individually unreliable. To provide reliability, we propose an Epistemic Classifier (EC) that can provide justification of its belief using support from the…

Machine Learning · Computer Science 2020-10-20 Chitresh Bhushan , Zhaoyuan Yang , Nurali Virani , Naresh Iyer

The underlying processes that enable self-perception are crucial for understanding multisensory integration, body perception and action, and the development of the self. Previous computational models have overlooked an essential aspect:…

Neurons and Cognition · Quantitative Biology 2022-08-30 Jonathan Bauermeister , Pablo Lanillos

The incompleteness of positive labels and the presence of many unlabelled instances are common problems in binary classification applications such as in review helpfulness classification. Various studies from the classification literature…

Information Retrieval · Computer Science 2020-08-17 Xi Wang , Iadh Ounis , Craig Macdonald

Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples,…

Computation and Language · Computer Science 2025-03-03 Nguyen Xuan Thanh , Anh Duc Le , Quyen Tran , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

Self-learning paradigms in large-scale conversational AI agents tend to leverage user feedback in bridging between what they say and what they mean. However, such learning, particularly in Markov-based query rewriting systems have far from…

Computation and Language · Computer Science 2022-05-03 Pragaash Ponnusamy , Clint Solomon Mathialagan , Gustavo Aguilar , Chengyuan Ma , Chenlei Guo

The key of referring expression comprehension lies in capturing the cross-modal visual-linguistic relevance. Existing works typically model the cross-modal relevance in each image, where the anchor object/expression and their positive…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Fuhai Chen , Xuri Ge , Xiaoshuai Sun , Yue Gao , Jianzhuang Liu , Fufeng Chen , Wenjie Li

For person re-identification (re-id), attention mechanisms have become attractive as they aim at strengthening discriminative features and suppressing irrelevant ones, which matches well the key of re-id, i.e., discriminative feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Zhizheng Zhang , Cuiling Lan , Wenjun Zeng , Xin Jin , Zhibo Chen

We present a simple yet effective self-training approach, named as STAD, for low-resource relation extraction. The approach first classifies the auto-annotated instances into two groups: confident instances and uncertain instances,…

Computation and Language · Computer Science 2022-09-08 Junjie Yu , Xing Wang , Jiangjiang Zhao , Chunjie Yang , Wenliang Chen

Recent studies have revealed that reading comprehension (RC) systems learn to exploit annotation artifacts and other biases in current datasets. This prevents the community from reliably measuring the progress of RC systems. To address this…

Computation and Language · Computer Science 2020-05-05 Naoya Inoue , Pontus Stenetorp , Kentaro Inui

We tackle a new task of training neural network models that can assess subjective impressions conveyed through speech and assign scores accordingly, inspired by the work on automatic speech quality assessment (SQA). Speech impressions are…

Sound · Computer Science 2025-06-25 Yuto Kondo , Hirokazu Kameoka , Kou Tanaka , Takuhiro Kaneko , Noboru Harada

Conversational Causal Emotion Entailment (C2E2) is a task that aims at recognizing the causes corresponding to a target emotion in a conversation. The order of utterances in the conversation affects the causal inference. However, most…

Computation and Language · Computer Science 2023-03-06 Xiaojie Gu , Renze Lou , Lin Sun , Shangxin Li

Reflexion-style agents rely on self-generated reflections as memory, implicitly assuming that agents can accurately diagnose their own failures.We show that this assumption can fail systematically: across ALFWorld and HumanEval, agents…

Machine Learning · Computer Science 2026-05-29 Prakhar Dixit , Sadia Kamal , Tim Oates

Classifier-free Guidance (CFG) is a widely used technique in modern diffusion models for enhancing sample quality and prompt adherence. However, through an empirical analysis on Gaussian mixture modeling with a closed-form solution, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Chubin Chen , Jiashu Zhu , Xiaokun Feng , Nisha Huang , Chen Zhu , Meiqi Wu , Fangyuan Mao , Jiahong Wu , Xiangxiang Chu , Xiu Li

We propose a general, modular method for significance testing of groups (or clusters) of variables in a high-dimensional linear model. In presence of high correlations among the covariables, due to serious problems of identifiability, it is…

Statistics Theory · Mathematics 2015-02-12 Jacopo Mandozzi , Peter Bühlmann