English
Related papers

Related papers: ILDAE: Instance-Level Difficulty Analysis of Evalu…

200 papers

Partial label learning (PLL) is a typical weakly supervised learning problem, where each training example is associated with a set of candidate labels among which only one is true. Most existing PLL approaches assume that the incorrect…

Machine Learning · Computer Science 2021-10-27 Ning Xu , Congyu Qiao , Xin Geng , Min-Ling Zhang

Deep models trained with noisy labels are prone to over-fitting and struggle in generalization. Most existing solutions are based on an ideal assumption that the label noise is class-conditional, i.e., instances of the same class share the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Ganlong Zhao , Guanbin Li , Yipeng Qin , Feng Liu , Yizhou Yu

Multi-instance learning is a type of weakly supervised learning. It deals with tasks where the data is a set of bags and each bag is a set of instances. Only the bag labels are observed whereas the labels for the instances are unknown. An…

Machine Learning · Computer Science 2021-05-05 Weijia Zhang

Estimating item difficulty through field-testing is often resource-intensive and time-consuming. As such, there is strong motivation to develop methods that can predict item difficulty at scale using only the item content. Large Language…

Computers and Society · Computer Science 2026-03-10 Pooya Razavi , Sonya Powers

We introduce a novel sensitivity analysis framework for large scale classification problems that can be used when a small number of instances are incrementally added or removed. For quickly updating the classifier in such a situation,…

Machine Learning · Statistics 2015-04-14 Shota Okumura , Yoshiki Suzuki , Ichiro Takeuchi

As model finetuning is central to the modern NLP, we set to maximize its efficiency. Motivated by redundancy in training examples and the sheer sizes of pretrained models, we exploit a key opportunity: training only on important data. To…

Computation and Language · Computer Science 2023-05-22 Xu Ouyang , Shahina Mohd Azam Ansari , Felix Xiaozhu Lin , Yangfeng Ji

Large Language Models (LLMs) are increasingly employed as AI tutors due to their scalability and potential for personalized instruction. However, off-the-shelf LLMs often underperform in educational settings: they frequently reveal answers…

Computation and Language · Computer Science 2025-08-13 Shuzhou Yuan , William LaCroix , Hardik Ghoshal , Ercong Nie , Michael Färber

Partial label learning is a prominent weakly supervised classification task, where each training instance is ambiguously labeled with a set of candidate labels. In real-world scenarios, candidate labels are often influenced by instance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Rui Zhao , Bin Shi , Kai Sun , Bo Dong

Learning with the \textit{instance-dependent} label noise is challenging, because it is hard to model such real-world noise. Note that there are psychological and physiological evidences showing that we humans perceive instances by…

Machine Learning · Computer Science 2020-12-04 Xiaobo Xia , Tongliang Liu , Bo Han , Nannan Wang , Mingming Gong , Haifeng Liu , Gang Niu , Dacheng Tao , Masashi Sugiyama

Data valuation has found various applications in machine learning, such as data filtering, efficient learning and incentives for data sharing. The most popular current approach to data valuation is the Shapley value. While popular for its…

Machine Learning · Computer Science 2023-11-10 Lauren Watson , Zeno Kujawa , Rayna Andreeva , Hao-Tsung Yang , Tariq Elahi , Rik Sarkar

Knowledge distillation (KD) enhances the performance of a student network by allowing it to learn the knowledge transferred from a teacher network incrementally. Existing methods dynamically adjust the temperature to enable the student…

Machine Learning · Computer Science 2026-02-03 Zhengbo Zhang , Yuxi Zhou , Jia Gong , Jun Liu , Zhigang Tu

Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends on the choice of…

Computation and Language · Computer Science 2024-06-19 Vinay M. S. , Minh-Hao Van , Xintao Wu

Data annotated by humans is a source of knowledge by describing the peculiarities of the problem and therefore fueling the decision process of the trained model. Unfortunately, the annotation process for subjective natural language…

Computation and Language · Computer Science 2023-12-14 Kamil Kanclerz , Julita Bielaniewicz , Marcin Gruza , Jan Kocon , Stanisław Woźniak , Przemysław Kazienko

How do we most effectively treat a disease or condition? Ideally, we could consult a database of evidence gleaned from clinical trials to answer such questions. Unfortunately, no such database exists; clinical trial results are instead…

Computation and Language · Computer Science 2020-05-15 Jay DeYoung , Eric Lehman , Ben Nye , Iain J. Marshall , Byron C. Wallace

We consider the problem of Learning from Label Proportions (LLP), a weakly supervised classification setup where instances are grouped into "bags", and only the frequency of class labels at each bag is available. Albeit, the objective of…

Machine Learning · Computer Science 2023-02-15 Robert Istvan Busa-Fekete , Heejin Choi , Travis Dick , Claudio Gentile , Andres Munoz medina

In this paper, we investigate the effect of addressing difficult samples from a given text dataset on the downstream text classification task. We define difficult samples as being non-obvious cases for text classification by analysing them…

Computation and Language · Computer Science 2023-02-14 Shashank Mujumdar , Stuti Mehta , Hima Patel , Suman Mitra

State-of-the-art natural language processing models have been shown to achieve remarkable performance in 'closed-world' settings where all the labels in the evaluation set are known at training time. However, in real-world settings, 'novel'…

Computation and Language · Computer Science 2023-05-10 Neeraj Varshney , Himanshu Gupta , Eric Robertson , Bing Liu , Chitta Baral

Although large-scale pre-trained language models (PTLMs) are shown to encode rich knowledge in their model parameters, the inherent knowledge in PTLMs can be opaque or static, making external knowledge necessary. However, the existing…

Computation and Language · Computer Science 2025-03-18 Xinran Zhao , Hongming Zhang , Xiaoman Pan , Wenlin Yao , Dong Yu , Jianshu Chen

Recent work on Natural Language Interfaces to Databases (NLIDB) has attracted considerable attention. NLIDB allow users to search databases using natural language instead of SQL-like query languages. While saving the users from having to…

Computation and Language · Computer Science 2019-01-25 Qian Liu , Bei Chen , Jian-Guang Lou , Ge Jin , Dongmei Zhang

Software Defect Prediction (SDP) models are central to proactive software quality assurance, yet their effectiveness is often constrained by the quality of available datasets. Prior research has typically examined single issues such as…

Software Engineering · Computer Science 2025-12-22 Emmanuel Charleson Dapaah , Jens Grabowski