English
Related papers

Related papers: Evaluating LLP Methods: Challenges and Approaches

200 papers

Multi-label classification (MLC) is the task of assigning a set of target labels for a given sample. Modeling the combinatorial label interactions in MLC has been a long-haul challenge. We propose Label Message Passing (LaMP) Neural…

Machine Learning · Computer Science 2019-04-18 Jack Lanchantin , Arshdeep Sekhon , Yanjun Qi

Partial label learning (PLL) is a typical weakly supervised learning problem in which each instance is associated with a candidate label set, and among which only one is true. However, the assumption that the ground-truth label is always…

Artificial Intelligence · Computer Science 2023-08-30 Yu Shi , Ning Xu , Hua Yuan , Xin Geng

Machine learning practitioners often face significant challenges in formally integrating their prior knowledge and beliefs into predictive models, limiting the potential for nuanced and context-aware analyses. Moreover, the expertise needed…

Machine Learning · Statistics 2024-12-23 James Requeima , John Bronskill , Dami Choi , Richard E. Turner , David Duvenaud

Complementary-label learning (CLL) is a weakly supervised learning paradigm for multiclass classification, where only complementary labels -- indicating classes an instance does not belong to -- are provided to the learning algorithm.…

Machine Learning · Computer Science 2024-11-20 Nai-Xuan Ye , Tan-Ha Mai , Hsiu-Hsuan Wang , Wei-I Lin , Hsuan-Tien Lin

Language models (LMs) have demonstrated remarkable capabilities in NLP, yet adapting them efficiently and robustly to specific tasks remains challenging. As their scale and complexity grow, fine-tuning LMs on labelled data often…

Computation and Language · Computer Science 2025-06-27 Zhengyan Shi

The integration of large language models (LLMs) into automated algorithm design has shown promising potential. A prevalent approach embeds LLMs within search routines to iteratively generate and refine candidate algorithms. However, most…

Machine Learning · Computer Science 2026-05-20 Fei Liu , Rui Zhang , Xi Lin , Zhichao Lu , Qingfu Zhang

Label ranking is a prediction task which deals with learning a mapping between an instance and a ranking (i.e., order) of labels from a finite set, representing their relevance to the instance. Boosting is a well-known and reliable ensemble…

Machine Learning · Computer Science 2020-09-24 Lihi Dery , Erez Shmueli

Complementary-label learning is a weakly supervised learning problem in which each training example is associated with one or multiple complementary labels indicating the classes to which it does not belong. Existing consistent approaches…

Machine Learning · Computer Science 2024-10-14 Wei Wang , Takashi Ishida , Yu-Jie Zhang , Gang Niu , Masashi Sugiyama

In modern multilabel classification problems, each data instance belongs to a small number of classes from a large set of classes. In other words, these problems involve learning very sparse binary label vectors. Moreover, in large-scale…

Machine Learning · Computer Science 2020-11-03 Shashanka Ubaru , Sanjeeb Dash , Arya Mazumdar , Oktay Gunluk

Labeled data are critical to modern machine learning applications, but obtaining labels can be expensive. To mitigate this cost, machine learning methods, such as transfer learning, semi-supervised learning and active learning, aim to be…

Two challenges lie in the facial attractiveness computation research: the lack of true attractiveness labels (scores), and the lack of an accurate face representation. In order to address the first challenge, this paper recasts facial…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Shu Liu , Bo Li , Yangyu Fan , Zhe Guo , Ashok Samal

Large language models (LLMs) have demonstrated remarkable capabilities but often struggle to align with human preferences, leading to harmful or undesirable outputs. Preference learning, which trains models to distinguish between preferred…

Machine Learning · Computer Science 2025-10-16 Shawn Im , Sharon Li

There has been a recent push in making machine learning models more interpretable so that their performance can be trusted. Although successful, these methods have mostly focused on the deep learning methods while the fundamental…

Machine Learning · Computer Science 2022-06-16 David Steinmann , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

The success of Large Language Models (LLMs) relies heavily on the huge amount of pre-training data learned in the pre-training phase. The opacity of the pre-training process and the training data causes the results of many benchmark tests…

Computation and Language · Computer Science 2025-03-03 Shiwen Ni , Xiangtao Kong , Chengming Li , Xiping Hu , Ruifeng Xu , Jia Zhu , Min Yang

In this position paper, we argue that the classical evaluation on Natural Language Processing (NLP) tasks using annotated benchmarks is in trouble. The worst kind of data contamination happens when a Large Language Model (LLM) is trained on…

Computation and Language · Computer Science 2023-10-30 Oscar Sainz , Jon Ander Campos , Iker García-Ferrero , Julen Etxaniz , Oier Lopez de Lacalle , Eneko Agirre

The cost of labeling data often limits the performance of machine learning systems. In multi-task learning, related tasks provide information to each other and improve overall performance, but the label cost can vary among tasks. How should…

Machine Learning · Computer Science 2023-08-25 Ximeng Sun , Kihyuk Sohn , Kate Saenko , Clayton Mellina , Xiao Bian

Meta learning generalizes the empirical experience with different learning tasks and holds promise for providing important empirical insight into the behaviour of machine learning algorithms. In this paper, we present a comprehensive…

Machine Learning · Computer Science 2021-06-30 Jasmin Bogatinovski , Ljupčo Todorovski , Sašo Džeroski , Dragi Kocev

Partial label learning deals with the problem where each training instance is assigned a set of candidate labels, only one of which is correct. This paper provides the first attempt to leverage the idea of self-training for dealing with…

Machine Learning · Computer Science 2019-02-11 Lei Feng , Bo An

In multi-label learning, leveraging contrastive learning to learn better representations faces a key challenge: selecting positive and negative samples and effectively utilizing label information. Previous studies selected positive and…

Machine Learning · Computer Science 2025-02-03 Ning Chen , Shen-Huan Lyu , Tian-Shuang Wu , Yanyan Wang , Bin Tang

Robotic path planning problems are often NP-hard, and practical solutions typically rely on approximation algorithms with provable performance guarantees for general cases. While designing such algorithms is challenging, formally proving…

Robotics · Computer Science 2026-03-23 Zhengbang Yang , Md. Tasin Tazwar , Minghan Wei , Zhuangdi Zhu