English
Related papers

Related papers: IIRC: Incremental Implicitly-Refined Classificatio…

200 papers

Although BERT is widely used by the NLP community, little is known about its inner workings. Several attempts have been made to shed light on certain aspects of BERT, often with contradicting conclusions. A much raised concern focuses on…

Computation and Language · Computer Science 2020-10-13 Nikolaos Manginas , Ilias Chalkidis , Prodromos Malakasiotis

While standard IR models are mainly designed to optimize relevance, real-world search often needs to balance additional objectives such as diversity and fairness. These objectives depend on inter-document interactions and are commonly…

Information Retrieval · Computer Science 2025-05-26 Nilanjan Sinhababu , Andrew Parry , Debasis Ganguly , Pabitra Mitra

In contrast to the incremental classification task, the incremental detection task is characterized by the presence of data ambiguity, as an image may have differently labeled bounding boxes across multiple continuous learning stages. This…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Ziyue Huang , Yupeng He , Qingjie Liu , Yunhong Wang

This paper tackles the problem of learning a finer representation than the one provided by training labels. This enables fine-grained category retrieval of images in a collection annotated with coarse labels only. Our network is learned…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Hugo Touvron , Alexandre Sablayrolles , Matthijs Douze , Matthieu Cord , Hervé Jégou

In-Context Learning (ICL) enables Large Language Models (LLMs) to perform new tasks by conditioning on prompts with relevant information. Retrieval-Augmented Generation (RAG) enhances ICL by incorporating retrieved documents into the LLM's…

Machine Learning · Computer Science 2024-12-02 Marie Al Ghossein , Emile Contal , Alexandre Robicquet

Instance-incremental learning (IIL) focuses on learning continually with data of the same classes. Compared to class-incremental learning (CIL), the IIL is seldom explored because IIL suffers less from catastrophic forgetting (CF). However,…

Machine Learning · Computer Science 2024-06-06 Qiang Nie , Weifu Fu , Yuhuan Lin , Jialin Li , Yifeng Zhou , Yong Liu , Lei Zhu , Chengjie Wang

Deep neural networks perform remarkably well in close-world scenarios. However, novel classes emerged continually in real applications, making it necessary to learn incrementally. Class-incremental learning (CIL) aims to gradually recognize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

This study focuses on incremental learning for image classification, exploring how to reduce catastrophic forgetting of all learned knowledge when access to old data is restricted. The challenge lies in balancing plasticity (learning new…

Machine Learning · Computer Science 2026-03-12 Zhiping Zhou , Xuchen Xie , Yiqiao Qiu , Run Lin , Weishi Zheng , Ruixuan Wang

After pre-training by generating the next word conditional on previous words, the Language Model (LM) acquires the ability of In-Context Learning (ICL) that can learn a new task conditional on the context of the given in-context examples…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Haokun Chen , Xu Yang , Yuhang Huang , Zihan Wu , Jing Wang , Xin Geng

A weakly-supervised learning framework named as complementary-label learning has been proposed recently, where each sample is equipped with a single complementary label that denotes one of the classes the sample does not belong to. However,…

Machine Learning · Statistics 2020-07-24 Yuzhou Cao , Shuqi Liu , Yitian Xu

Conventional multi-label classification (MLC) methods assume that all samples are fully labeled and identically distributed. Unfortunately, this assumption is unrealistic in large-scale MLC data that has long-tailed (LT) distribution and…

Machine Learning · Computer Science 2023-04-24 Wenqiao Zhang , Changshuo Liu , Lingze Zeng , Beng Chin Ooi , Siliang Tang , Yueting Zhuang

This paper outlines our approach to the 5th CLVision challenge at CVPR, which addresses the Class-Incremental with Repetition (CIR) scenario. In contrast to traditional class incremental learning, this novel setting introduces unique…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Panagiota Moraiti , Efstathios Karypidis

Instance-level image classification tasks have traditionally relied on single-instance labels to train models, e.g., few-shot learning and transfer learning. However, set-level coarse-grained labels that capture relationships among…

Machine Learning · Computer Science 2023-11-21 Renyu Zhang , Aly A. Khan , Yuxin Chen , Robert L. Grossman

Continual learning enables incremental learning of new tasks without forgetting those previously learned, resulting in positive knowledge transfer that can enhance performance on both new and old tasks. However, continual learning poses new…

Machine Learning · Computer Science 2023-08-01 Dawid Rymarczyk , Joost van de Weijer , Bartosz Zieliński , Bartłomiej Twardowski

Regression via classification (RvC) is a common method used for regression problems in deep learning, where the target variable belongs to a set of continuous values. By discretizing the target into a set of non-overlapping classes, it has…

Machine Learning · Computer Science 2022-04-11 Axel Berg , Magnus Oskarsson , Mark O'Connor

In this paper, we propose a method for class-incremental learning of potentially overlapping sounds for solving a sequence of multi-label audio classification tasks. We design an incremental learner that learns new classes independently of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Manjunath Mulimani , Annamaria Mesaros

Continual learning (CL) enables models to adapt to new tasks and environments without forgetting previously learned knowledge. While current CL setups have ignored the relationship between labels in the past task and the new task with or…

Machine Learning · Computer Science 2023-08-29 Byung Hyun Lee , Okchul Jung , Jonghyun Choi , Se Young Chun

We propose a method for jointly inferring labels across a collection of data samples, where each sample consists of an observation and a prior belief about the label. By implicitly assuming the existence of a generative model for which a…

Machine Learning · Computer Science 2022-06-22 Esther Rolf , Nikolay Malkin , Alexandros Graikos , Ana Jojic , Caleb Robinson , Nebojsa Jojic

A complementary label (CL) simply indicates an incorrect class of an example, but learning with CLs results in multi-class classifiers that can predict the correct class. Unfortunately, the problem setting only allows a single CL for each…

Machine Learning · Computer Science 2022-08-09 Lei Feng , Takuo Kaneko , Bo Han , Gang Niu , Bo An , Masashi Sugiyama

Learning representations for individual instances when only bag-level labels are available is a fundamental challenge in multiple instance learning (MIL). Recent works have shown promising results using contrastive self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Kangning Liu , Weicheng Zhu , Yiqiu Shen , Sheng Liu , Narges Razavian , Krzysztof J. Geras , Carlos Fernandez-Granda