English
Related papers

Related papers: AdaptCL: Adaptive Continual Learning for Tackling …

200 papers

Continual instruction tuning enables large language models (LLMs) to learn incrementally while retaining past knowledge, whereas existing methods primarily focus on how to retain old knowledge rather than on selecting which new knowledge to…

Computation and Language · Computer Science 2025-03-21 Peiyi Lin , Fukai Zhang , Kai Niu , Hao Fu

Cross-modal retrieval (CMR) typically involves learning common representations to directly measure similarities between multimodal samples. Most existing CMR methods commonly assume multimodal samples in pairs and employ joint training to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Ruitao Pu , Yang Qin , Dezhong Peng , Xiaomin Song , Huiming Zheng

Adversarial continual learning is effective for continual learning problems because of the presence of feature alignment process generating task-invariant features having low susceptibility to the catastrophic forgetting problem.…

Machine Learning · Computer Science 2022-09-07 Tanmoy Dam , Mahardhika Pratama , MD Meftahul Ferdaus , Sreenatha Anavatti , Hussein Abbas

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Real-world large-scale datasets are heteroskedastic and imbalanced -- labels have varying levels of uncertainty and label distributions are long-tailed. Heteroskedasticity and imbalance challenge deep learning algorithms due to the…

Machine Learning · Computer Science 2021-03-19 Kaidi Cao , Yining Chen , Junwei Lu , Nikos Arechiga , Adrien Gaidon , Tengyu Ma

Contrastive learning (CL), a self-supervised learning approach, can effectively learn visual representations from unlabeled data. Given the CL training data, generative models can be trained to generate synthetic data to supplement the real…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yawen Wu , Zhepeng Wang , Dewen Zeng , Yiyu Shi , Jingtong Hu

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Continual learning (CL) is crucial for evaluating adaptability in learning solutions to retain knowledge. Our research addresses the challenge of catastrophic forgetting, where models lose proficiency in previously learned tasks as they…

Contrastive learning has shown impressive success in enhancing feature discriminability for various visual tasks in a self-supervised manner, but the standard contrastive paradigm (features+$\ell_{2}$ normalization) has limited benefits…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Junjie Li , Yixin Zhang , Zilei Wang , Saihui Hou , Keyu Tu , Man Zhang

Deep learning approaches to the segmentation of magnetic resonance images have shown significant promise in automating the quantitative analysis of brain images. However, a continuing challenge has been its sensitivity to the variability of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-05 Dzung L. Pham , Yi-Yu Chou , Blake E. Dewey , Daniel S. Reich , John A. Butman , Snehashis Roy

Existing research on continual learning (CL) of a sequence of tasks focuses mainly on dealing with catastrophic forgetting (CF) to balance the learning plasticity of new tasks and the memory stability of old tasks. However, an ideal CL…

Machine Learning · Computer Science 2026-01-12 Zhi Wang , Zhongbin Wu , Yanni Li , Bing Liu , Guangxi Li , Yuping Wang

In the domain of recommendation and collaborative filtering, Graph Contrastive Learning (GCL) has become an influential approach. Nevertheless, the reasons for the effectiveness of contrastive learning are still not well understood. In this…

Information Retrieval · Computer Science 2024-10-01 Chengkai Liu , Jianling Wang , James Caverlee

Multi-view multi-label learning frequently suffers from simultaneous feature absence and incomplete annotations, due to challenges in data acquisition and cost-intensive supervision. To tackle the complex yet highly practical problem while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Quanjiang Li , Zhiming Liu , Tianxiang Xu , Tingjin Luo , Chenping Hou

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

Machine Learning · Computer Science 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

For anomaly detection (AD), early approaches often train separate models for individual classes, yielding high performance but posing challenges in scalability and resource management. Recent efforts have shifted toward training a single…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Lei Fan , Junjie Huang , Donglin Di , Anyang Su , Tianyou Song , Maurice Pagnucco , Yang Song

Universal time series representation learning is challenging but valuable in real-world applications such as classification, anomaly detection, and forecasting. Recently, contrastive learning (CL) has been actively explored to tackle time…

Machine Learning · Computer Science 2025-02-06 Namwoo Kim , Hyungryul Baik , Yoonjin Yoon

Self-supervised learning (SSL) has gained remarkable success, for which contrastive learning (CL) plays a key role. However, the recent development of new non-CL frameworks has achieved comparable or better performance with high improvement…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Thanh Nguyen , Trung Pham , Chaoning Zhang , Tung Luu , Thang Vu , Chang D. Yoo

Adaptive Resonance Theory (ART) is considered as an effective approach for realizing continual learning thanks to its ability to handle the plasticity-stability dilemma. In general, however, the clustering performance of ART-based…

Machine Learning · Computer Science 2022-07-08 Naoki Masuyama , Narito Amako , Yuna Yamada , Yusuke Nojima , Hisao Ishibuchi

When dealing with real-world optimization problems, decision-makers usually face high levels of uncertainty associated with partial information, unknown parameters, or complex relationships between these and the problem decision variables.…

Optimization and Control · Mathematics 2023-05-01 Antonio Alcántara , Carlos Ruiz

In modern biomedical and econometric studies, longitudinal processes are often characterized by complex time-varying associations and abrupt regime shifts that are shared across correlated outcomes. Standard functional data analysis (FDA)…

Methodology · Statistics 2026-01-28 Baolin Chen , Mengfei Ran