English
Related papers

Related papers: Exemplar Masking for Multimodal Incremental Learni…

200 papers

Exemplar-free class-incremental learning enables models to learn new classes over time without storing data from old ones. As multimodal graph-structured data becomes increasingly prevalent, existing methods struggle with challenges like…

Machine Learning · Computer Science 2025-09-09 Haochen You , Baojing Liu

Rehearsal-based continual learning (CL) mitigates catastrophic forgetting by maintaining a subset of samples from previous tasks for replay. Existing studies primarily focus on optimizing memory storage through coreset selection strategies.…

Machine Learning · Computer Science 2026-04-13 Minh-Duong Nguyen , Thien-Thanh Dao , Le-Tuan Nguyen , Dung D. Le , Kok-Seng Wong

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Unlike traditional Multimodal Class-Incremental Learning (MCIL) methods that focus only on vision and text, this paper explores MCIL across vision, audio and text modalities, addressing challenges in integrating complementary information…

Machine Learning · Computer Science 2025-06-13 Yukun Chen , Zihuan Qiu , Fanman Meng , Hongliang Li , Linfeng Xu , Qingbo Wu

Large language models (LLMs) excel in various tasks but are primarily trained on text data, limiting their application scope. Expanding LLM capabilities to include vision-language understanding is vital, yet training them on multimodal data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Shanshan Zhong , Shanghua Gao , Zhongzhan Huang , Wushao Wen , Marinka Zitnik , Pan Zhou

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

This paper proposes a simple but highly efficient expansion-based model for continual learning. The recent feature transformation, masking and factorization-based methods are efficient, but they grow the model only over the global or shared…

Machine Learning · Computer Science 2023-12-05 Soumya Roy , Vinay K Verma , Deepak Gupta

Multimodality Representation Learning, as a technique of learning to embed information from different modalities and their correlations, has achieved remarkable success on a variety of applications, such as Visual Question Answering (VQA),…

Artificial Intelligence · Computer Science 2024-03-04 Muhammad Arslan Manzoor , Sarah Albarri , Ziting Xian , Zaiqiao Meng , Preslav Nakov , Shangsong Liang

Deep learning models generally display catastrophic forgetting when learning new data continuously. Many incremental learning approaches address this problem by reusing data from previous tasks while learning new tasks. However, the direct…

Machine Learning · Computer Science 2024-11-12 Young Jo Choi , Min Kyoon Yoo , Yu Rang Park

We introduce a lifelong imitation learning framework that enables continual policy refinement across sequential tasks under realistic memory and data constraints. Our approach departs from conventional experience replay by operating…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Fanqi Yu , Matteo Tiezzi , Tommaso Apicella , Cigdem Beyan , Vittorio Murino

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Image-point class incremental learning helps the 3D-points-vision robots continually learn category knowledge from 2D images, improving their perceptual capability in dynamic environments. However, some incremental learning methods address…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chao Qi , Jianqin Yin , Ren Zhang

Image compression emerges as a pivotal tool in the efficient handling and transmission of digital images. Its ability to substantially reduce file size not only facilitates enhanced data storage capacity but also potentially brings…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Justin Yang , Zhihao Duan , Andrew Peng , Yuning Huang , Jiangpeng He , Fengqing Zhu

We propose a visual-linguistic representation learning approach within a self-supervised learning framework by introducing a new operation, loss, and data augmentation strategy. First, we generate diverse features for the image-text…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jaeyoo Park , Bohyung Han

Multimodal demonstrations provide robots with an abundance of information to make sense of the world. However, such abundance may not always lead to good performance when it comes to learning sensorimotor control policies from human…

Machine Learning · Computer Science 2023-03-07 Yilun Hao , Ruinan Wang , Zhangjie Cao , Zihan Wang , Yuchen Cui , Dorsa Sadigh

Despite the outstanding performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning from continuous data streams in real-world scenarios. Current Non-Exemplar Class-Incremental Learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Liang Bai , Hong Song , Yucong Lin , Tianyu Fu , Deqiang Xiao , Danni Ai , Jingfan Fan , Jian Yang

Understanding human perceptions presents a formidable multimodal challenge for computers, encompassing aspects such as sentiment tendencies and sense of humor. While various methods have recently been introduced to extract…

Multimedia · Computer Science 2023-11-21 Hao Sun , Ziwei Niu , Xinyao Yu , Jiaqing Liu , Yen-Wei Chen , Lanfen Lin

Significant advancements have been made in single label incremental learning (SLCIL),yet the more practical and challenging multi label class incremental learning (MLCIL) remains understudied. Recently,visual language models such as CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Haifeng Zhao , Yuguang Jin , Leilei Ma

Continual Learning is an unresolved challenge, whose relevance increases when considering modern applications. Unlike the human brain, trained deep neural networks suffer from a phenomenon called catastrophic forgetting, wherein they…

Machine Learning · Computer Science 2025-02-18 Shahar Shaul-Ariel , Daphna Weinshall

Large Multimodal Models (LMMs) exhibit remarkable multi-tasking ability by learning mixed instruction datasets. However, novel tasks would be encountered sequentially in dynamic world, which urges for equipping LMMs with multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Fanhu Zeng , Fei Zhu , Haiyang Guo , Xu-Yao Zhang , Cheng-Lin Liu