中文
相关论文

相关论文: COBRA: A Continual Learning Approach to Vision-Bra…

200 篇论文

Foundation models pretrained on large-scale 3D medical imaging data face challenges when adapted to multiple downstream tasks under continual learning with limited labeled data. We address few-shot continual learning for 3D brain MRI by…

图像与视频处理 · 电气工程与系统科学 2026-03-02 Chi-Sheng Chen , Xinyu Zhang , Guan-Ying Chen , Qiuzhe Xie , Fan Zhang , En-Jui Kuo

The ability of deep neural networks to continually learn and adapt to a sequence of tasks has remained challenging due to catastrophic forgetting of previously learned tasks. Humans, on the other hand, have a remarkable ability to acquire,…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Kishaan Jeeveswaran , Prashant Bhat , Bahram Zonooz , Elahe Arani

In this paper, we propose Conceptual Codebook Learning (CoCoLe), a novel fine-tuning method for vision-language models (VLMs) to address the challenge of improving the generalization capability of VLMs while fine-tuning them on downstream…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Yi Zhang , Ke Yu , Siqi Wu , Zhihai He

Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges…

机器学习 · 计算机科学 2022-07-26 Kun Wu , Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang , Dejun Yang

Deep segmentation networks achieve high performance when trained on specific datasets. However, in clinical practice, it is often desirable that pretrained segmentation models can be dynamically extended to enable segmenting new organs…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Vince Zhu , Zhanghexuan Ji , Dazhou Guo , Puyang Wang , Yingda Xia , Le Lu , Xianghua Ye , Wei Zhu , Dakai Jin

The goal of continual learning (CL) is to learn a sequence of tasks without suffering from the phenomenon of catastrophic forgetting. Previous work has shown that leveraging memory in the form of a replay buffer can reduce performance…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Sayna Ebrahimi , Suzanne Petryk , Akash Gokul , William Gan , Joseph E. Gonzalez , Marcus Rohrbach , Trevor Darrell

In continual learning, our aim is to learn a new task without forgetting what was learned previously. In topic models, this translates to learning new topic models without forgetting previously learned topics. Previous work either…

机器学习 · 计算机科学 2025-08-22 Charu Karakkaparambil James , Waleed Mustafa , Marius Kloft , Sophie Fellenz

Understanding how the brain represents visual information is a fundamental challenge in neuroscience and artificial intelligence. While AI-driven decoding of neural data has provided insights into the human visual system, integrating…

神经与进化计算 · 计算机科学 2025-10-07 Dongyang Li , Haoyang Qin , Mingyang Wu , Chen Wei , Quanying Liu

While advanced image captioning systems are increasingly describing images coherently and exactly, recent progress in continual learning allows deep learning models to avoid catastrophic forgetting. However, the domain where image…

计算机视觉与模式识别 · 计算机科学 2020-04-22 Giang Nguyen , Tae Joon Jun , Trung Tran , Tolcha Yalew , Daeyoung Kim

Complex Visual Question Answering (Complex VQA) tasks, which demand sophisticated multi-modal reasoning and external knowledge integration, present significant challenges for existing large vision-language models (LVLMs) often limited by…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Jingwei Peng , Jiehao Chen , Mateo Alejandro Rojas , Meilin Zhang

This study aims to address the problem of multi-domain task incremental learning~(MTIL), which requires that vision-language models~(VLMs) continuously acquire new knowledge while maintaining their inherent zero-shot recognition capability.…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Songlin Dong , Chenhao Ding , Jiangyang Li , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

In continual learning, solving the catastrophic forgetting problem may make the models fall into the stability-plasticity dilemma. Moreover, inter-task confusion will also occur due to the lack of knowledge exchanges between different…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Sheng-Kai Huang , Jiun-Feng Chang , Chun-Rong Huang

Recent State Space Models (SSM), especially Mamba, have demonstrated impressive performance in visual modeling and possess superior model efficiency. However, the application of Mamba to visual tasks suffers inferior performance due to…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Fei Xie , Jiahao Nie , Yujin Tang , Wenkang Zhang , Hongshen Zhao

A fundamental challenge in artificial intelligence involves understanding the cognitive mechanisms underlying visual reasoning in sophisticated models like Vision-Language Models (VLMs). How do these models integrate visual perception with…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Mohit Vaishnav , Tanel Tammet

Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential advantages such as…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Continual learning aims to train a model incrementally on a sequence of tasks without forgetting previous knowledge. Although continual learning has been widely studied in computer vision, its application to Vision+Language tasks is not…

机器学习 · 计算机科学 2024-01-23 Mavina Nikandrou , Lu Yu , Alessandro Suglia , Ioannis Konstas , Verena Rieser

Person re-identification is an important task in video surveillance that aims to associate people across camera views at different locations and time. View variability is always a challenging problem seriously degrading person…

计算机视觉与模式识别 · 计算机科学 2019-10-10 Fangyi Liu , Lei Zhang

Continual Learning is considered a key step toward next-generation Artificial Intelligence. Among various methods, replay-based approaches that maintain and replay a small episodic memory of previous samples are one of the most successful…

机器学习 · 计算机科学 2022-12-27 Guangji Bai , Chen Ling , Yuyang Gao , Liang Zhao

Multimodal Large Language Models (MLLMs) achieve remarkable capabilities but can inadvertently memorize privacy-sensitive information. Although existing unlearning methods can remove such knowledge, they fail to achieve benign forgetting…

人工智能 · 计算机科学 2025-11-26 Zhen Zeng , Leijiang Gu , Zhangling Duan , Feng Li , Zenglin Shi , Cees G. M. Snoek , Meng Wang

Continual Machine Reading Comprehension aims to incrementally learn from a continuous data stream across time without access the previous seen data, which is crucial for the development of real-world MRC systems. However, it is a great…

计算与语言 · 计算机科学 2022-08-11 Zhijing Wu , Hua Xu , Jingliang Fang , Kai Gao