中文
相关论文

相关论文: Don't Stop Learning: Towards Continual Learning fo…

200 篇论文

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing…

机器学习 · 计算机科学 2024-04-02 Maorong Wang , Nicolas Michel , Ling Xiao , Toshihiko Yamasaki

Continual learning -- the ability to acquire knowledge incrementally without forgetting previous skills -- is fundamental to natural intelligence. While the human brain excels at this, artificial neural networks struggle with "catastrophic…

机器学习 · 计算机科学 2025-09-16 Aoi Otani

CLIP is a seminal multimodal model that maps images and text into a shared representation space through contrastive learning on billions of image-caption pairs. Inspired by the rapid progress of large language models (LLMs), we investigate…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Weiquan Huang , Aoqi Wu , Yifan Yang , Xufang Luo , Yuqing Yang , Usman Naseem , Chunyu Wang , Chunyu Wang , Qi Dai , Xiyang Dai , Dongdong Chen , Chong Luo , Lili Qiu , Liang Hu

Large-scale but noisy image-text pair data have paved the way for the success of Contrastive Language-Image Pretraining (CLIP). As the foundation vision encoder, CLIP in turn serves as the cornerstone for most large vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Zhixiang Wei , Guangting Wang , Xiaoxiao Ma , Ke Mei , Huaian Chen , Yi Jin , Fengyun Rao

The recent large-scale Contrastive Language-Image Pretraining (CLIP) model has shown great potential in various downstream tasks via leveraging the pretrained vision and language knowledge. Scene text, which contains rich textual and visual…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Wenwen Yu , Yuliang Liu , Wei Hua , Deqiang Jiang , Bo Ren , Xiang Bai

Contrastive language-image pretraining (CLIP) links vision and language modalities into a unified embedding space, yielding the tremendous potential for vision-language (VL) tasks. While early concurrent works have begun to study this…

计算机视觉与模式识别 · 计算机科学 2023-01-02 Zhecan Wang , Noel Codella , Yen-Chun Chen , Luowei Zhou , Jianwei Yang , Xiyang Dai , Bin Xiao , Haoxuan You , Shih-Fu Chang , Lu Yuan

We tackle catastrophic forgetting problem in the context of class-incremental learning for video recognition, which has not been explored actively despite the popularity of continual learning. Our framework addresses this challenging task…

计算机视觉与模式识别 · 计算机科学 2022-03-28 Jaeyoo Park , Minsoo Kang , Bohyung Han

Large-scale Pre-Training Vision-Language Model such as CLIP has demonstrated outstanding performance in zero-shot classification, e.g. achieving 76.3% top-1 accuracy on ImageNet without seeing any example, which leads to potential benefits…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Xuefeng Hu , Ke Zhang , Lu Xia , Albert Chen , Jiajia Luo , Yuyin Sun , Ken Wang , Nan Qiao , Xiao Zeng , Min Sun , Cheng-Hao Kuo , Ram Nevatia

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

计算机视觉与模式识别 · 计算机科学 2023-01-04 Francesco Pelosin

Recent image tone adjustment (or enhancement) approaches have predominantly adopted supervised learning for learning human-centric perceptual assessment. However, these approaches are constrained by intrinsic challenges of supervised…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Hyeongmin Lee , Kyoungkook Kang , Jungseul Ok , Sunghyun Cho

Image enhancement is a significant research area in the fields of computer vision and image processing. In recent years, many learning-based methods for image enhancement have been developed, where the Look-up-table (LUT) has proven to be…

计算机视觉与模式识别 · 计算机科学 2023-11-23 Weiwen Chen , Qiuhong Ke , Zinuo Li

Continual learning (CL) aims to incrementally learn different tasks (such as classification) in a non-stationary data stream without forgetting old ones. Most CL works focus on tackling catastrophic forgetting under a learning-from-scratch…

机器学习 · 计算机科学 2024-01-17 Mark D. McDonnell , Dong Gong , Amin Parveneh , Ehsan Abbasnejad , Anton van den Hengel

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

Continual learning (CL) has emerged as a pivotal paradigm to enable large language models (LLMs) to dynamically adapt to evolving knowledge and sequential tasks while mitigating catastrophic forgetting-a critical limitation of the static…

计算与语言 · 计算机科学 2026-03-16 Hongyang Chen , Zhongwu Sun , Hongfei Ye , Kunchi Li , Xuemin Lin

Contrastive Language-Image Pretraining (CLIP) has gained popularity for its remarkable zero-shot capacity. Recent research has focused on developing efficient fine-tuning methods, such as prompt learning and adapter, to enhance CLIP's…

计算机视觉与模式识别 · 计算机科学 2024-02-07 Zhengbo Wang , Jian Liang , Lijun Sheng , Ran He , Zilei Wang , Tieniu Tan

Vision-Language Pretraining (VLP) has shown impressive results on diverse downstream tasks by offline training on large-scale datasets. Regarding the growing nature of real-world data, such an offline training paradigm on ever-expanding…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Hongguang Zhu , Yunchao Wei , Xiaodan Liang , Chunjie Zhang , Yao Zhao

While advanced image captioning systems are increasingly describing images coherently and exactly, recent progress in continual learning allows deep learning models to avoid catastrophic forgetting. However, the domain where image…

计算机视觉与模式识别 · 计算机科学 2020-04-22 Giang Nguyen , Tae Joon Jun , Trung Tran , Tolcha Yalew , Daeyoung Kim

Recent progress has shown that large-scale pre-training using contrastive image-text pairs can be a promising alternative for high-quality visual representation learning from natural language supervision. Benefiting from a broader source of…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Yongming Rao , Wenliang Zhao , Guangyi Chen , Yansong Tang , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

机器学习 · 计算机科学 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

计算机视觉与模式识别 · 计算机科学 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins