English
Related papers

Related papers: LLEDA -- Lifelong Self-Supervised Domain Adaptatio…

200 papers

Deep learning has become the leading approach to assisted target recognition. While these methods typically require large amounts of labeled training data, domain adaptation (DA) or transfer learning (TL) enables these algorithms to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Deborah Weeks , Samuel Rivera

Lifelong learning (LL) aims to improve a predictive model as the data source evolves continuously. Most work in this learning paradigm has focused on resolving the problem of 'catastrophic forgetting,' which refers to a notorious dilemma…

Machine Learning · Computer Science 2023-03-09 Jinghan Jia , Yihua Zhang , Dogyoon Song , Sijia Liu , Alfred Hero

Lifelong sequence generation (LSG), a problem in continual learning, aims to continually train a model on a sequence of generation tasks to learn constantly emerging new generation patterns while avoiding the forgetting of previous…

Computation and Language · Computer Science 2023-11-23 Chengwei Qin , Chen Chen , Shafiq Joty

In real-world scenarios, person Re-IDentification (Re-ID) systems need to be adaptable to changes in space and time. Therefore, the adaptation of Re-ID models to new domains while preserving previously acquired knowledge is crucial, known…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Qizao Wang , Xuelin Qian , Bin Li , Xiangyang Xue

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial…

Machine Learning · Computer Science 2020-03-23 German I. Parisi , Vincenzo Lomonaco

Person ReID methods always learn through a stationary domain that is fixed by the choice of a given dataset. In many contexts (e.g., lifelong learning), those methods are ineffective because the domain is continually changing in which case…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Nan Pu , Wei Chen , Yu Liu , Erwin M. Bakker , Michael S. Lew

In lifelong learning systems based on artificial neural networks, one of the biggest obstacles is the inability to retain old knowledge as new information is encountered. This phenomenon is known as catastrophic forgetting. In this paper,…

Machine Learning · Computer Science 2022-08-16 Alexander Ororbia , Ankur Mali , Daniel Kifer , C. Lee Giles

Lifelong Person Re-Identification (LReID) extends traditional ReID by requiring systems to continually learn from non-overlapping datasets across different times and locations, adapting to new identities while preserving knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Xuelin Qian , Ruiqi Wu , Gong Cheng , Junwei Han

Artificial neural networks (ANNs) exhibit a narrow scope of expertise on stationary independent data. However, the data in the real world is continuous and dynamic, and ANNs must adapt to novel scenarios while also retaining the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Shruthi Gowda , Bahram Zonooz , Elahe Arani

Unsupervised Domain Adaptation (UDA) aims to align the labeled source distribution with the unlabeled target distribution to obtain domain invariant predictive models. However, the application of well-known UDA approaches does not…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Ankit Singh

Domain adaptation (DA) enables knowledge transfer from a labeled source domain to an unlabeled target domain by reducing the cross-domain distribution discrepancy. Most prior DA approaches leverage complicated and powerful deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Shuang Li , Jinming Zhang , Wenxuan Ma , Chi Harold Liu , Wei Li

LLMs are trained once, then deployed into a world that never stops changing. External memory compensates for this, but most systems manage it explicitly rather than letting it adapt on its own. Biological memory works differently: coupled…

Machine Learning · Computer Science 2026-05-08 Andreas Pattichis , Constantine Dovrolis

Continual Learning (CL) methods aim to enable machine learning models to learn new tasks without catastrophic forgetting of those that have been previously mastered. Existing CL approaches often keep a buffer of previously-seen samples,…

Machine Learning · Computer Science 2022-02-22 Dong Gong , Qingsen Yan , Yuhang Liu , Anton van den Hengel , Javen Qinfeng Shi

Attempts to train a comprehensive artificial intelligence capable of solving multiple tasks have been impeded by a chronic problem called catastrophic forgetting. Although simply replaying all previous data alleviates the problem, it…

Artificial Intelligence · Computer Science 2017-12-13 Hanul Shin , Jung Kwon Lee , Jaehong Kim , Jiwon Kim

Test-time domain adaptation aims to adapt a source pre-trained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Qin Wang , Olga Fink , Luc Van Gool , Dengxin Dai

This work presents a lifelong learning approach to train a multilingual Text-To-Speech (TTS) system, where each language was seen as an individual task and was learned sequentially and continually. It does not require pooled data from all…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-20 Mu Yang , Shaojin Ding , Tianlong Chen , Tong Wang , Zhangyang Wang

Domain Adaptation (DA) facilitates knowledge transfer from a source domain to a related target domain. This paper investigates a practical DA paradigm, namely Source data-Free Active Domain Adaptation (SFADA), where source data becomes…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Mengyao Lyu , Tianxiang Hao , Xinhao Xu , Hui Chen , Zijia Lin , Jungong Han , Guiguang Ding

In this work, we revisit the semi-supervised learning (SSL) problem from a new perspective of explicitly reducing empirical distribution mismatch between labeled and unlabeled samples. Benefited from this new perspective, we first propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Feiyu Wang , Qin Wang , Wen Li , Dong Xu , Luc Van Gool

In many scenarios, 1) data streams are generated in real time; 2) labeled data are expensive and only limited labels are available in the beginning; 3) real-world data is not always i.i.d. and data drift over time gradually; 4) the storage…

Machine Learning · Computer Science 2022-05-27 Weijieying Ren , Pengyang Wang , Xiaolin Li , Charles E. Hughes , Yanjie Fu

Attention is an important cognition process of humans, which helps humans concentrate on critical information during their perception and learning. However, although many machine learning models can remember information of data, they have…

Machine Learning · Computer Science 2019-09-06 Guoqiang Zhong , Xin Lin , Kang Chen , Qingyang Li , Kaizhu Huang