English
Related papers

Related papers: Continual Semantic Segmentation with Automatic Mem…

200 papers

Deep Neural Networks (DNNs) based semantic segmentation of the robotic instruments and tissues can enhance the precision of surgical activities in robot-assisted surgery. However, in biological learning, DNNs cannot learn incremental tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Mengya Xu , Mobarakol Islam , Long Bai , Hongliang Ren

Online continual learning aims to learn from a non-IID stream of data from a number of different tasks, where the learner is only allowed to consider data once. Methods are typically allowed to use a limited buffer to store some of the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Kai Wang , Luis Herranz , Joost van de Weijer

Continual learning in large language models (LLMs) is prone to catastrophic forgetting, where adapting to new tasks significantly degrades performance on previously learned ones. Existing methods typically rely on low-rank,…

Ensemble of predictions is known to perform better than individual predictions taken separately. However, for tasks that require heavy computational resources, e.g. semantic segmentation, creating an ensemble of learners that needs to be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Walid Bousselham , Guillaume Thibault , Lucas Pagano , Archana Machireddy , Joe Gray , Young Hwan Chang , Xubo Song

Continual learning is considered a promising step towards next-generation Artificial Intelligence (AI), where deep neural networks (DNNs) make decisions by continuously learning a sequence of different tasks akin to human learning…

Machine Learning · Computer Science 2021-05-06 Yuyang Gao , Giorgio A. Ascoli , Liang Zhao

Continuous speech separation (CSS) aims to separate overlapping voices from a continuous influx of conversational audio containing an unknown number of utterances spoken by an unknown number of speakers. A common application scenario is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-14 Zhuohuang Zhang , Takuya Yoshioka , Naoyuki Kanda , Zhuo Chen , Xiaofei Wang , Dongmei Wang , Sefik Emre Eskimez

The continual learning (CL) ability is vital for deploying large language models (LLMs) in the dynamic world. Existing methods devise the learning module to acquire task-specific knowledge with parameter-efficient tuning (PET) block and the…

Computation and Language · Computer Science 2024-06-07 Weixiang Zhao , Shilong Wang , Yulin Hu , Yanyan Zhao , Bing Qin , Xuanyu Zhang , Qing Yang , Dongliang Xu , Wanxiang Che

Cued Speech (CS) is a visual communication system for the deaf or hearing impaired people. It combines lip movements with hand cues to obtain a complete phonetic repertoire. Current deep learning based methods on automatic CS recognition…

Multimedia · Computer Science 2021-06-28 Jianrong Wang , Ziyue Tang , Xuewei Li , Mei Yu , Qiang Fang , Li Liu

Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequately addressed by…

Referring Video Object Segmentation (RefVOS) seeks to segment target objects in videos guided by natural language descriptions, demanding both temporal reasoning and fine-grained visual comprehension. Existing sampling strategies for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Ming Dai , Sen Yang , Boqiang Duan , Wankou Yang , Jingdong Wang

Coreset Selection (CS) aims to identify a subset of the training dataset that achieves model performance comparable to using the entire dataset. Many state-of-the-art CS methods select coresets using scores whose computation requires…

Machine Learning · Computer Science 2025-06-05 Akshay Mehra , Trisha Mittal , Subhadra Gopalakrishnan , Joshua Kimball

Continual learning enables large language models to adapt to evolving tasks without retraining from scratch, yet catastrophic forgetting remains a central obstacle. Among continual learning methods, regularization-based approaches are…

Machine Learning · Computer Science 2026-05-26 Mingxu Zhang , Yuhan Li , Lujundong Li , Dazhong Shen , Hui Xiong , Ying Sun

We investigate the performance on phoneme categorization and phoneme and word segmentation of several self-supervised learning (SSL) methods based on Contrastive Predictive Coding (CPC). Our experiments show that with the existing…

In natural speech, the speaker does not pause between words, yet a human listener somehow perceives this continuous stream of phonemes as a series of distinct words. The detection of boundaries between spoken words is an instance of a…

Computation and Language · Computer Science 2011-06-28 Jerry R. Van Aken

Continual learning consists in incrementally training a model on a sequence of datasets and testing on the union of all datasets. In this paper, we examine continual learning for the problem of sound classification, in which we wish to…

Machine Learning · Computer Science 2019-06-04 Zhepei Wang , Cem Subakan , Efthymios Tzinis , Paris Smaragdis , Laurent Charlin

Continual Learning is a step towards lifelong intelligence where models continuously learn from recently collected data without forgetting previous knowledge. Existing continual learning approaches mostly focus on image classification in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Motasem Alfarra , Zhipeng Cai , Adel Bibi , Bernard Ghanem , Matthias Müller

Rehearsal is a critical component for class-incremental continual learning, yet it requires a substantial memory budget. Our work investigates whether we can significantly reduce this memory budget by leveraging unlabeled data from an…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 James Smith , Jonathan Balloch , Yen-Chang Hsu , Zsolt Kira

Document-level neural machine translation has yielded attractive improvements. However, majority of existing methods roughly use all context sentences in a fixed scope. They neglect the fact that different source sentences need different…

Computation and Language · Computer Science 2020-10-12 Xiaomian Kang , Yang Zhao , Jiajun Zhang , Chengqing Zong

State-of-the-art systems for semantic image segmentation use feed-forward pipelines with fixed computational costs. Building an image segmentation system that works across a range of computational budgets is challenging and time-intensive…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Lane McIntosh , Niru Maheswaranathan , David Sussillo , Jonathon Shlens

Most continual segmentation methods tackle the problem as a per-pixel classification task. However, such a paradigm is very challenging, and we find query-based segmenters with built-in objectness have inherent advantages compared with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yizheng Gong , Siyue Yu , Xiaoyang Wang , Jimin Xiao