English
Related papers

Related papers: SATS: Self-Attention Transfer for Continual Semant…

200 papers

In this paper, we consider the problem of unsupervised domain adaptation in the semantic segmentation. There are two primary issues in this field, i.e., what and how to transfer domain knowledge across two domains. Existing methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Jinyu Yang , Weizhi An , Chaochao Yan , Peilin Zhao , Junzhou Huang

Sparse neural systems are gaining traction for efficient continual learning due to their modularity and low interference. Architectures such as Sparse Distributed Memory Multi-Layer Perceptrons (SDMLP) construct task-specific subnetworks…

Machine Learning · Computer Science 2025-12-18 Huiyan Xue , Xuming Ran , Yaxin Li , Qi Xu , Enhui Li , Yi Xu , Qiang Zhang

Knowledge distillation becomes a de facto standard to improve the performance of small neural networks. Most of the previous works propose to regress the representational features from the teacher to the student in a one-to-one spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Sihao Lin , Hongwei Xie , Bing Wang , Kaicheng Yu , Xiaojun Chang , Xiaodan Liang , Gang Wang

Class-incremental/Continual image segmentation (CIS) aims to train an image segmenter in stages, where the set of available categories differs at each stage. To leverage the built-in objectness of query-based transformers, which mitigates…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Yuchen Zhu , Cheng Shi , Dingyou Wang , Jiajin Tang , Zhengxuan Wei , Yu Wu , Guanbin Li , Sibei Yang

Semantic segmentation is the task of assigning a class-label to each pixel in an image. We propose a region-based semantic segmentation framework which handles both full and weak supervision, and addresses three common problems: (1) Objects…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Holger Caesar , Jasper Uijlings , Vittorio Ferrari

Learning new information without forgetting prior knowledge is central to human intelligence. In contrast, neural network models suffer from catastrophic forgetting: a significant degradation in performance on previously learned tasks when…

Machine Learning · Computer Science 2025-07-16 James P Jun , Vijay Marupudi , Raj Sanjay Shah , Sashank Varma

Conventional transfer learning leverages weights of pre-trained networks, but mandates the need for similar neural architectures. Alternatively, knowledge distillation can transfer knowledge between heterogeneous networks but often requires…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Shuhang Wang , Vivek Kumar Singh , Alex Benjamin , Mercy Asiedu , Elham Yousef Kalafi , Eugene Cheah , Viksit Kumar , Anthony Samir

In incremental classification tasks for hyperspectral images, catastrophic forgetting is an unavoidable challenge. While memory recall methods can mitigate this issue, they heavily rely on samples from old categories. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Songfeng Zhu

This paper studies the context aggregation problem in semantic image segmentation. The existing researches focus on improving the pixel representations by aggregating the contextual information within individual images. Though impressive,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Zhenchao Jin , Tao Gong , Dongdong Yu , Qi Chu , Jian Wang , Changhu Wang , Jie Shao

Transfer learning is a powerful way to adapt existing deep learning models to new emerging use-cases in remote sensing. Starting from a neural network already trained for semantic segmentation, we propose to modify its label space to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Gaston Lenczner , Adrien Chan-Hon-Tong , Nicola Luminari , Bertrand Le Saux

Video object segmentation is a fundamental research problem in computer vision. Recent techniques have often applied attention mechanism to object representation learning from video sequences. However, due to temporal changes in the video…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Quang-Trung Truong , Duc Thanh Nguyen , Binh-Son Hua , Sai-Kit Yeung

Deep convolutional semantic segmentation (DCSS) learning doesn't converge to an optimal local minimum with random parameters initializations; a pre-trained model on the same domain becomes necessary to achieve convergence.In this work, we…

Machine Learning · Computer Science 2017-10-24 Mrinal Haloi

During the last few years, continual learning (CL) strategies for image classification and segmentation have been widely investigated designing innovative solutions to tackle catastrophic forgetting, like knowledge distillation and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Elena Camuffo , Simone Milani

Semantic segmentation is a critical task in computer vision aiming to identify and classify individual pixels in an image, with numerous applications in for example autonomous driving and medical image analysis. However, semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prügel-Bennett

This work presents a novel domain adaption paradigm for studying contrastive self-supervised representation learning and knowledge transfer using remote sensing satellite data. Major state-of-the-art remote sensing visual domain efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Muskaan Chopra , Prakash Chandra Chhipa , Gopal Mengi , Varun Gupta , Marcus Liwicki

Semantic segmentation is the task of classifying each pixel in an image. Training a segmentation model achieves best results using annotated images, where each pixel is annotated with the corresponding class. When obtaining fine annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Jort de Jong , Mike Holenderski

Class-incremental semantic segmentation (CISS) labels each pixel of an image with a corresponding object/stuff class continually. To this end, it is crucial to learn novel classes incrementally without forgetting previously learned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Donghyeon Baek , Youngmin Oh , Sanghoon Lee , Junghyup Lee , Bumsub Ham

We present semantic attribute matching networks (SAM-Net) for jointly establishing correspondences and transferring attributes across semantically similar images, which intelligently weaves the advantages of the two tasks while overcoming…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Seungryong Kim , Dongbo Min , Somi Jeong , Sunok Kim , Sangryul Jeon , Kwanghoon Sohn

Automatic segmentation methods based on deep learning have recently demonstrated state-of-the-art performance, outperforming the ordinary methods. Nevertheless, these methods are inapplicable for small datasets, which are very common in…

Image and Video Processing · Electrical Eng. & Systems 2020-05-29 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev

Automatic segmentation methods based on deep learning have recently demonstrated state-of-the-art performance, outperforming the ordinary methods. Nevertheless, these methods are inapplicable for small datasets, which are very common in…

Image and Video Processing · Electrical Eng. & Systems 2019-08-16 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev