English
Related papers

Related papers: Slot Attention with Re-Initialization and Self-Dis…

200 papers

Traditional object detection are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will leads to catastrophic forgetting. Knowledge distillation is a straightforward…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Tao Feng , Mang Wang

Block attention, which processes the input as separate blocks that cannot attend to one another, offers significant potential to improve KV cache reuse in long-context scenarios such as Retrieval-Augmented Generation (RAG). However, its…

Computation and Language · Computer Science 2026-05-25 Shuaiyi Li , Zhisong Zhang , Yan Wang , Lei Zhu , Dongyang Ma , Chenlong Deng , Yang Deng , Wai Lam

Attention mechanisms have significantly boosted the performance of video classification neural networks thanks to the utilization of perspective contexts. However, the current research on video attention generally focuses on adopting a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Yanbin Hao , Shuo Wang , Pei Cao , Xinjian Gao , Tong Xu , Jinmeng Wu , Xiangnan He

Aiming at improving performance of visual classification in a cost-effective manner, this paper proposes an incremental semi-supervised learning paradigm called Deep Co-Space (DCS). Unlike many conventional semi-supervised learning methods…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Ziliang Chen , Keze Wang , Xiao Wang , Pai Peng , Ebroul Izquierdo , Liang Lin

Object detection is a pivotal task in computer vision that has received significant attention in previous years. Nonetheless, the capability of a detector to localise objects out of the training distribution remains unexplored. Whilst…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Brian K. S. Isaac-Medina , Yona Falinie A. Gaus , Neelanjan Bhowmik , Toby P. Breckon

Object-centric slot attention is an emerging paradigm for unsupervised learning of structured, interpretable object-centric representations (slots). This enables effective reasoning about objects and events at a low computational cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Guiqiu Liao , Matjaz Jogan , Marcel Hussing , Edward Zhang , Eric Eaton , Daniel A. Hashimoto

Object detection aims to localize and classify the objects in a given image, and these two tasks are sensitive to different object regions. Therefore, some locations predict high-quality bounding boxes but low classification scores, and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yang Yang , Min Li , Bo Meng , Junxing Ren , Degang Sun , Zihao Huang

We propose Self-Supervised Implicit Attention (SSIA), a new approach that adaptively guides deep neural network models to gain attention by exploiting the properties of the models themselves. SSIA is a novel attention mechanism that does…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jinyi Wu , Xun Gong , Zhemin Zhang

In this paper, we introduce DetailCLIP: A Detail-Oriented CLIP to address the limitations of contrastive learning-based vision-language models, particularly CLIP, in handling detail-oriented and fine-grained tasks like segmentation. While…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Amin Karimi Monsefi , Kishore Prakash Sailaja , Ali Alilooee , Ser-Nam Lim , Rajiv Ramnath

Reliance on vast annotations to achieve leading performance severely restricts the practicality of large-scale point cloud semantic segmentation. For the purpose of reducing data annotation costs, effective labeling schemes are developed…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Puzuo Wang , Wei Yao , Jie Shao

Online continual learning (OCL) involves deep neural networks retaining knowledge from old data while adapting to new data, which is accessible only once. A critical challenge in OCL is catastrophic forgetting, reflected in reduced model…

Machine Learning · Computer Science 2024-07-18 Huiwei Lin

Existing salient instance detection (SID) methods typically learn from pixel-level annotated datasets. In this paper, we present the first weakly-supervised approach to the SID problem. Although weak supervision has been considered in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Xin Tian , Ke Xu , Xin Yang , Baocai Yin , Rynson W. H. Lau

Despite the recent advances in the field of object detection, common architectures are still ill-suited to incrementally detect new categories over time. They are vulnerable to catastrophic forgetting: they forget what has been already…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Fabio Cermelli , Antonino Geraci , Dario Fontanel , Barbara Caputo

Clustering is a fundamental unsupervised representation learning task with wide application in computer vision and pattern recognition. Deep clustering utilizes deep neural networks to learn latent representation, which is suitable for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wenhao Wu , Weiwei Wang , Shengjiang Kong

Unsupervised continual learning aims to learn new tasks incrementally without requiring human annotations. However, most existing methods, especially those targeted on image classification, only work in a simplified scenario by assuming all…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jiangpeng He , Fengqing Zhu

Attention mechanisms are widely used in salient object detection models based on deep learning, which can effectively promote the extraction and utilization of useful information by neural networks. However, most of the existing attention…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Shiping Zhu , Lanyun Zhu

Few-shot segmentation focuses on the generalization of models to segment unseen object with limited annotated samples. However, existing approaches still face two main challenges. First, huge feature distinction between support and query…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Qi Zhao , Binghao Liu , Shuchang Lyu , Huojin Chen

Recent works on 3D scene understanding leverage 2D masks from visual foundation models (VFMs) to supervise radiance fields, enabling instance-level 3D segmentation. However, the supervision signals from foundation models are not…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Tsuheng Hsu , Guiyu Liu , Juho Kannala , Janne Heikkilä

Recent advances in object detection have benefited significantly from rapid developments in deep neural networks. However, neural networks suffer from the well-known issue of catastrophic forgetting, which makes continual or lifelong…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Wang Zhou , Shiyu Chang , Norma Sosa , Hendrik Hamann , David Cox

The field of continual deep learning is an emerging field and a lot of progress has been made. However, concurrently most of the approaches are only tested on the task of image classification, which is not relevant in the field of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Tobias Kalb , Masoud Roschani , Miriam Ruf , Jürgen Beyerer