English
Related papers

Related papers: WSS-CL: Weight Saliency Soft-Guided Contrastive Le…

200 papers

Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Xiangyun Zhao , Raviteja Vemulapalli , Philip Mansfield , Boqing Gong , Bradley Green , Lior Shapira , Ying Wu

Hyperspectral image (HSI) classification techniques have been intensively studied and a variety of models have been developed. However, these HSI classification models are confined to pocket models and unrealistic ways of dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Quanwei Liu , Yanni Dong , Tao Huang , Lefei Zhang , Bo Du

We introduce a new training paradigm that enforces interval constraints on neural network parameter space to control forgetting. Contemporary Continual Learning (CL) methods focus on training neural networks efficiently from a stream of…

Contrastive learning has gained significant attention in skeleton-based action recognition for its ability to learn robust representations from unlabeled data. However, existing methods rely on a single skeleton convention, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Mert Kiray , Alvaro Ritter , Nassir Navab , Benjamin Busam

Deep learning generally suffers from enormous computational resources and time-consuming training processes. Broad Learning System (BLS) and its convolutional variants have been proposed to mitigate these issues and have achieved superb…

Machine Learning · Computer Science 2023-04-04 Chunyu Lei , C. L. Philip Chen , Jifeng Guo , Tong Zhang

Machine unlearning methods aim to remove sensitive or unwanted content from trained models, but typically demand extensive model updates at significant computational cost while potentially degrading model performance on both related and…

Machine Learning · Computer Science 2025-06-02 Zikui Cai , Yaoteng Tan , M. Salman Asif

Sequential learning of multiple tasks in artificial neural networks using gradient descent leads to catastrophic forgetting, whereby previously learned knowledge is erased during learning of new, disjoint knowledge. Here, we propose a new…

Machine Learning · Computer Science 2018-05-22 Shixian Wen , Laurent Itti

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

Machine Learning · Computer Science 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

Weight regularization methods in continual learning (CL) alleviate catastrophic forgetting by assessing and penalizing changes to important model weights. Elastic Weight Consolidation (EWC) is a foundational and widely used approach within…

Machine Learning · Computer Science 2026-03-27 Xuan Liu , Xiaobin Chang

Whole Slide Image (WSI) representation is critical for cancer subtyping, cancer recognition and mutation prediction.Training an end-to-end WSI representation model poses significant challenges, as a standard gigapixel slide can contain tens…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Jing Jin , Xu Liu , Te Gao , Zhihong Shi , Yixiong Liang , Ruiqing Zheng , Hulin Kuang , Min Zeng , Shichao Kan

To improve the detection accuracy and generalization of steganalysis, this paper proposes the Steganalysis Contrastive Framework (SCF) based on contrastive learning. The SCF improves the feature representation of steganalysis by maximizing…

Artificial Intelligence · Computer Science 2021-03-02 Yanzhen Ren , Yiwen Liu , Lina Wang

Deep neural networks often rely on spurious features to make predictions, which makes them brittle under distribution shift and on samples where the spurious correlation does not hold (e.g., minority-group examples). Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Aryan Yazdan Parast , Khawar Islam , Soyoun Won , Basim Azam , Naveed Akhtar

Multi-view feature extraction is an efficient approach for alleviating the issue of dimensionality in highdimensional multi-view data. Contrastive learning (CL), which is a popular self-supervised learning method, has recently attracted…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Hongjie Zhang

Accurate lesion classification in Wireless Capsule Endoscopy (WCE) images is vital for early diagnosis and treatment of gastrointestinal (GI) cancers. However, this task is confronted with challenges like tiny lesions and background…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Kunpeng Qiu , Zhiying Zhou , Yongxin Guo

Whole-slide image (WSI) analysis plays a crucial role in cancer diagnosis and treatment. In addressing the demands of this critical task, self-supervised learning (SSL) methods have emerged as a valuable resource, leveraging their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Gia-Bao Le , Van-Tien Nguyen , Trung-Nghia Le , Minh-Triet Tran

Learning representations unaffected by superficial characteristics is important to ensure that shifts in these characteristics at test time do not compromise downstream prediction performance. For instance, in healthcare applications, we…

Machine Learning · Computer Science 2025-07-28 Minghui Sun , Benjamin A. Goldstein , Matthew M. Engelhard

Machine unlearning has garnered significant attention due to its ability to selectively erase knowledge obtained from specific training data samples in an already trained machine learning model. This capability enables data holders to…

Machine Learning · Computer Science 2024-03-13 Vinay Chakravarthi Gogineni , Esmaeil S. Nadimi

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Continual Learning (CL) is crucial for enabling networks to dynamically adapt as they learn new tasks sequentially, accommodating new data and classes without catastrophic forgetting. Diverging from conventional perspectives on CL, our…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Nourhan Bayasi , Jamil Fayyad , Alceu Bissoto , Ghassan Hamarneh , Rafeef Garbi

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu