English
Related papers

Related papers: About Explicit Variance Minimization: Training Neu…

200 papers

We propose a compression based continual task learning method that can dynamically grow a neural network. Inspired from the recent model compression techniques, we employ compression-aware training and perform low-rank weight approximations…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Varigonda Pavan Teja , Priyadarshini Panda

Deep learning models in medical image analysis often struggle with generalizability across domains and demographic groups due to data heterogeneity and scarcity. Traditional augmentation improves robustness, but fails under substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sebastian Doerrich , Francesco Di Salvo , Jonas Alle , Christian Ledig

Supervised learning-based segmentation methods typically require a large number of annotated training data to generalize well at test time. In medical applications, curating such datasets is not a favourable option because acquiring a large…

Image and Video Processing · Electrical Eng. & Systems 2020-11-20 Krishna Chaitanya , Neerav Karani , Christian F. Baumgartner , Ertunc Erdil , Anton Becker , Olivio Donati , Ender Konukoglu

We propose a weakly-supervised multi-view learning approach to learn category-specific surface mapping without dense annotations. We learn the underlying surface geometry of common categories, such as human faces, cars, and airplanes, given…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Nishant Rai , Aidas Liaudanskas , Srinivas Rao , Rodrigo Ortiz Cayon , Matteo Munaro , Stefan Holzer

Medical image segmentation is a fundamental and critical step in many image-guided clinical approaches. Recent success of deep learning-based segmentation methods usually relies on a large amount of labeled data, which is particularly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Rushi Jiao , Yichi Zhang , Le Ding , Rong Cai , Jicong Zhang

Medical vision foundation models remain limited in downstream tasks, particularly volumetric medical image segmentation. While fine-tuning on labeled target-domain data improves performance, existing approaches typically rely on randomly…

Image and Video Processing · Electrical Eng. & Systems 2026-05-07 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

Many leading self-supervised methods for unsupervised representation learning, in particular those for embedding image features, are built on variants of the instance discrimination task, whose optimization is known to be prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Daniel Shalam , Simon Korman

Virtual Adversarial Training (VAT) has shown impressive results among recently developed regularization methods called consistency regularization. VAT utilizes adversarial samples, generated by injecting perturbation in the input space, for…

Machine Learning · Computer Science 2022-12-27 Genki Osada , Budrul Ahsan , Revoti Prasad Bora , Takashi Nishide

Viewpoint invariance remains challenging for visual recognition in the 3D world, as altering the viewing directions can significantly impact predictions for the same object. While substantial efforts have been dedicated to making neural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shouwei Ruan , Yinpeng Dong , Hang Su , Jianteng Peng , Ning Chen , Xingxing Wei

In this paper, we investigate the continual learning of Vision Transformers (ViT) for the challenging exemplar-free scenario, with special focus on how to efficiently distill the knowledge of its crucial self-attention mechanism (SAM). Our…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Francesco Pelosin , Saurav Jha , Andrea Torsello , Bogdan Raducanu , Joost van de Weijer

Training a deep learning model to classify histopathological images is challenging, because of the color and shape variability of the cells and tissues, and the reduced amount of available data, which does not allow proper learning of those…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Saypraseuth Mounsaveng , Issam Laradji , David Vázquez , Marco Perdersoli , Ismail Ben Ayed

Detection of Alzheimer's Disease (AD) from neuroimaging data such as MRI through machine learning has been a subject of intense research in recent years. Recent success of deep learning in computer vision has progressed such research…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Naimul Mefraz Khan , Marcia Hon , Nabila Abraham

Semi-supervised learning has made significant strides in the medical domain since it alleviates the heavy burden of collecting abundant pixel-wise annotated data for semantic segmentation tasks. Existing semi-supervised approaches enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Xu Zheng , Chong Fu , Haoyu Xie , Jialei Chen , Xingwei Wang , Chiu-Wing Sham

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

Vision Transformers (ViTs) have emerged as the state-of-the-art architecture in representation learning, leveraging self-attention mechanisms to excel in various tasks. ViTs split images into fixed-size patches, constraining them to a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Aswathi Varma , Suprosanna Shit , Chinmay Prabhakar , Daniel Scholz , Hongwei Bran Li , Bjoern Menze , Daniel Rueckert , Benedikt Wiestler

Recent advances in deep learning have achieved promising performance for medical image analysis, while in most cases ground-truth annotations from human experts are necessary to train the deep model. In practice, such annotations are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Jianbo Jiao , Richard Droste , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

Deep convolutional neural networks have achieved remarkable progress on a variety of medical image computing tasks. A common problem when applying supervised deep learning methods to medical images is the lack of labeled data, which is very…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xiaomeng Li , Lequan Yu , Hao Chen , Chi-Wing Fu , Lei Xing , Pheng-Ann Heng

Advances in deep learning are re-defining how visual data is processed and understand by the machines. Vision Transformers (ViTs) have recently demonstrated prominent performance in computer vision related tasks. However, their performance…

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

Machine Learning · Computer Science 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto

Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson