English
Related papers

Related papers: About Explicit Variance Minimization: Training Neu…

200 papers

Supervised Deep Learning has been highly successful in recent years, achieving state-of-the-art results in most tasks. However, with the ongoing uptake of such methods in industrial applications, the requirement for large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Fabio De Sousa Ribeiro , Francesco Caliva , Mark Swainson , Kjartan Gudmundsson , Georgios Leontidis , Stefanos Kollias

Deep learning (DL) has been used in the automatic diagnosis of Mild Cognitive Impairment (MCI) and Alzheimer's Disease (AD) with brain imaging data. However, previous methods have not fully exploited the relation between brain image and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Luoyao Kang , Haifan Gong , Xiang Wan , Haofeng Li

In the recent years, convolutional neural networks have transformed the field of medical image analysis due to their capacity to learn discriminative image features for a variety of classification and regression tasks. However, successfully…

Computer Vision and Pattern Recognition · Computer Science 2019-07-08 Wenjia Bai , Chen Chen , Giacomo Tarroni , Jinming Duan , Florian Guitton , Steffen E. Petersen , Yike Guo , Paul M. Matthews , Daniel Rueckert

Recently, the vision transformer (ViT) has made breakthroughs in image recognition. Its self-attention mechanism (MSA) can extract discriminative labeling information of different pixel blocks to improve image classification accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Chao Hu , Liqiang Zhu , Weibin Qiu , Weijie Wu

Liver vessel segmentation in magnetic resonance imaging data is important for the computational analysis of vascular remodelling, associated with a wide spectrum of diffuse liver diseases. Existing approaches rely on contrast enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Daniel Sobotka , Alexander Herold , Matthias Perkonigg , Lucian Beer , Nina Bastati , Alina Sablatnig , Ahmed Ba-Ssalamah , Georg Langs

Intra-operative ultrasound is an increasingly important imaging modality in neurosurgery. However, manual interaction with imaging data during the procedures, for example to select landmarks or perform segmentation, is difficult and can be…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Julia Rackerseder , Rüdiger Göbl , Nassir Navab , Christoph Hennersperger

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

Most of the current state-of-the-art methods for tumor segmentation are based on machine learning models trained on manually segmented images. This type of training data is particularly costly, as manual delineation of tumors is not only…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Pawel Mlynarski , Hervé Delingette , Antonio Criminisi , Nicholas Ayache

Vision transformers (ViTs) have recently obtained success in many applications, but their intensive computation and heavy memory usage at both training and inference time limit their generalization. Previous compression algorithms usually…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zhenglun Kong , Haoyu Ma , Geng Yuan , Mengshu Sun , Yanyue Xie , Peiyan Dong , Xin Meng , Xuan Shen , Hao Tang , Minghai Qin , Tianlong Chen , Xiaolong Ma , Xiaohui Xie , Zhangyang Wang , Yanzhi Wang

Self-supervised learning, a.k.a., pretraining, is important in natural language processing. Most of the pretraining methods first randomly mask some positions in a sentence and then train a model to recover the tokens at the masked…

Computation and Language · Computer Science 2020-08-18 Liang Chen

We introduce a novel self-supervised learning approach to learn representations of videos that are responsive to changes in the motion dynamics. Our representations can be learned from data without human annotation and provide a substantial…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Simon Jenni , Givi Meishvili , Paolo Favaro

Deep learning models have shown remarkable success in dermatological image analysis, offering potential for automated skin disease diagnosis. Previously, convolutional neural network(CNN) based architectures have achieved immense popularity…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Rifat Sadik , Tanvir Rahman , Arpan Bhattacharjee , Bikash Chandra Halder , Ismail Hossain , Mridul Banik , Jia Uddin

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Deep learning methods have shown impressive results for a variety of medical problems over the last few years. However, datasets tend to be small due to time-consuming annotation. As datasets with different patients are often very…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Nils Gessert , Markus Heyder , Sarah Latus , David M. Leistner , Youssef S. Abdelwahed , Matthias Lutz , Alexander Schlaefer

Vision Transformers (ViTs) with self-attention modules have recently achieved great empirical success in many vision tasks. Due to non-convex interactions across layers, however, theoretical learning and generalization analysis is mostly…

Machine Learning · Computer Science 2023-11-15 Hongkang Li , Meng Wang , Sijia Liu , Pin-yu Chen

Modern deep neural networks can easily overfit to biased training data containing corrupted labels or class imbalance. Sample re-weighting methods are popularly used to alleviate this data bias issue. Most current methods, however, require…

Machine Learning · Computer Science 2023-05-02 Jun Shu , Xiang Yuan , Deyu Meng , Zongben Xu

We introduce an exploratory study on Mutation Validation (MV), a model validation method using mutated training labels for supervised learning. MV mutates training data labels, retrains the model against the mutated data, then uses the…

Machine Learning · Computer Science 2021-10-22 Jie M. Zhang , Mark Harman , Benjamin Guedj , Earl T. Barr , John Shawe-Taylor

Vision Transformer (ViT) models, utilizing self-attention mechanisms, have demonstrated robust generalization capabilities across various vision tasks, including image classification. However, these models, typically pretrained on general…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yuli Wang , Hyewon Jung , Dongshen Peng , Yuwei Dai , Jing Wu , Haoyue Guan , Yoko Kato , Zhicheng Jiao , Yu Sun , Ihab Kamel , Joao Lima , Cheng Ting Lin , Harrison Bai

Self-supervised representation learning has been extremely successful in medical image analysis, as it requires no human annotations to provide transferable representations for downstream tasks. Recent self-supervised learning methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Hong-Yu Zhou , Chixiang Lu , Liansheng Wang , Yizhou Yu

(Very early draft)Traditional supervised learning keeps pushing convolution neural network(CNN) achieving state-of-art performance. However, lack of large-scale annotation data is always a big problem due to the high cost of it, even…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Zhibo Wang , Shen Yan , Xiaoyu Zhang , Niels Lobo