English
Related papers

Related papers: DiM: $f$-Divergence Minimization Guided Sharpness-…

200 papers

The recently proposed optimization algorithm for deep neural networks Sharpness Aware Minimization (SAM) suggests perturbing parameters before gradient calculation by a gradient ascent step to guide the optimization into parameter space…

Machine Learning · Computer Science 2025-10-03 Marlon Becker , Frederick Altrock , Benjamin Risse

Sharpness-Aware Minimization (SAM) has attracted significant attention for its effectiveness in improving generalization across various tasks. However, its underlying principles remain poorly understood. In this work, we analyze SAM's…

Machine Learning · Computer Science 2025-01-23 Haocheng Luo , Tuan Truong , Tung Pham , Mehrtash Harandi , Dinh Phung , Trung Le

In this paper, we aim to improve the performance of semantic image segmentation in a semi-supervised setting in which training is effectuated with a reduced set of annotated images and additional non-annotated images. We present a method…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Jizong Peng , Guillermo Estrada , Marco Pedersoli , Christian Desrosiers

Liver tumor segmentation is essential for computer-aided diagnosis, surgical planning, and prognosis evaluation. However, obtaining and maintaining a large-scale dataset with dense annotations is challenging. Semi-Supervised Learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Shiyun Chen , Li Lin , Pujin Cheng , Xiaoying Tang

Sharpness-aware minimization (SAM) has well documented merits in enhancing generalization of deep neural networks, even without sizable data augmentation. Embracing the geometry of the loss function, where neighborhoods of 'flat minima'…

Machine Learning · Computer Science 2023-12-25 Bingcong Li , Georgios B. Giannakis

Surgical instrument segmentation is recognised as a key enabler in providing advanced surgical assistance and improving computer-assisted interventions. In this work, we propose SegMatch, a semi-supervised learning method to reduce the need…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Meng Wei , Charlie Budd , Luis C. Garcia-Peraza-Herrera , Reuben Dorent , Miaojing Shi , Tom Vercauteren

The performance of existing supervised neuron segmentation methods is highly dependent on the number of accurate annotations, especially when applied to large scale electron microscopy (EM) data. By extracting semantic information from…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Yinda Chen , Wei Huang , Shenglong Zhou , Qi Chen , Zhiwei Xiong

Image segmentation is one of the most essential biomedical image processing problems for different imaging modalities, including microscopy and X-ray in the Internet-of-Medical-Things (IoMT) domain. However, annotating biomedical images is…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Ziyuan Zhao , Zeng Zeng , Kaixin Xu , Cen Chen , Cuntai Guan

Deep learning has achieved remarkable success in medical image classification. However, its clinical application is often hindered by data heterogeneity caused by variations in scanner vendors, imaging protocols, and operators. Approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yaoyao Zhu , Xiuding Cai , Yingkai Wang , Yu Yao , Xu Luo , Zhongliang Fu

Image-level weakly supervised semantic segmentation (WSSS) is a fundamental yet challenging computer vision task facilitating scene understanding and automatic driving. Most existing methods resort to classification-based Class Activation…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Jie Qin , Jie Wu , Xuefeng Xiao , Lujun Li , Xingang Wang

Semi-supervised medical image segmentation aims to leverage limited annotated data and rich unlabeled data to perform accurate segmentation. However, existing semi-supervised methods are highly dependent on the quality of self-generated…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Xinyu Liu , Wuyang Li , Yixuan Yuan

Semi-supervised learning, which leverages both annotated and unannotated data, is an efficient approach for medical image segmentation, where obtaining annotations for the whole dataset is time-consuming and costly. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Ruizhe Li , Grazziela Figueredo , Dorothee Auer , Rob Dineen , Paul Morgan , Xin Chen

In this paper, we propose a novel mutual consistency network (MC-Net+) to effectively exploit the unlabeled data for semi-supervised medical image segmentation. The MC-Net+ model is motivated by the observation that deep models trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yicheng Wu , Zongyuan Ge , Donghao Zhang , Minfeng Xu , Lei Zhang , Yong Xia , Jianfei Cai

Diffusion models excel at image restoration via probabilistic modeling of forward noise addition and reverse denoising, and their ability to handle complex noise while preserving fine details makes them well-suited for Low-Light Image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Ying Liu , Junchao Zhang , Caiyun Wu

The sharpness-aware minimization (SAM) algorithm and its variants, including gap guided SAM (GSAM), have been successful at improving the generalization capability of deep neural network models by finding flat local minima of the empirical…

Machine Learning · Computer Science 2024-09-17 Hinata Harada , Hideaki Iiduka

Sharpness-aware minimization (SAM) is known to improve the generalization performance of neural networks. However, it is not widely used in real-world applications yet due to its expensive model perturbation cost. A few variants of SAM have…

Machine Learning · Computer Science 2025-03-19 Sunwoo Lee

Medical imaging provides many valuable clues involving anatomical structure and pathological characteristics. However, image degradation is a common issue in clinical practice, which can adversely impact the observation and diagnosis by…

Image and Video Processing · Electrical Eng. & Systems 2023-12-05 Heng Li , Ziqin Lin , Zhongxi Qiu , Zinan Li , Huazhu Fu , Yan Hu , Jiang Liu

Semi-supervised learning relaxes the need of large pixel-wise labeled datasets for image segmentation by leveraging unlabeled data. The scarcity of high-quality labeled data remains a major challenge in medical image analysis due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jun Li

It is commonly believed that gradient compression in federated learning (FL) enjoys significant improvement in communication efficiency with negligible performance degradation. In this paper, we find that gradient compression induces…

Machine Learning · Computer Science 2026-02-13 Yujie Gu , Richeng Jin , Zhaoyang Zhang , Huaiyu Dai

Few-shot semantic segmentation (FSS) has great potential for medical imaging applications. Most of the existing FSS techniques require abundant annotated semantic classes for training. However, these methods may not be applicable for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Cheng Ouyang , Carlo Biffi , Chen Chen , Turkay Kart , Huaqi Qiu , Daniel Rueckert