English
Related papers

Related papers: Margin and Consistency Supervision for Calibrated …

200 papers

This study addresses a key limitation in deep learning Automatic Modulation Classification (AMC) models, which perform well at high signal-to-noise ratios (SNRs) but degrade under noisy conditions due to conventional feature extraction…

Machine Learning · Computer Science 2026-04-14 Prakash Suman , Yanzhen Qu

Few-Shot Class Incremental Learning (FSCIL) is crucial for adapting to the complex open-world environments. Contemporary prospective learning-based space construction methods struggle to balance old and new knowledge, as prototype bias and…

Machine Learning · Computer Science 2026-03-03 Qinzhe Wang , Zixuan Chen , Keke Huang , Xiu Su , Chunhua Yang , Chang Xu

The Lookahead optimizer enhances deep learning models by employing a dual-weight update mechanism, which has been shown to improve the performance of underlying optimizers such as SGD. However, most theoretical studies focus on its…

Machine Learning · Computer Science 2025-09-22 Kangcheng Li , Yunwen Lei

Class imbalance remains a major challenge in machine learning, especially in multi-class problems with long-tailed distributions. Existing methods, such as data resampling, cost-sensitive techniques, and logistic loss modifications, though…

Machine Learning · Computer Science 2025-12-30 Corinna Cortes , Anqi Mao , Mehryar Mohri , Yutao Zhong

Randomized smoothing (RS) has been shown to be a fast, scalable technique for certifying the robustness of deep neural network classifiers. However, methods based on RS require augmenting data with large amounts of noise, which leads to…

Machine Learning · Computer Science 2022-05-13 Ameya Joshi , Minh Pham , Minsu Cho , Leonid Boytsov , Filipe Condessa , J. Zico Kolter , Chinmay Hegde

Images suffer from heavy spatial redundancy because pixels in neighboring regions are spatially correlated. Existing approaches strive to overcome this limitation by reducing less meaningful image regions. However, current leading methods…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yang Luo , Zhineng Chen , Peng Zhou , Zuxuan Wu , Xieping Gao , Yu-Gang Jiang

Researches using margin based comparison loss demonstrate the effectiveness of penalizing the distance between face feature and their corresponding class centers. Despite their popularity and excellent performance, they do not explicitly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Ying Huang , Shangfeng Qiu , Wenwei Zhang , Xianghui Luo , Jinzhuo Wang

Model selection is difficult to analyse yet theoretically and empirically important, especially for high-dimensional data analysis. Recently the least absolute shrinkage and selection operator (Lasso) has been applied in the statistical and…

Machine Learning · Statistics 2016-06-02 Ning Xu , Jian Hong , Timothy C. G. Fisher

We introduce MarginMatch, a new SSL approach combining consistency regularization and pseudo-labeling, with its main novelty arising from the use of unlabeled data training dynamics to measure pseudo-label quality. Instead of using only the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Tiberiu Sosea , Cornelia Caragea

Rank-based metrics are some of the most widely used criteria for performance evaluation of computer vision models. Despite years of effort, direct optimization for these metrics remains a challenge due to their non-differentiable and…

Machine Learning · Computer Science 2024-12-16 Michal Rolínek , Vít Musil , Anselm Paulus , Marin Vlastelica , Claudio Michaelis , Georg Martius

Camera calibration is a crucial technique which significantly influences the performance of many robotic systems. Robustness and high precision have always been the pursuit of diverse calibration methods. State-of-the-art calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Yesheng Zhang , Xu Zhao , Dahong Qian

In this paper, we provide new theoretical results on the generalization properties of learning algorithms for multiclass classification problems. The originality of our work is that we propose to use the confusion matrix of a classifier as…

Machine Learning · Computer Science 2012-05-25 Pierre Machart , Liva Ralaivola

Despite the remarkable reasoning abilities of large vision-language models (LVLMs), their robustness under visual corruptions remains insufficiently studied. Existing evaluation paradigms exhibit two major limitations: 1) the dominance of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Xiangjie Sui , Songyang Li , Hanwei Zhu , Baoliang Chen , Yuming Fang , Xin Sun

Consistency regularization is a technique for semi-supervised learning that underlies a number of strong results for classification with few labeled data. It works by encouraging a learned model to be robust to perturbations on unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Geoff French , Avital Oliver , Tim Salimans

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

Machine Learning · Statistics 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone

A widely believed explanation for the remarkable generalization capacities of overparameterized neural networks is that the optimization algorithms used for training induce an implicit bias towards benign solutions. To grasp this…

Machine Learning · Computer Science 2025-12-19 Maria Matveev , Vit Fojtik , Hung-Hsu Chou , Gitta Kutyniok , Johannes Maly

We address the problem of network calibration adjusting miscalibrated confidences of deep neural networks. Many approaches to network calibration adopt a regularization-based method that exploits a regularization term to smooth the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Hyekang Park , Jongyoun Noh , Youngmin Oh , Donghyeon Baek , Bumsub Ham

Consistency regularization is a commonly-used technique for semi-supervised and self-supervised learning. It is an auxiliary objective function that encourages the prediction of the network to be similar in the vicinity of the observed…

Machine Learning · Computer Science 2021-10-05 Erik Englesson , Hossein Azizpour

Synthesis planning seeks an efficient sequence of chemical reactions that produce a target molecule. Typically, a pretrained single-step (autoregressive) retrosynthesis model is repeatedly invoked to generate such a sequence. Classifier…

Machine Learning · Computer Science 2026-05-14 Najwa Laabid , Vikas Garg

Synthesizing high-quality images from low-field MRI holds significant potential. Low-field MRI is cheaper, more accessible, and safer, but suffers from low resolution and poor signal-to-noise ratio. This synthesis process can reduce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Zhenxuan Zhang , Peiyuan Jing , Zi Wang , Ula Briski , Coraline Beitone , Yue Yang , Yinzhe Wu , Fanwen Wang , Liutao Yang , Jiahao Huang , Zhifan Gao , Zhaolin Chen , Kh Tohidul Islam , Guang Yang , Peter J. Lally