English
Related papers

Related papers: Margin and Consistency Supervision for Calibrated …

200 papers

Learning effective visual representations without human supervision is a long-standing problem in computer vision. Recent advances in self-supervised learning algorithms have utilized contrastive learning, with methods such as SimCLR, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Jansel Herrera-Gerena , Ramakrishnan Sundareswaran , John Just , Matthew Darr , Ali Jannesari

Many recent loss functions in deep metric learning are expressed with logarithmic and exponential forms, and they involve margin and scale as essential hyper-parameters. Since each data class has an intrinsic characteristic, several…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Myunghun Jung , Hoirin Kim

Regularization is an effective way to promote the generalization performance of machine learning models. In this paper, we focus on label smoothing, a form of output distribution regularization that prevents overfitting of a neural network…

Machine Learning · Computer Science 2020-07-07 Weizhi Li , Gautam Dasarathy , Visar Berisha

Data-driven methods have shown tremendous progress in medical image analysis. In this context, deep learning-based supervised methods are widely popular. However, they require a large amount of training data and face issues in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Ziang Xu , Jens Rittscher , Sharib Ali

Multi-objective preference alignment in language models often encounters a challenging trade-off: optimizing for one human preference (e.g., helpfulness) frequently compromises others (e.g., harmlessness) due to the inherent conflicts…

Computation and Language · Computer Science 2025-04-16 Zhihao Xu , Yongqi Tong , Xin Zhang , Jun Zhou , Xiting Wang

Randomized smoothing is currently a state-of-the-art method to construct a certifiably robust classifier from neural networks against $\ell_2$-adversarial perturbations. Under the paradigm, the robustness of a classifier is aligned with the…

Machine Learning · Computer Science 2021-11-18 Jongheon Jeong , Sejun Park , Minkyu Kim , Heung-Chang Lee , Doguk Kim , Jinwoo Shin

Existing losses used in deep metric learning (DML) for image retrieval often lead to highly non-uniform intra-class and inter-class representation structures across test classes and data distributions. When combined with the common practice…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Qin Zhang , Linghan Xu , Qingming Tang , Jun Fang , Ying Nian Wu , Joe Tighe , Yifan Xing

We introduce Minimal Achievable Sufficient Statistic (MASS) Learning, a training method for machine learning models that attempts to produce minimal sufficient statistics with respect to a class of functions (e.g. deep networks) being…

Machine Learning · Computer Science 2019-06-13 Milan Cvitkovic , Günther Koliander

Perspective distortion (PD) leads to substantial alterations in the shape, size, orientation, angles, and spatial relationships of visual elements in images. Accurately determining camera intrinsic and extrinsic parameters is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Meenakshi Subhash Chippa , Prakash Chandra Chhipa , Kanjar De , Marcus Liwicki , Rajkumar Saini

As a pioneering work, PointContrast conducts unsupervised 3D representation learning via leveraging contrastive learning over raw RGB-D frames and proves its effectiveness on various downstream tasks. However, the trend of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Xiaoyang Wu , Xin Wen , Xihui Liu , Hengshuang Zhao

It is practical to assume that an individual view is unlikely to be sufficient for effective multi-view learning. Therefore, integration of multi-view information is both valuable and necessary. In this paper, we propose the Multi-view…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Chang Xu , Dacheng Tao , Chao Xu

Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem…

Machine Learning · Computer Science 2020-02-28 Ankit Raj , Yoram Bresler , Bo Li

Robust unsupervised anomaly detection (AD) in real-world scenarios is an important task. Current methods exhibit severe performance degradation on the MVTec AD 2 benchmark due to its complex real-world challenges. To solve this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xurui Li , Zhonesheng Jiang , Tingxuan Ai , Yu Zhou

An important challenge for autonomous agents such as robots is to maintain a spatially and temporally consistent model of the world. It must be maintained through occlusions, previously-unseen views, and long time horizons (e.g., loop…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Dominik A. Kloepfer , Dylan Campbell , João F. Henriques

Consistency models (CMs) are a powerful class of diffusion-based generative models optimized for fast sampling. Most existing CMs are trained using discretized timesteps, which introduce additional hyperparameters and are prone to…

Machine Learning · Computer Science 2025-03-04 Cheng Lu , Yang Song

Certifiable robustness gives the guarantee that small perturbations around an input to a classifier will not change the prediction. There are two approaches to provide certifiable robustness to adversarial examples: a) explicitly training…

Machine Learning · Computer Science 2025-08-04 Meiyu Zhong , Ravi Tandon

Traditional Multi-level Hierarchical Classification (MLHC) classifiers often rely on backbone models with $n$ independent output layers. This structure tends to overlook the hierarchical relationships between classes, leading to…

With the advent of multi-coil imaging and compressed sensing, a number of model based reconstruction algorithms have been created. They incorporate a multitude of different regularization functions based on physics, observed phenomenology,…

Image and Video Processing · Electrical Eng. & Systems 2023-02-03 Nicholas Dwork , Ethan M. I. Johnson , Daniel O'Connor , Jeremy W. Gordon , Adam B. Kerr , Corey A. Baron , John M. Pauly , Peder E. Z. Larson

Fine-grained visual categorization (FGVC), which aims at classifying objects with small inter-class variances, has been significantly advanced in recent years. However, ultra-fine-grained visual categorization (ultra-FGVC), which targets at…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Yajie Sun , Miaohua Zhang , Xiaohan Yu , Yi Liao , Yongsheng Gao

Large language models frequently produce errors in reasoning tasks despite possessing the underlying knowledge required for correct reasoning. One possible approach to improve reasoning consistency is through activation steering. However,…

Machine Learning · Computer Science 2026-05-22 Ian Li , Kapilesh Guruprasad , Raunak Sengupta , Ninad Satish , Loris D'Antoni , Rose Yu