English
Related papers

Related papers: Improving greedy core-set configurations for activ…

200 papers

In the problem of active sequential hypothesis testing (ASHT), a learner seeks to identify the true hypothesis from among a known set of hypotheses. The learner is given a set of actions and knows the random distribution of the outcome of…

Machine Learning · Computer Science 2021-10-08 Kyra Gan , Su Jia , Andrew Li

In practical applications of iterative first-order optimization, the learning rate schedule remains notoriously difficult to understand and expensive to tune. We demonstrate the presence of these subtleties even in the innocuous case when…

Machine Learning · Computer Science 2021-06-15 Naman Agarwal , Surbhi Goel , Cyril Zhang

Calibration is crucial in deep learning applications, especially in fields like healthcare and autonomous driving, where accurate confidence estimates are vital for decision-making. However, deep neural networks often suffer from…

Machine Learning · Computer Science 2024-10-17 Linwei Tao , Haolan Guo , Minjing Dong , Chang Xu

We present a deep learning framework for probabilistic pixel-wise semantic segmentation, which we term Bayesian SegNet. Semantic segmentation is an important tool for visual scene understanding and a meaningful measure of uncertainty is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Alex Kendall , Vijay Badrinarayanan , Roberto Cipolla

We introduce an unsupervised formulation to estimate heteroscedastic uncertainty in retrieval systems. We propose an extension to triplet loss that models data uncertainty for each input. Besides improving performance, our formulation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ahmed Taha , Yi-Ting Chen , Teruhisa Misu , Abhinav Shrivastava , Larry Davis

Active learning enables the efficient construction of a labeled dataset by labeling informative samples from an unlabeled dataset. In a real-world active learning scenario, considering the diversity of the selected samples is crucial…

Machine Learning · Computer Science 2022-07-15 Yeachan Kim , Bonggun Shin

Camouflaged Object Detection (COD), the task of identifying objects concealed within their environments, has seen rapid growth due to its wide range of practical applications. A key step toward developing trustworthy COD systems is the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Ziyue Yang , Kehan Wang , Yuhang Ming , Yong Peng , Han Yang , Qiong Chen , Wanzeng Kong

The use of deep learning for medical imaging has seen tremendous growth in the research community. One reason for the slow uptake of these systems in the clinical setting is that they are complex, opaque and tend to fail silently. Outside…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Terrance DeVries , Graham W. Taylor

This paper aims to quantify uncertainty for SVBRDF acquisition in multi-view captures. Under uncontrolled illumination and unstructured viewpoints, there is no guarantee that the observations contain enough information to reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Ruben Wiersma , Julien Philip , Miloš Hašan , Krishna Mullia , Fujun Luan , Elmar Eisemann , Valentin Deschaintre

Deep learning approaches require enough training samples to perform well, but it is a challenge to collect enough real training data and label them manually. In this letter, we propose the use of realistic synthetic data with a wide…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Weixing Liu , Jun Liu , Bin Luo

Forward gradient learning computes a noisy directional gradient and is a biologically plausible alternative to backprop for learning deep neural networks. However, the standard forward gradient algorithm, when applied naively, suffers from…

Machine Learning · Computer Science 2023-03-03 Mengye Ren , Simon Kornblith , Renjie Liao , Geoffrey Hinton

Convolutional image classifiers can achieve high predictive accuracy, but quantifying their uncertainty remains an unresolved challenge, hindering their deployment in consequential settings. Existing uncertainty quantification techniques,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Anastasios Angelopoulos , Stephen Bates , Jitendra Malik , Michael I. Jordan

Learning exists in the context of data, yet notions of confidence typically focus on model predictions, not label quality. Confident learning (CL) is an alternative approach which focuses instead on label quality by characterizing and…

Machine Learning · Statistics 2022-08-23 Curtis G. Northcutt , Lu Jiang , Isaac L. Chuang

Robust optimization (RO) provides a principled framework for decision-making under uncertainty, but its performance critically depends on the choice of the uncertainty set. While large sets ensure reliability, they often lead to overly…

Machine Learning · Computer Science 2026-05-15 Shuyi Chen , Wenbin Zhou , Shixiang Zhu

The scalability of Distributed Stochastic Gradient Descent (SGD) is today limited by communication bottlenecks. We propose a novel SGD variant: Communication-efficient SGD with Error Reset, or CSER. The key idea in CSER is first a new…

Machine Learning · Computer Science 2020-12-08 Cong Xie , Shuai Zheng , Oluwasanmi Koyejo , Indranil Gupta , Mu Li , Haibin Lin

We study the problem of causal structure learning when the experimenter is limited to perform at most $k$ non-adaptive experiments of size $1$. We formulate the problem of finding the best intervention target set as an optimization problem,…

Machine Learning · Computer Science 2018-08-03 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash , Elias Bareinboim

Reinforcement learning (RL) systems typically optimize scalar reward functions that assume precise and reliable evaluation of outcomes. However, real-world objectives--especially those derived from human preferences--are often uncertain,…

Machine Learning · Computer Science 2026-04-30 Disha Singha

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and materials properties. A common short-coming shared by current approaches, however, is that neural networks only give point…

Computational Physics · Physics 2023-05-10 Albert Zhu , Simon Batzner , Albert Musaelian , Boris Kozinsky

This paper proposes a novel analysis for the Scaffold algorithm, a popular method for dealing with data heterogeneity in federated learning. While its convergence in deterministic settings--where local control variates mitigate client…

Machine Learning · Statistics 2025-03-11 Paul Mangold , Alain Durmus , Aymeric Dieuleveut , Eric Moulines