English
Related papers

Related papers: Pretrained Visual Uncertainties

200 papers

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Predicting mortality-related outcomes from images offers the prospect of accessible, noninvasive, and scalable health screening. We present a method that leverages pretrained vision transformer foundation models to estimate remaining…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Tristan Kenneweg , Philip Kenneweg , Barbara Hammer

Model-based deep learning solutions to inverse problems have attracted increasing attention in recent years as they bridge state-of-the-art numerical performance with interpretability. In addition, the incorporated prior domain knowledge…

Machine Learning · Statistics 2023-09-18 Frederik Hoppe , Claudio Mayrink Verdun , Felix Krahmer , Hannah Laus , Holger Rauhut

The use of deep learning for medical imaging has seen tremendous growth in the research community. One reason for the slow uptake of these systems in the clinical setting is that they are complex, opaque and tend to fail silently. Outside…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Terrance DeVries , Graham W. Taylor

Training robots to operate effectively in environments with uncertain states, such as ambiguous object properties or unpredictable interactions, remains a longstanding challenge in robotics. Imitation learning methods typically rely on…

Robotics · Computer Science 2025-10-14 Hyogo Hiruma , Hiroshi Ito , Tetsuya Ogata

Prior Networks are a recently developed class of models which yield interpretable measures of uncertainty and have been shown to outperform state-of-the-art ensemble approaches on a range of tasks. They can also be used to distill an…

Machine Learning · Computer Science 2020-12-10 Andrey Malinin , Sergey Chervontsev , Ivan Provilkov , Mark Gales

One aim shared by multiple settings, such as continual learning or transfer learning, is to leverage previously acquired knowledge to converge faster on the current task. Usually this is done through fine-tuning, where an implicit…

Machine Learning · Computer Science 2023-10-17 Tudor Berariu , Wojciech Czarnecki , Soham De , Jorg Bornschein , Samuel Smith , Razvan Pascanu , Claudia Clopath

Pretrained deep models hold their learnt knowledge in the form of model parameters. These parameters act as "memory" for the trained models and help them generalize well on unseen data. However, in absence of training data, the utility of a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Gaurav Kumar Nayak , Konda Reddy Mopuri , Saksham Jain , Anirban Chakraborty

Self-supervised pre-training for 3D vision has drawn increasing research interest in recent years. In order to learn informative representations, a lot of previous works exploit invariances of 3D features, e.g., perspective-invariance…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Lanxiao Li , Michael Heizmann

As instruction-tuned large language models (LLMs) evolve, aligning pretrained foundation models presents increasing challenges. Existing alignment strategies, which typically leverage diverse and high-quality data sources, often overlook…

Computation and Language · Computer Science 2024-06-10 Yikun Wang , Rui Zheng , Liang Ding , Qi Zhang , Dahua Lin , Dacheng Tao

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainties by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have…

Machine Learning · Statistics 2021-12-17 Sujay Thakur , Cooper Lorsung , Yaniv Yacoby , Finale Doshi-Velez , Weiwei Pan

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Neural Processes (NPs) are a popular class of approaches for meta-learning. Similar to Gaussian Processes (GPs), NPs define distributions over functions and can estimate uncertainty in their predictions. However, unlike GPs, NPs and their…

Machine Learning · Computer Science 2023-02-09 Tung Nguyen , Aditya Grover

The existing internet-scale image and video datasets cover a wide range of everyday objects and tasks, bringing the potential of learning policies that generalize in diverse scenarios. Prior works have explored visual pre-training with…

Robotics · Computer Science 2023-10-24 Xingyu Lin , John So , Sashwat Mahalingam , Fangchen Liu , Pieter Abbeel

As autonomous systems become more complex and integral in our society, the need to accurately model and safely control these systems has increased significantly. In the past decade, there has been tremendous success in using deep learning…

Robotics · Computer Science 2024-09-10 Hao Wang , Javier Borquez , Somil Bansal

Existing popular unsupervised embedding learning methods focus on enhancing the instance-level local discrimination of the given unlabeled images by exploring various negative data. However, the existed sample outliers which exhibit large…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Jiahuan Zhou , Yansong Tang , Bing Su , Ying Wu

To provide rigorous uncertainty quantification for online learning models, we develop a framework for constructing uncertainty sets that provably control risk -- such as coverage of confidence intervals, false negative rate, or F1 score --…

Machine Learning · Computer Science 2023-01-30 Shai Feldman , Liran Ringel , Stephen Bates , Yaniv Romano

Regression methods are fundamental for scientific and technological applications. However, fitted models can be highly unreliable outside of their training domain, and hence the quantification of their uncertainty is crucial in many of…

Machine Learning · Statistics 2024-03-05 Filippo Bigi , Sanggyu Chong , Michele Ceriotti , Federico Grasselli

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön