English
Related papers

Related papers: Real-Time Uncertainty Estimation in Computer Visio…

200 papers

Deep learning has grown tremendously over recent years, yielding state-of-the-art results in various fields. However, training such models requires huge amounts of data, increasing the computational time and cost. To address this, dataset…

Machine Learning · Computer Science 2023-07-18 Murad Tukan , Alaa Maalouf , Margarita Osadchy

Measurement of uncertainty of predictions from machine learning methods is important across scientific domains and applications. We present, to our knowledge, the first such technique that quantifies the uncertainty of predictions from a…

Machine Learning · Statistics 2022-04-04 Alex Hagen , Karl Pazdernik , Nicole LaHaye , Marjolein Oostrom

Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such…

Machine Learning · Computer Science 2019-12-06 Peter Grönquist , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Luca Lavarini , Shigang Li , Torsten Hoefler

For an unknown continuous distribution on a real line, we consider the approximate estimation by the discretization. There are two methods for the discretization. First method is to divide the real line into several intervals before taking…

Statistics Theory · Mathematics 2017-10-12 Yo Sheena

Knowledge distillation is an effective technique that transfers knowledge from a large teacher model to a shallow student. However, just like massive classification, large scale knowledge distillation also imposes heavy computational costs…

Machine Learning · Computer Science 2018-12-04 Minghan Li , Tanli Zuo , Ruicheng Li , Martha White , Weishi Zheng

Real-time CNN-based object detection models for applications like surveillance can achieve high accuracy but are computationally expensive. Recent works have shown 10 to 100x reduction in computation cost for inference by using…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Kentaro Yoshioka , Edward Lee , Simon Wong , Mark Horowitz

Finding a person across a camera network plays an important role in video surveillance. For a real-world person re-identification application, in order to guarantee an optimal time response, it is crucial to find the balance between…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Idoia Ruiz , Bogdan Raducanu , Rakesh Mehta , Jaume Amores

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

Machine Learning · Computer Science 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

With the advancements made in deep learning, computer vision problems like object detection and segmentation have seen a great improvement in performance. However, in many real-world applications such as autonomous driving vehicles, the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Kumari Deepshikha , Sai Harsha Yelleni , P. K. Srijith , C Krishna Mohan

In recent years, machine learning has witnessed extensive adoption across various sectors, yet its application in medical image-based disease detection and diagnosis remains challenging due to distribution shifts in real-world data. In…

Machine Learning · Computer Science 2024-02-13 Masoumeh Javanbakhat , Md Tasnimul Hasan , Cristoph Lippert

Virtual Diagnostic (VD) is a deep learning tool that can be used to predict a diagnostic output. VDs are especially useful in systems where measuring the output is invasive, limited, costly or runs the risk of damaging the output. Given a…

Accelerator Physics · Physics 2021-08-02 Owen Convery , Lewis Smith , Yarin Gal , Adi Hanuka

Depth estimation and scene segmentation are two important tasks in intelligent transportation systems. A joint modeling of these two tasks will reduce the requirement for both the storage and training efforts. This work explores how the…

Machine Learning · Computer Science 2025-05-16 Tiancong Cheng , Ying Zhang , Yuxuan Liang , Roger Zimmermann , Zhiwen Yu , Bin Guo

Deep learning has shown tremendous progress in a wide range of digital pathology and medical image classification tasks. Its integration into safe clinical decision-making support requires robust and reliable models. However, real-world…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Abdur R. Fayjie , Jutika Borah , Florencia Carbone , Jan Tack , Patrick Vandewalle

Techniques such as ensembling and distillation promise model quality improvements when paired with almost any base model. However, due to increased test-time cost (for ensembles) and increased complexity of the training pipeline (for…

Machine Learning · Computer Science 2020-08-24 Rohan Anil , Gabriel Pereyra , Alexandre Passos , Robert Ormandi , George E. Dahl , Geoffrey E. Hinton

Uncertainty estimation bears the potential to make deep learning (DL) systems more reliable. Standard techniques for uncertainty estimation, however, come along with specific combinations of strengths and weaknesses, e.g., with respect to…

Machine Learning · Computer Science 2022-05-02 Joachim Sicking , Maram Akila , Jan David Schneider , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

Camera localization, i.e., camera pose regression, represents an important task in computer vision since it has many practical applications such as in the context of intelligent vehicles and their localization. Having reliable estimates of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Matteo Vaghi , Augusto Luis Ballardini , Simone Fontana , Domenico Giorgio Sorrenti

Medical images are increasingly used as input to deep neural networks to produce quantitative values that aid researchers and clinicians. However, standard deep neural networks do not provide a reliable measure of uncertainty in those…

Image and Video Processing · Electrical Eng. & Systems 2020-02-19 Jacob C. Reinhold , Yufan He , Shizhong Han , Yunqiang Chen , Dashan Gao , Junghoon Lee , Jerry L. Prince , Aaron Carass

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…