English
Related papers

Related papers: Tackling Algorithmic Bias in Neural-Network Classi…

200 papers

We propose a parameter efficient Bayesian layer for hierarchical convolutional Gaussian Processes that incorporates Gaussian Processes operating in Wasserstein-2 space to reliably propagate uncertainty. This directly replaces convolving…

Machine Learning · Statistics 2021-04-29 Sebastian G. Popescu , David J. Sharp , James H. Cole , Konstantinos Kamnitsas , Ben Glocker

Computer vision systems that are deployed in safety-critical applications need to quantify their output uncertainty. We study regression from images to parameter values and here it is common to detect uncertainty by predicting probability…

Machine Learning · Computer Science 2024-06-24 Ziliang Xiong , Arvi Jonnarth , Abdelrahman Eldesokey , Joakim Johnander , Bastian Wandt , Per-Erik Forssen

We propose a novel end-to-end non-minimax algorithm for training optimal transport mappings for the quadratic cost (Wasserstein-2 distance). The algorithm uses input convex neural networks and a cycle-consistency regularization to…

Machine Learning · Computer Science 2020-12-11 Alexander Korotin , Vage Egiazarian , Arip Asadulaev , Alexander Safin , Evgeny Burnaev

Traditionally, quantization is designed to minimize the reconstruction error of a data source. When considering downstream classification tasks, other measures of distortion can be of interest; such as the 0-1 classification loss.…

Machine Learning · Computer Science 2021-07-22 Daniel Severo , Elad Domanovitz , Ashish Khisti

Deep learning models, including modern systems like large language models, are well known to offer unreliable estimates of the uncertainty of their decisions. In order to improve the quality of the confidence levels, also known as…

Machine Learning · Computer Science 2024-04-15 Jiayi Huang , Sangwoo Park , Osvaldo Simeone

The key distinguishing property of a Bayesian approach is marginalization, rather than using a single setting of weights. Bayesian marginalization can particularly improve the accuracy and calibration of modern deep neural networks, which…

Machine Learning · Computer Science 2022-03-31 Andrew Gordon Wilson , Pavel Izmailov

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Recent advancements in reinforcement learning (RL) have achieved great success in fine-tuning diffusion-based generative models. However, fine-tuning continuous flow-based generative models to align with arbitrary user-defined reward…

Machine Learning · Computer Science 2025-02-11 Jiajun Fan , Shuaike Shen , Chaoran Cheng , Yuxin Chen , Chumeng Liang , Ge Liu

Deep neural networks rely heavily on normalization methods to improve their performance and learning behavior. Although normalization methods spurred the development of increasingly deep and efficient architectures, they also increase the…

Machine Learning · Computer Science 2021-10-06 Alexander Fuchs , Christian Knoll , Franz Pernkopf

From the statistical learning perspective, complexity control via explicit regularization is a necessity for improving the generalization of over-parameterized models. However, the impressive generalization performance of neural networks…

Machine Learning · Computer Science 2021-02-09 Taejong Joo , Uijung Chung

Wasserstein barycenters provide a geometric notion of the weighted average of probability measures based on optimal transport. In this paper, we present a scalable algorithm to compute Wasserstein-2 barycenters given sample access to the…

Machine Learning · Computer Science 2022-01-02 Alexander Korotin , Lingxiao Li , Justin Solomon , Evgeny Burnaev

Deep neural networks are known to be vulnerable to adversarial attacks (AA). For an image recognition task, this means that a small perturbation of the original can result in the image being misclassified. Design of such attacks as well as…

Machine Learning · Computer Science 2023-06-19 Xingjian Bai , Guangyi He , Yifan Jiang , Jan Obloj

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

Machine Learning · Computer Science 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

Despite superior performance in many situations, deep neural networks are often vulnerable to adversarial examples and distribution shifts, limiting model generalization ability in real-world applications. To alleviate these problems,…

Machine Learning · Computer Science 2023-02-14 Hoang Phan , Trung Le , Trung Phung , Tuan Anh Bui , Nhat Ho , Dinh Phung

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks.…

Machine Learning · Computer Science 2023-05-24 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

The purpose of training neural networks is to achieve high generalization performance on unseen inputs. However, when trained on imbalanced datasets, a model's prediction tends to favor majority classes over minority classes, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Hiroaki Aizawa , Yuta Naito , Kohei Fukuda

Recent works have shown that deep neural networks can achieve super-human performance in a wide range of image classification tasks in the medical imaging domain. However, these works have primarily focused on classification accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Gongbo Liang , Yu Zhang , Xiaoqin Wang , Nathan Jacobs

Deep neural networks with millions of parameters may suffer from poor generalization due to overfitting. To mitigate the issue, we propose a new regularization method that penalizes the predictive distribution between similar samples. In…

Machine Learning · Computer Science 2020-04-08 Sukmin Yun , Jongjin Park , Kimin Lee , Jinwoo Shin

Wasserstein-GANs have been introduced to address the deficiencies of generative adversarial networks (GANs) regarding the problems of vanishing gradients and mode collapse during the training, leading to improved convergence behaviour and…

Machine Learning · Computer Science 2019-12-17 Jan Müller , Reinhard Klein , Michael Weinmann