English
Related papers

Related papers: Analyzing Divergence for Nondeterministic Probabil…

200 papers

In this paper, we perform deep neural networks for learning $\psi$-weakly dependent processes. Such weak-dependence property includes a class of weak dependence conditions such as mixing, association,$\cdots$ and the setting considered here…

Machine Learning · Statistics 2023-02-02 William Kengne , Wade Modou

Bayesian inference can quantify uncertainty in the predictions of neural networks using posterior distributions for model parameters and network output. By looking at these posterior distributions, one can separate the origin of uncertainty…

Machine Learning · Computer Science 2023-11-23 H. Linander , O. Balabanov , H. Yang , B. Mehlig

Even though probabilistic treatments of neural networks have a long history, they have not found widespread use in practice. Sampling approaches are often too slow already for simple networks. The size of the inputs and the depth of typical…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Jochen Gast , Stefan Roth

Being a promising model to be deployed in resource-limited devices, Binarized Neural Networks (BNNs) have drawn extensive attention from both academic and industry. However, comparing to the full-precision deep neural networks (DNNs), BNNs…

Machine Learning · Computer Science 2022-06-08 Yanfei Li , Ang Li , Huimin Yu

Robustness in deep neural networks and machine learning algorithms in general is an open research challenge. In particular, it is difficult to ensure algorithmic performance is maintained on out-of-distribution inputs or anomalous instances…

Machine Learning · Computer Science 2022-11-23 Natalie Abreu , Nathan Vaska , Victoria Helus

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

We consider the nonparametric regression and the classification problems for $\psi$-weakly dependent processes. This weak dependence structure is more general than conditions such as, mixing, association, $\ldots$. A penalized estimation…

Machine Learning · Statistics 2023-03-03 William Kengne , Modou Wade

Correlations and other collective phenomena in a schematic model of heterogeneous binary agents (individual spin-glass samples) are considered on the complete graph and also on 2d and 3d regular lattices. The system's stochastic dynamics is…

Disordered Systems and Neural Networks · Physics 2014-02-25 Imre Kondor , István Csabai , Gábor Papp , Enys Mones , Gábor Czimbalmos , Máté Csaba Sándor

When the historical data are limited, the conditional probabilities associated with the nodes of Bayesian networks are uncertain and can be empirically estimated. Second order estimation methods provide a framework for both estimating the…

Machine Learning · Statistics 2022-08-09 Conrad D. Hougen , Lance M. Kaplan , Federico Cerutti , Alfred O. Hero

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

We explore language semantics for automata combining probabilistic and nondeterministic behavior. We first show that there are precisely two natural semantics for probabilistic automata with nondeterminism. For both choices, we show that…

Formal Languages and Automata Theory · Computer Science 2018-05-30 Gerco van Heerdt , Justin Hsu , Joël Ouaknine , Alexandra Silva

Despite achieving excellent performance on benchmarks, deep neural networks often underperform in real-world deployment due to sensitivity to minor, often imperceptible shifts in input data, known as distributional shifts. These shifts are…

Machine Learning · Computer Science 2025-09-25 Birk Torpmann-Hagen , Pål Halvorsen , Michael A. Riegler , Dag Johansen

We tackle the problem of bias mitigation of algorithmic decisions in a setting where both the output of the algorithm and the sensitive variable are continuous. Most of prior work deals with discrete sensitive variables, meaning that the…

Empirical studies of graphs have contributed enormously to our understanding of complex systems. Known today as network science, what was originally a theoretical study of graphs has grown into a more scientific exploration of communities…

Quantitative Methods · Quantitative Biology 2020-01-01 Ryan E. Langendorf , Debra S. Goldberg

The paper studies binary classification and aims at estimating the underlying regression function which is the conditional expectation of the class labels given the inputs. The regression function is the key component of the Bayes optimal…

Machine Learning · Statistics 2019-03-26 Balázs Csanád Csáji , Ambrus Tamás

Gradients and subgradients are central to optimization and sensitivity analysis of buffered failure probabilities. We furnish a characterization of subgradients based on subdifferential calculus in the case of finite probability…

Optimization and Control · Mathematics 2021-10-26 Johannes O. Royset , Ji-Eun Byun

We introduce $(\gamma,\delta)$-similarity, a notion of system comparison that measures to what extent two stable linear dynamical systems behave similarly in an input-output sense. This behavioral similarity is characterized by measuring…

Optimization and Control · Mathematics 2023-12-20 Armin Pirastehzad , Arjan van der Schaft , Bart Besselink

Advances in architectural design, data availability, and compute have driven remarkable progress in semantic segmentation. Yet, these models often rely on relaxed Bayesian assumptions, omitting critical uncertainty information needed for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 M. M. A. Valiuddin , R. J. G. van Sloun , C. G. A. Viviers , P. H. N. de With , F. van der Sommen

The problem of comparing concepts of dependence in general rough sets with those in probability theory had been initiated by the present author in some of her recent papers. This problem relates to the identification of the limitations of…

Logic · Mathematics 2018-04-09 A Mani

Deep neural networks have achieved impressive performance on a variety of tasks, but their brittleness to distributional shifts remains a significant barrier to real-world deployment. In this paper, we propose a framework to analyse and…

Machine Learning · Computer Science 2026-05-21 Divij Khaitan , Subhashis Banerjee