English
Related papers

Related papers: Analyzing Divergence for Nondeterministic Probabil…

200 papers

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik

Deep learning models, such as wide neural networks, can be conceptualized as nonlinear dynamical physical systems characterized by a multitude of interacting degrees of freedom. Such systems in the infinite limit, tend to exhibit simplified…

Machine Learning · Computer Science 2024-01-09 Ori Shem-Ur , Yaron Oz

This paper is concerned with relationships of weakly mixing, topologically weakly mixing, and sensitivity for non-autonomous discrete systems. It is shown that weakly mixing implies topologically weakly mixing and sensitivity for measurable…

Dynamical Systems · Mathematics 2016-06-07 Hua Shao , Yuming Shi , Hao Zhu

In this paper we propose definitions of equivalence via stochastic bisimulation and of equivalence of stochastic external behavior for the class of discrete-time stochastic linear control systems with possibly degenerate normally…

Optimization and Control · Mathematics 2016-11-28 Giordano Pola , Costanzo Manes , Arjan J. van der Schaft , Maria Domenica Di Benedetto

Classical learning theory suggests that the optimal generalization performance of a machine learning model should occur at an intermediate model complexity, with simpler models exhibiting high bias and more complex models exhibiting high…

Machine Learning · Statistics 2020-11-09 Ben Adlam , Jeffrey Pennington

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks.…

Machine Learning · Computer Science 2023-05-24 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

This paper explores the well known approximation approach to decide weak bisimilarity of Basic Parallel Processes. We look into how different refinement functions can be used to prove weak bisimilarity decidable for certain subclasses. We…

Formal Languages and Automata Theory · Computer Science 2012-08-15 Piotr Hofman , Patrick Totzke

The causal (belief) network is a well-known graphical structure for representing independencies in a joint probability distribution. The exact methods and the approximation methods, which perform probabilistic inference in causal networks,…

Artificial Intelligence · Computer Science 2013-04-05 Richard E. Neapolitan , James Kenevan

The analysis of decision making under uncertainty is closely related to the analysis of probabilistic inference. Indeed, much of the research into efficient methods for probabilistic inference in expert systems has been motivated by the…

Artificial Intelligence · Computer Science 2013-03-25 Ross D. Shachter , Mark Alan Peot

The process of decomposing a complex system into simpler subsystems has been of interest to computer scientists over many decades, for instance, for the field of distributed computing. In this paper, motivated by the desire to distribute…

Formal Languages and Automata Theory · Computer Science 2019-08-26 Omar al Duhaiby , Jan Friso Groote

We study the problem of cooperative inference where a group of agents interact over a network and seek to estimate a joint parameter that best explains a set of observations. Agents do not know the network topology or the observations of…

Optimization and Control · Mathematics 2017-04-11 Angelia Nedić , Alex Olshevsky , César A. Uribe

Strong bisimilarity on normed BPA is polynomial-time decidable, while weak bisimilarity on totally normed BPA is NP-hard. It is natural to ask where the computational complexity of branching bisimilarity on totally normed BPA lies. This…

Logic in Computer Science · Computer Science 2014-11-18 Chaodong He

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the…

Machine Learning · Computer Science 2019-02-19 Ravi Mangal , Aditya V. Nori , Alessandro Orso

Weak bisimilarity is a distribution-based equivalence notion for Markov automata. It has gained some popularity as the coarsest reasonable behavioural equivalence on Markov automata. This paper studies a strictly coarser notion: Late weak…

Formal Languages and Automata Theory · Computer Science 2014-01-15 Christian Eisentraut , Jens Chr. Godskesen , Holger Hermanns , Lei Song , Lijun Zhang

Sensitivity methods for the analysis of the outputs of discrete Bayesian networks have been extensively studied and implemented in different software packages. These methods usually focus on the study of sensitivity functions and on the…

Artificial Intelligence · Computer Science 2016-07-05 Manuele Leonelli , Christiane Görgen , Jim Q. Smith

Accurate probabilistic predictions can be characterized by two properties -- calibration and sharpness. However, standard maximum likelihood training yields models that are poorly calibrated and thus inaccurate -- a 90% confidence interval…

Machine Learning · Computer Science 2025-05-14 Volodymyr Kuleshov , Shachi Deshpande

We introduce estimation and test procedures through divergence minimization for models satisfying linear constraints with unknown parameter. Several statistical examples and motivations are given. These procedures extend the empirical…

Statistics Theory · Mathematics 2008-11-24 Michel Broniatowski , Amor Keziou

Motivated by applications in databases, this paper considers various fragments of the calculus of binary relations. The fragments are obtained by leaving out, or keeping in, some of the standard operators, along with some derived operators…

Logic in Computer Science · Computer Science 2014-03-31 George H. L. Fletcher , Marc Gyssens , Dirk Leinders , Jan Van den Bussche , Dirk Van Gucht , Stijn Vansummeren

Several application domains require formal but flexible approaches to the comparison problem. Different process models that cannot be related by behavioral equivalences should be compared via a quantitative notion of similarity, which is…

Logic in Computer Science · Computer Science 2010-06-29 Alessandro Aldini

When eliciting probability models from experts, knowledge engineers may compare the results of the model with expert judgment on test scenarios, then adjust model parameters to bring the behavior of the model more in line with the expert's…

Artificial Intelligence · Computer Science 2013-03-08 Kathryn Blackmond Laskey