English
Related papers

Related papers: Concentration-Bound Analysis for Probabilistic Pro…

200 papers

While techniques have been developed for chance constrained stochastic optimal control using sample disturbance data that provide a probabilistic confidence bound for chance constraint satisfaction, far less is known about how to use sample…

Systems and Control · Electrical Eng. & Systems 2023-03-31 Shawn Priore , Meeko Oishi

Many practitioners who use the EM algorithm complain that it is sometimes slow. When does this happen, and what can be done about it? In this paper, we study the general class of bound optimization algorithms - including…

Machine Learning · Computer Science 2012-12-12 Ruslan R Salakhutdinov , Sam T Roweis , Zoubin Ghahramani

Online learning methods yield sequential regret bounds under minimal assumptions and provide in-expectation risk bounds for statistical learning. However, despite the apparent advantage of online guarantees over their statistical…

Machine Learning · Computer Science 2023-08-16 Dirk van der Hoeven , Nikita Zhivotovskiy , Nicolò Cesa-Bianchi

Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for…

Systems and Control · Electrical Eng. & Systems 2023-10-05 Alexandre Capone , Tim Brüdigam , Sandra Hirche

Causal discovery studies the problem of mining causal relationships between variables from data, which is of primary interest in science. During the past decades, significant amount of progresses have been made toward this fundamental data…

Artificial Intelligence · Computer Science 2016-11-28 Kui Yu , Jiuyong Li , Lin Liu

Even if path planning can be solved using standard techniques from dynamic programming and control, the problem can also be approached using probabilistic inference. The algorithms that emerge using the latter framework bear some appealing…

Finite-sum optimization plays an important role in the area of machine learning, and hence has triggered a surge of interest in recent years. To address this optimization problem, various randomized incremental gradient methods have been…

Machine Learning · Computer Science 2022-06-22 Min Zhang , Yao Shu , Kun He

Quantum algorithms and complexity have recently been studied not only for discrete, but also for some numerical problems. Most attention has been paid so far to the integration problem, for which a speed-up is shown by quantum computers…

Quantum Physics · Physics 2007-05-23 Boleslaw Kacewicz

Run-times of quantum algorithms are often studied via an asymptotic, worst-case analysis. Whilst useful, such a comparison can often fall short: it is not uncommon for algorithms with a large worst-case run-time to end up performing well on…

Quantum Physics · Physics 2023-10-11 Chris Cade , Marten Folkertsma , Ido Niesen , Jordi Weggemans

Finite-precision floating point arithmetic unavoidably introduces rounding errors which are traditionally bounded using a worst-case analysis. However, worst-case analysis might be overly conservative because worst-case errors can be…

Numerical Analysis · Mathematics 2019-12-11 Fredrik Dahlqvist , Rocco Salvia , George A Constantinides

Probabilistic verification problems of neural networks are concerned with formally analysing the output distribution of a neural network under a probability distribution of the inputs. Examples of probabilistic verification problems include…

Machine Learning · Computer Science 2025-07-11 David Boetius , Stefan Leue , Tobias Sutter

We derive new concentration bounds for time averages of measurement outcomes in quantum Markov processes. This generalizes well-known bounds for classical Markov chains which provide constraints on finite time fluctuations of time-additive…

Quantum Physics · Physics 2023-07-19 Federico Girotti , Juan P. Garrahan , Mădălin Guţă

Stochastic programming is often challenged by epistemic uncertainty, where critical probability distributions are poorly characterized or unknown due to a lack of data. To address this, we pioneer a novel framework for stochastic…

Optimization and Control · Mathematics 2026-05-19 Shixin Liu , Ming Gao , Jian Hu

In this paper, we obtain fundamental $\mathcal{L}_{p}$ bounds in sequential prediction and recursive algorithms via an entropic analysis. Both classes of problems are examined by investigating the underlying entropic relationships of the…

Machine Learning · Computer Science 2021-05-12 Song Fang , Quanyan Zhu

We consider the task of performing probabilistic inference with probabilistic logical models. Many algorithms for approximate inference with such models are based on sampling. From a logic programming perspective, sampling boils down to…

Artificial Intelligence · Computer Science 2015-03-19 Daan Fierens

We examine a multi-stage stochastic optimization problem characterized by stagewise-independent, decision-dependent noises with strict constraints. The problem assumes convexity in that, following a specific relaxation, it transforms into a…

Optimization and Control · Mathematics 2023-08-28 Chen Yan , Alexandre Reiffers-Masson

This paper presents a wp-style calculus for obtaining expectations on the outcomes of (mutually) recursive probabilistic programs. We provide several proof rules to derive one-- and two--sided bounds for such expectations, and show the…

Logic in Computer Science · Computer Science 2016-03-10 Federico Olmedo , Benjamin Lucien Kaminski , Joost-Pieter Katoen , Christoph Matheja

We present a focused introduction to exact penalty methods for nonlinear programs and mathematical programs with equilibrium constraints (MPECs), emphasizing their connection to modern error bound theory. The goal is twofold. First, we…

Optimization and Control · Mathematics 2026-05-04 Louis Shuo Wang

In this article we consider the problem of choosing an optimal sampling scheme for the regression problem simultaneously with that of model selection. We consider a batch type approach and an on-line approach following algorithms recently…

Statistics Theory · Mathematics 2018-01-30 Ana Karina Fermin , Carenne Ludeña

Chance-constrained programs (CCPs) constitute a difficult class of stochastic programs due to its possible nondifferentiability and nonconvexity even with simple linear random functionals. Existing approaches for solving the CCPs mainly…

Optimization and Control · Mathematics 2022-03-02 Ying Cui , Junyi Liu , Jong-Shi Pang