English
Related papers

Related papers: Concentration-Bound Analysis for Probabilistic Pro…

200 papers

This paper presents a detailed theoretical analysis of the three stochastic approximation proximal gradient algorithms proposed in our companion paper [49] to set regularization parameters by marginal maximum likelihood estimation. We prove…

Statistics Theory · Mathematics 2020-08-14 Valentin De Bortoli , Alain Durmus , Ana F. Vidal , Marcelo Pereyra

In this article, we discuss two algorithms tailored to discrete-time deterministic finite-horizon nonlinear optimal control problems or so-called deterministic trajectory optimization problems. Both algorithms can be derived from an…

Optimization and Control · Mathematics 2024-12-10 Mohammad Mahmoudi Filabadi , Tom Lefebvre , Guillaume Crevecoeur

Motivated by applications in online bidding and sleeping bandits, we examine the problem of contextual bandits with cross learning, where the learner observes the loss associated with the action across all possible contexts, not just the…

Machine Learning · Computer Science 2025-01-27 Ruiyuan Huang , Zengfeng Huang

An algorithm is proposed, analyzed, and tested for solving continuous nonlinear-equality-constrained optimization problems where the objective and constraint functions are defined by expectations or averages over large, finite numbers of…

Optimization and Control · Mathematics 2026-05-14 Frank E. Curtis , Lingjun Guo , Daniel P. Robinson

Large deviations for additive path functionals of stochastic processes have attracted significant research interest, in particular in the context of stochastic particle systems and statistical physics. Efficient numerical `cloning'…

Probability · Mathematics 2021-07-21 Letizia Angeli , Stefan Grosskinsky , Adam M. Johansen

This thesis is concerned with continuous, static, and single-objective optimization problems subject to inequality constraints. Nevertheless, some methods to handle other kinds of problems are briefly reviewed. The particle swarm…

Neural and Evolutionary Computing · Computer Science 2021-01-27 Mauro S. Innocente

We present a data-driven approach to the quantitative verification of probabilistic programs and stochastic dynamical models. Our approach leverages neural networks to compute tight and sound bounds for the probability that a stochastic…

Logic in Computer Science · Computer Science 2026-04-22 Alessandro Abate , Alec Edwards , Mirco Giacobbe , Hashan Punchihewa , Diptarko Roy

In container terminal yards, the Container Rehandling Problem (CRP) involves rearranging containers between stacks under specific operational rules, and it is a pivotal optimization challenge in intelligent container scheduling systems.…

Artificial Intelligence · Computer Science 2025-04-22 Ruoqi Wang , Jiawei Li

We address the reachability problem for continuous-time stochastic dynamic systems. Our objective is to present a unified framework that characterizes the reachable set of a dynamic system in the presence of both stochastic disturbances and…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Saber Jafarpour , Zishun Liu , Yongxin Chen

This note is concerned with weakly interacting stochastic particle systems with possibly singular pairwise interactions. In this setting, we observe a connection between entropic propagation of chaos and exponential concentration bounds for…

Probability · Mathematics 2024-06-06 Joe Jackson , Antonios Zitridis

We present a probabilistic model for stochastic iterative algorithms with the use case of optimization algorithms in mind. Based on this model, we present PAC-Bayesian generalization bounds for functions that are defined on the trajectory…

Machine Learning · Computer Science 2024-08-22 Michael Sucker , Peter Ochs

Many quantitative properties of probabilistic programs can be characterized as least fixed points, but verifying their lower bounds remains a challenging problem. We present a new approach to lower-bound verification that exploits and…

Logic in Computer Science · Computer Science 2026-04-21 Satoshi Kura , Hiroshi Unno , Takeshi Tsukada

In this paper, we introduce a method for approximating the solution to inference and optimization tasks in uncertain and deterministic reasoning. Such tasks are in general intractable for exact algorithms because of the large number of…

Artificial Intelligence · Computer Science 2012-12-12 David Ephraim Larkin

As has long been known to computer scientists, the performance of probabilistic algorithms characterized by relatively large runtime fluctuations can be improved by applying a restart, i.e., episodic interruption of a randomized…

Statistical Mechanics · Physics 2023-06-21 Dmitry Starkov , Sergey Belan

The popular LSPE($\lambda$) algorithm for policy evaluation is revisited to derive a concentration bound that gives high probability performance guarantees from some time on.

Machine Learning · Computer Science 2022-12-01 Siddharth Chandak , Vivek S. Borkar , Harsh Dolhare

This work introduces a stochastic model predictive control scheme for dynamic chance constraints. We consider linear discrete-time systems affected by unbounded additive stochastic disturbance. To synthesize an optimal controller, we solve…

Systems and Control · Electrical Eng. & Systems 2023-07-26 Maico Hendrikus Wilhelmus Engelaar , Sofie Haesaert , Mircea Lazar

This paper considers data-driven chance-constrained stochastic optimization problems in a Bayesian framework. Bayesian posteriors afford a principled mechanism to incorporate data and prior knowledge into stochastic optimization problems.…

Statistics Theory · Mathematics 2023-08-07 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

The standard approach to analyzing the asymptotic complexity of probabilistic programs is based on studying the asymptotic growth of certain expected values (such as the expected termination time) for increasing input size. We argue that…

Formal Languages and Automata Theory · Computer Science 2023-07-13 Michal Ajdarów , Antonín Kučera

In this paper, we tackle the resolution of chance-constrained problems reformulated via Sample Average Approximation. The resulting data-driven deterministic reformulation takes the form of a large-scale mixed-integer program cursed with…

Optimization and Control · Mathematics 2023-06-27 Álvaro Porras , Concepción Domínguez , Juan M. Morales , Salvador Pineda

We initiate a systematic study of utilizing predictions to improve over approximation guarantees of classic algorithms, without increasing the running time. We propose a systematic method for a wide class of optimization problems that ask…

Data Structures and Algorithms · Computer Science 2024-11-26 Antonios Antoniadis , Marek Eliáš , Adam Polak , Moritz Venzin