English
Related papers

Related papers: Verification and Parameter Synthesis for Stochasti…

200 papers

Multi-objective probabilistic model checking provides a way to verify several, possibly conflicting, quantitative properties of a stochastic system. It has useful applications in controller synthesis and compositional probabilistic…

Logic in Computer Science · Computer Science 2015-03-20 Vojtech Forejt , Marta Kwiatkowska , David Parker

Modern deep learning methods are very sensitive to many hyperparameters, and, due to the long training times of state-of-the-art models, vanilla Bayesian hyperparameter optimization is typically computationally infeasible. On the other…

Machine Learning · Computer Science 2018-07-06 Stefan Falkner , Aaron Klein , Frank Hutter

We give a Markov chain based perfect sampler for uniform sampling solutions of constraint satisfaction problems (CSP). Under some mild Lov\'asz local lemma conditions where each constraint of the CSP has a small number of forbidden local…

Data Structures and Algorithms · Computer Science 2021-07-09 Kun He , Xiaoming Sun , Kewen Wu

Latent variable models are widely used in social and behavioural sciences, including education, psychology, and political science. With the increasing availability of large and complex datasets, high-dimensional latent variable models have…

Computation · Statistics 2025-12-09 Motonori Oka , Yunxiao Chen , Irini Moustaki

This work targets the development of an efficient abstraction method for formal analysis and control synthesis of discrete-time stochastic hybrid systems (SHS) with linear dynamics. The focus is on temporal logic specifications, both over…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Nathalie Cauchi , Luca Laurenti , Morteza Lahijanian , Alessandro Abate , Marta Kwiatkowska , Luca Cardelli

The Combined Algorithm Selection and Hyperparameter optimization (CASH) is one of the most fundamental problems in Automatic Machine Learning (AutoML). The existing Bayesian optimization (BO) based solutions turn the CASH problem into a…

Machine Learning · Computer Science 2020-12-09 Yang Li , Jiawei Jiang , Jinyang Gao , Yingxia Shao , Ce Zhang , Bin Cui

In this paper, we present a methodology to estimate the parameters of stochastically contaminated models under two contamination regimes. In both regimes, we assume that the original process is a variable length Markov chain that is…

Methodology · Statistics 2017-02-23 Denise Duarte , Sokol Ndreca , Wecsley O. Prates

We study the problem of parameter-free stochastic optimization, inquiring whether, and under what conditions, do fully parameter-free methods exist: these are methods that achieve convergence rates competitive with optimally tuned methods,…

Machine Learning · Computer Science 2024-10-22 Amit Attia , Tomer Koren

We present a general framework for applying learning algorithms and heuristical guidance to the verification of Markov decision processes (MDPs). The primary goal of our techniques is to improve performance by avoiding an exhaustive…

We present a faster symbolic algorithm for the following central problem in probabilistic verification: Compute the maximal end-component (MEC) decomposition of Markov decision processes (MDPs). This problem generalizes the SCC…

Logic in Computer Science · Computer Science 2021-04-16 Krishnendu Chatterjee , Wolfgang Dvořák , Monika Henzinger , Alexander Svozil

This article deals with stochastic processes endowed with the Markov (memoryless) property and evolving over general (uncountable) state spaces. The models further depend on a non-deterministic quantity in the form of a control input, which…

Systems and Control · Computer Science 2015-09-11 Sofie Haesaert , Robert Babuska , Alessandro Abate

Particle swarm optimisation is a metaheuristic algorithm which finds reasonable solutions in a wide range of applied problems if suitable parameters are used. We study the properties of the algorithm in the framework of random dynamical…

Neural and Evolutionary Computing · Computer Science 2015-11-20 J. Michael Herrmann , Adam Erskine , Thomas Joyce

This paper presents a stochastic model predictive control approach for nonlinear systems subject to time-invariant probabilistic uncertainties in model parameters and initial conditions. The stochastic optimal control problem entails a cost…

Optimization and Control · Mathematics 2014-10-17 Stefan Streif , Matthias Karl , Ali Mesbah

We consider the problem of verifying stochastic models of biochemical networks against behavioral properties expressed in temporal logic terms. Exact probabilistic verification approaches such as, for example, CSL/PCTL model checking, are…

Computational Engineering, Finance, and Science · Computer Science 2009-12-15 Paolo Ballarini , Michele Forlin , Tommaso Mazza , Davide Prandi

This paper studies performative risk minimization, a formulation of stochastic optimization under decision-dependent distributions. We consider the general case where the performative risk can be non-convex, for which we develop efficient…

Machine Learning · Computer Science 2024-02-26 Sungwoo Park , Junyeop Kwon , Byeongnoh Kim , Suhyun Chae , Jeeyong Lee , Dabeen Lee

This paper presents a detailed theoretical analysis of the three stochastic approximation proximal gradient algorithms proposed in our companion paper [49] to set regularization parameters by marginal maximum likelihood estimation. We prove…

Statistics Theory · Mathematics 2020-08-14 Valentin De Bortoli , Alain Durmus , Ana F. Vidal , Marcelo Pereyra

We give a Markov chain based algorithm for sampling almost uniform solutions of constraint satisfaction problems (CSPs). Assuming a canonical setting for the Lov\'asz local lemma, where each constraint is violated by a small number of…

Data Structures and Algorithms · Computer Science 2021-04-13 Weiming Feng , Kun He , Yitong Yin

High-order control barrier functions (HOCBFs) can be used to provide autonomous systems with safety, though computational methods to verify and synthesize these functions remain lacking. In this work, we address this need by formulating SOS…

Systems and Control · Electrical Eng. & Systems 2025-02-06 Ellie Pond , Matthew Hale

Consider the problem of minimizing the expected value of a (possibly nonconvex) cost function parameterized by a random (vector) variable, when the expectation cannot be computed accurately (e.g., because the statistics of the random…

Multiagent Systems · Computer Science 2017-12-12 Yang Yang , Gesualdo Scutari , Daniel P. Palomar , Marius Pesavento

In this paper, we present a novel optimization algorithm designed specifically for estimating state-space models to deal with heavy-tailed measurement noise and constraints. Our algorithm addresses two significant limitations found in…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Yifan Yu , Shengjie Xiu , Daniel P. Palomar