English
Related papers

Related papers: Optimisation of Stochastic Programming by Hidden M…

200 papers

Stochastic volatility models are the backbone of financial engineering. We study both continuous time diffusions as well as discrete time models. We propose two novel approaches to estimating stochastic volatility diffusions, one using…

Quantum Physics · Physics 2025-07-30 Eric Ghysels , Jack Morgan , Hamed Mohammadbagherpoor

This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…

Optimization and Control · Mathematics 2020-04-22 Yuk-Loong Chow , Xiang Yu , Chao Zhou

We present a new method for nonlinear prediction of discrete random sequences under minimal structural assumptions. We give a mathematical construction for optimal predictors of such processes, in the form of hidden Markov models. We then…

Machine Learning · Computer Science 2011-11-09 Cosma Rohilla Shalizi , Kristina Lisa Shalizi

Many real-world systems are characterized by stochastic dynamical rules where a complex network of interactions among individual elements probabilistically determines their state. Even with full knowledge of the network structure and of the…

Physics and Society · Physics 2018-05-15 Filippo Radicchi , Claudio Castellano

In this paper, an approach to estimating a nonlinear deterministic model is presented. We introduce a stochastic model with extremely small variances so that the deterministic and stochastic models are essentially indistinguishable from…

Methodology · Statistics 2015-11-13 Spyridon J. Hatjispyros , Stephen G. Walker

Well-designed queuing systems form the backbone of modern communications, distributed computing, and content delivery architectures. Designs balancing infrastructure costs and user experience indices require tools from teletraffic theory…

Information Theory · Computer Science 2019-07-23 Srujan Teja Thomdapu , Ketan Rajawat

One of the most fundamental problems in Markov decision processes is analysis and control synthesis for safety and reachability specifications. We consider the stochastic reach-avoid problem, in which the objective is to synthesize a…

Optimization and Control · Mathematics 2017-10-09 Nikolaos Kariotoglou , Maryam Kamgarpour , Tyler Summers , John Lygeros

Many real-world problems encountered in several disciplines deal with the modeling of time-series containing different underlying dynamical regimes, for which probabilistic approaches are very often employed. In this paper we describe…

Machine Learning · Statistics 2015-03-19 Silvia Chiappa

Probabilistic programs with mixed support (both continuous and discrete latent random variables) commonly appear in many probabilistic programming systems (PPSs). However, the existence of the discrete random variables prohibits many basic…

Machine Learning · Computer Science 2020-03-06 David Tolpin , Yuan Zhou , Hongseok Yang

Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…

Probability · Mathematics 2014-03-10 Christophe Andrieu , Matti Vihola

Multi-model ensembles provide a pragmatic approach to the representation of model uncertainty in climate prediction. However, such representations are inherently ad hoc, and, as shown, probability distributions of climate variables based on…

Atmospheric and Oceanic Physics · Physics 2009-08-26 T. N. Palmer , F. J. Doblas-Reyes , A. Weisheimer , G. J. Shutts , J. Berner , J. M. Murphy

We develop a predictive-first optimisation framework for streaming hidden Markov models. Unlike classical approaches that prioritise full posterior recovery under a fully specified generative model, we assume access to regime-specific…

Machine Learning · Statistics 2026-04-13 Gerardo Duran-Martin

Worldwide commitments to net zero greenhouse emissions have accelerated investments in renewable energy resources. The requirements for operating and planning power systems are becoming stringent because of the need to take into account the…

Optimization and Control · Mathematics 2022-07-21 Aiusha Sangadiev , Alvaro Gonzalez-Castellanos , David Pozo

This paper introduces a performative scenario optimization framework for decision-dependent chance-constrained problems. Unlike classical stochastic optimization, we account for the feedback loop where decisions actively shape the…

Computer Science and Game Theory · Computer Science 2026-04-01 Quanyan Zhu , Zhengye Han

The concepts of probability, statistics and stochastic theory are being successfully used in structural engineering. Markov Chain modelling is a simple stochastic process model that has found its application in both describing stochastic…

Applications · Statistics 2007-08-14 K. Balaji Rao

In this paper we propose a problem-driven scenario generation approach to the single-period portfolio selection problem which use tail risk measures such as conditional value-at-risk. Tail risk measures are useful for quantifying potential…

Risk Management · Quantitative Finance 2019-11-14 Jamie Fairbrother , Amanda Turner , Stein Wallace

Scenario generation is an effective data-driven method for solving chance-constrained optimization while ensuring desired risk guarantees with a finite number of samples. Crucial challenges in deploying this technique in the real world…

Optimization and Control · Mathematics 2024-01-04 Qian Zhang , Apurv Shukla , Le Xie

This paper studies a continuous-time market {under stochastic environment} where an agent, having specified an investment horizon and a target terminal mean return, seeks to minimize the variance of the return with multiple stocks and a…

Portfolio Management · Quantitative Finance 2013-02-28 Wan-Kai Pang , Yuan-Hua Ni , Xun Li , Ka-Fai Cedric Yiu

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

Optimization and Control · Mathematics 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

We present a new method for nonlinear prediction of discrete random sequences under minimal structural assumptions. We give a mathematical construction for optimal predictors of such processes, in the form of hidden Markov models. We then…

Machine Learning · Computer Science 2014-08-12 Cosma Shalizi , Kristina Lisa Klinkner