English
Related papers

Related papers: Reversible Markov chain estimation using convex-co…

200 papers

We propose and study a weakly convergent variant of the forward--backward algorithm for solving structured monotone inclusion problems. Our algorithm features a per-iteration deviation vector which provides additional degrees of freedom.…

Optimization and Control · Mathematics 2022-08-15 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

We consider the question of estimating a solution to a system of equations that involve convex nonlinearities, a problem that is common in machine learning and signal processing. Because of these nonlinearities, conventional estimators…

Machine Learning · Computer Science 2018-08-14 Sohail Bahmani , Justin Romberg

We proposed an iterate scheme for solving convex-concave saddle-point problems associated with general convex-concave functions. We demonstrated that when our iterate scheme is applied to a special class of convex-concave functions, which…

Optimization and Control · Mathematics 2023-11-01 Hui Ouyang

We introduce a natural conjugate prior for the transition matrix of a reversible Markov chain. This allows estimation and testing. The prior arises from random walk with reinforcement in the same way the Dirichlet prior arises from…

Statistics Theory · Mathematics 2007-06-13 Persi Diaconis , Silke W. W. Rolles

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Huu Le , Christopher Zach

We discuss the efficient computation of performance, reliability, and availability measures for Markov chains; these metrics, and the ones obtained by combining them, are often called performability measures. We show that this computational…

Numerical Analysis · Mathematics 2019-10-11 Giulio Masetti , Leonardo Robol

We study a general class of convex submodular optimization problems with indicator variables. Many applications such as the problem of inferring Markov random fields (MRFs) with a sparsity or robustness prior can be naturally modeled in…

Optimization and Control · Mathematics 2025-07-09 Shaoning Han , Andrés Gómez

This paper addresses the challenging issue of symmetry in mixed-integer convex optimization problems, which frequently arise in real-world applications such as the unit commitment problem. Although variable aggregation techniques have been…

Optimization and Control · Mathematics 2026-02-05 Junhao Wu , Shaoze Li , Cheng Lu , Zhibin Deng , Shu-Cherng Fang

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm for hidden Markov models, in a…

Machine Learning · Statistics 2015-12-08 Pengyu Wang , Phil Blunsom

Dual decomposition has been successfully employed in a variety of distributed convex optimization problems solved by a network of computing and communicating nodes. Often, when the cost function is separable but the constraints are coupled,…

Optimization and Control · Mathematics 2017-09-18 Andrea Simonetto , Hadi Jamali-Rad

We show how the solution to NMPC problems for a special type of input-affine discrete-time systems can be obtained by reformulating the underlying non-convex optimal control problem in terms of a finite number of convex subproblems. The…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Manuel Klädtke , Moritz Schulze Darup

We propose a computationally efficient estimator, formulated as a convex program, for a broad class of non-linear regression problems that involve difference of convex (DC) non-linearities. The proposed method can be viewed as a significant…

Machine Learning · Statistics 2019-04-01 Sohail Bahmani

In this note, we provide an overarching analysis of primal-dual dynamics associated to linear equality-constrained optimization problems using contraction analysis. For the well-known standard version of the problem: we establish…

Systems and Control · Electrical Eng. & Systems 2021-06-22 Pedro Cisneros-Velarde , Saber Jafarpour , Francesco Bullo

We present a new class of interacting Markov chain Monte Carlo algorithms for solving numerically discrete-time measure-valued equations. The associated stochastic processes belong to the class of self-interacting Markov chains. In contrast…

Probability · Mathematics 2010-09-30 Pierre Del Moral , Arnaud Doucet

We study stochastic optimization algorithms for constrained nonconvex stochastic optimization problems with Markovian data. In particular, we focus on the case when the transition kernel of the Markov chain is state-dependent. Such…

Optimization and Control · Mathematics 2022-11-10 Abhishek Roy , Krishnakumar Balasubramanian , Saeed Ghadimi

This work investigates the finite-horizon optimal covariance steering problem for discrete-time linear systems subject to both additive and multiplicative uncertainties as well as state and input chance constraints. In particular, a…

Optimization and Control · Mathematics 2023-01-19 Jacob Knaup , Panagiotis Tsiotras

In this paper, we propose an approach to obtain reduced-order models of Markov chains. Our approach is composed of two information-theoretic processes. The first is a means of comparing pairs of stationary chains on different state spaces,…

Information Theory · Computer Science 2019-05-01 Isaac J. Sledge , Jose C. Principe

An irreversible Markov-chain Monte Carlo (MCMC) algorithm with skew detailed balance conditions originally proposed by Turitsyn et al. is extended to general discrete systems on the basis of the Metropolis-Hastings scheme. To evaluate the…

Statistical Mechanics · Physics 2016-04-21 Yuji Sakai , Koji Hukushima

We develop a new bidirectional algorithm for estimating Markov chain multi-step transition probabilities: given a Markov chain, we want to estimate the probability of hitting a given target state in $\ell$ steps after starting from a given…

Data Structures and Algorithms · Computer Science 2015-11-05 Siddhartha Banerjee , Peter Lofgren

We show the variational convergence of an irreversible Markov jump process describing a finite stochastic particle system to the solution of a countable infinite system of deterministic time-inhomogeneous quadratic differential equations…

Analysis of PDEs · Mathematics 2025-07-08 Jasper Hoeksema , Chun Yin Lam , André Schlichting