English
Related papers

Related papers: A Generalized Markov-Chain Modelling Approach to $…

200 papers

This paper analyzes a (1, $\lambda$)-Evolution Strategy, a randomized comparison-based adaptive search algorithm, optimizing a linear function with a linear constraint. The algorithm uses resampling to handle the constraint. Two cases are…

Optimization and Control · Mathematics 2015-10-16 Alexandre Chotard , Anne Auger , Nikolaus Hansen

This paper provides a new regularization method which is particularly suitable for linear exponentially ill-posed problems. Under logarithmic source conditions (which have a natural interpretation in terms of Sobolev spaces in the…

Numerical Analysis · Mathematics 2020-07-08 Walter Cedric Simo Tao Lee

A common tool in the practice of Markov Chain Monte Carlo is to use approximating transition kernels to speed up computation when the desired kernel is slow to evaluate or intractable. A limited set of quantitative tools exist to assess the…

Probability · Mathematics 2026-01-14 Jeffrey Negrea , Jeffrey S. Rosenthal

In this paper we propose a complete axiomatization of the bisimilarity distance of Desharnais et al. for the class of finite labelled Markov chains. Our axiomatization is given in the style of a quantitative extension of equational logic…

Logic in Computer Science · Computer Science 2023-06-22 Giorgio Bacci , Giovanni Bacci , Kim G. Larsen , Radu Mardare

Most successful applications of deep learning involve similar training and test conditions. However, tasks such as biological sequence design involve searching for sequences that improve desirable properties beyond previously known values,…

Machine Learning · Computer Science 2025-05-27 Sophia Hager , Aleem Khan , Andrew Wang , Nicholas Andrews

The lasso and elastic net are popular regularized regression models for supervised learning. Friedman, Hastie, and Tibshirani (2010) introduced a computationally efficient algorithm for computing the elastic net regularization path for…

Computation · Statistics 2021-03-08 J. Kenneth Tay , Balasubramanian Narasimhan , Trevor Hastie

In the present paper we study a unified approach for Quantum Markov Chains. A new quantum Markov property that generalizes the old one, is discussed. We introduce Markov states and chains on general local algebras, possessing a generic…

Operator Algebras · Mathematics 2018-11-04 Luigi Accardi , Abdessatar Souissi , El Gheteb Soueidy

Over the past years several authors have used the approach of generalized modeling to study the dynamics of food chains and food webs. Generalized models come close to the efficiency of random matrix models, while being as directly…

Populations and Evolution · Quantitative Biology 2011-04-18 Justin D. Yeakel , Dirk Stiefs , Mark Novak , Thilo Gross

We prove a central limit theorem for a general class of adaptive Markov Chain Monte Carlo algorithms driven by sub-geometrically ergodic Markov kernels. We discuss in detail the special case of stochastic approximation. We use the result to…

Probability · Mathematics 2009-11-03 Yves F. Atchade , Gersende Fort

Recently there is a large amount of work devoted to the study of Markov chain stochastic gradient methods (MC-SGMs) which mainly focus on their convergence analysis for solving minimization problems. In this paper, we provide a…

Machine Learning · Statistics 2022-09-19 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

We have identified a potential method for unifying first-order optimizers through the use of variable Second-Moment Exponential Scaling(SMES). We begin with back propagation, addressing classic phenomena such as gradient vanishing and…

Machine Learning · Computer Science 2024-05-30 Gongyue Zhang , Honghai Liu

We address the question of how to use a machine learned parameterization in a general circulation model, and assess its performance both computationally and physically. We take one particular machine learned parameterization…

Atmospheric and Oceanic Physics · Physics 2023-03-03 Cheng Zhang , Pavel Perezhogin , Cem Gultekin , Alistair Adcroft , Carlos Fernandez-Granda , Laure Zanna

We introduce a new embarrassingly parallel parameter learning algorithm for Markov random fields with untied parameters which is efficient for a large class of practical models. Our algorithm parallelizes naturally over cliques and, for…

Machine Learning · Statistics 2014-02-06 Yariv Dror Mizrahi , Misha Denil , Nando de Freitas

We introduce a Metropolis-Hastings Markov chain for Boltzmann distributions of classical spin systems. It relies on approximate tensor network contractions to propose correlated collective updates at each step of the evolution. We present…

We adapt the quasi-monotone method from [2] for composite convex minimization in the stochastic setting. For the proposed numerical scheme we derive the optimal convergence rate in terms of the last iterate, rather than on average as it is…

Optimization and Control · Mathematics 2021-07-09 Vyacheslav Kungurtsev , Vladimir Shikhman

An algorithm for estimating quasi-stationary distribution of finite state space Markov chains has been proven in a previous paper. Now this paper proves a similar algorithm that works for general state space Markov chains under very general…

Probability · Mathematics 2015-03-04 Jose H. Blanchet , Peter Glynn , Shuheng Zheng

We consider linear mixed models in which the observations are grouped. A L1-penalization on the fixed effects coefficients of the log-likelihood obtained by considering the random effects as missing values is proposed. A multicycle ECM…

Computation · Statistics 2013-01-29 Florian Rohart , Magali San-Cristobal , Béatrice Laurent

Markov chains are a natural and well understood tool for describing one-dimensional patterns in time or space. We show how to infer $k$-th order Markov chains, for arbitrary $k$, from finite data by applying Bayesian methods to both…

Statistics Theory · Mathematics 2009-11-13 Christopher C. Strelioff , James P. Crutchfield , Alfred W. Hubler

The Lasso regression is a popular regularization method for feature selection in statistics. Prior to computing the Lasso estimator in both linear and generalized linear models, it is common to conduct a preliminary rescaling of the feature…

Methodology · Statistics 2023-11-21 Anant Mathur , Sarat Moka , Zdravko Botev

Markov decision processes continue to gain in popularity for modeling a wide range of applications ranging from analysis of supply chains and queuing networks to cognitive science and control of autonomous vehicles. Nonetheless, they tend…

Optimization and Control · Mathematics 2023-12-07 Ali Eshragh