English
Related papers

Related papers: Asymptotic Dynamics of Alternating Minimization fo…

200 papers

Rerandomization is an effective treatment allocation procedure to control for baseline covariate imbalance. For estimating the average treatment effect, rerandomization has been previously shown to improve the precision of the unadjusted…

Methodology · Statistics 2026-05-18 Bingkai Wang , Fan Li

A $d$-dimensional nonparametric additive regression model with dependent observations is considered. Using the marginal integration technique and wavelets methodology, we develop a new adaptive estimator for a component of the additive…

Statistics Theory · Mathematics 2012-08-07 Christophe Chesneau , Jalal M. Fadili , Bertrand Maillot

We consider estimation procedures which are recursive in the sense that each successive estimator is obtained from the previous one by a simple adjustment. The model considered in the paper is very general as we do not impose any…

Statistics Theory · Mathematics 2007-05-23 Teo Sharia

We present a hybrid systems framework for multi-agent optimization in which agents execute computations in continuous time and communicate in discrete time. The optimization algorithm is a hybrid version of parallelized coordinate descent.…

Optimization and Control · Mathematics 2021-10-04 Katherine Hendrickson , Dawn Hustig-Schultz , Matthew Hale , Ricardo G. Sanfelice

In this paper, we establish the almost sure convergence of two-timescale stochastic gradient descent algorithms in continuous time under general noise and stability conditions, extending well known results in discrete time. We analyse…

Optimization and Control · Mathematics 2021-10-01 Louis Sharrock , Nikolas Kantas

We discuss parametric estimation of a degenerate diffusion system from time-discrete observations. The first component of the degenerate diffusion system has a parameter $\theta_1$ in a non-degenerate diffusion coefficient and a parameter…

Statistics Theory · Mathematics 2020-02-25 Arnaud Gloter , Nakahiro Yoshida

In this note, we study distributed time-varying optimization for a multi-agent system. We first focus on a class of time-varying quadratic cost functions, and develop a new distributed algorithm that integrates an average estimator and an…

Systems and Control · Electrical Eng. & Systems 2024-08-06 Liangze Jiang , Zheng-Guang Wu , Lei Wang

We consider the consensual distributed optimization problem and propose an asynchronous version of the Alternating Direction Method of Multipliers (ADMM) algorithm to solve it. The `asynchronous' part here refers to the fact that only one…

Optimization and Control · Mathematics 2022-04-01 Suhail M. Shah , Konstantin E. Avrachenkov

This paper focuses on recursive estimation of time varying autoregressive processes in a nonparametric setting. The stability of the model is revisited and uniform results are provided when the time-varying autoregressive parameters belong…

Statistics Theory · Mathematics 2007-06-13 Eric Moulines , Pierre Priouret , François Roueff

We study the coarsening dynamics of a two dimensional system via lattice Boltzmann numerical simulations. The system under consideration is a biphasic system consisting of domains of a dispersed phase closely packed together in a continuous…

Soft Condensed Matter · Physics 2020-10-07 Francesca Pelusi , Mauro Sbragaglia , Roberto Benzi

Many important challenges in science and technology can be cast as optimization problems. When viewed in a statistical physics framework, these can be tackled by simulated annealing, where a gradual cooling procedure helps search for…

Disordered Systems and Neural Networks · Physics 2024-01-17 Mohamed Hibat-Allah , Estelle M. Inack , Roeland Wiersema , Roger G. Melko , Juan Carrasquilla

We discuss relaxation and aging processes in the one- and two-dimensional $ABC$ models. In these driven diffusive systems of three particle types, biased exchanges in one direction yield a coarsening process characterized in the long time…

Statistical Mechanics · Physics 2015-05-13 Mark O. Brown , Robert H. Galyean , Xiangwen Wang , Michel Pleimling

This paper investigates gradient-based adaptive prediction and control for nonlinear stochastic dynamical systems under a weak convexity condition on the prediction-based loss. This condition accommodates a broad range of nonlinear models…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Yujing Liu , Xin Zheng , Zhixin Liu , Lei Guo

The alternating direction method of multipliers (ADMM) is a widely used method for solving many convex minimization models arising in signal and image processing. In this paper, we propose an inertial ADMM for solving a two-block separable…

Optimization and Control · Mathematics 2021-04-02 Yang Yang , Yuchao Tang

Mixed linear regression involves the recovery of two (or more) unknown vectors from unlabeled linear measurements; that is, where each sample comes from exactly one of the vectors, but we do not know which one. It is a classic problem, and…

Machine Learning · Statistics 2014-02-10 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

Multiscale dynamics are ubiquitous in applications of modern science. Because of time scale separation between relatively small set of slowly evolving variables and (typically) much larger set of rapidly changing variables, direct numerical…

Dynamical Systems · Mathematics 2016-04-08 Rafail V. Abramov

We use analytical techniques based on an expansion in the inverse system size to study the stochastic evolutionary dynamics of finite populations of players interacting in a repeated prisoner's dilemma game. We show that a mechanism of…

Populations and Evolution · Quantitative Biology 2012-04-20 Alex J. Bladon , Tobias Galla , Alan J. McKane

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

Numerical Analysis · Mathematics 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

We study the existence, strong consistency and asymptotic normality of estimators obtained from estimating functions, that are p-dimensional martingale transforms. The problem is motivated by the analysis of evolutionary clustered data,…

Statistics Theory · Mathematics 2020-12-01 Laura Dumitrescu , Ioana Schiopu-Kratina

Dynamical systems theory has long provided a foundation for understanding evolving phenomena across scientific domains. Yet, the application of this theory to complex real-world systems remains challenging due to issues in mathematical…

Machine Learning · Computer Science 2024-11-05 Samuel A. Moore , Brian P. Mann , Boyuan Chen