English
Related papers

Related papers: Asymptotic Dynamics of Alternating Minimization fo…

200 papers

In many practical applications, evaluating the joint impact of combinations of environmental variables is important for risk management and structural design analysis. When such variables are considered simultaneously, non-stationarity can…

Applications · Statistics 2024-04-23 C. J. R. Murphy-Barltrop , J. L. Wadsworth

In this paper, a centralized two-block separable optimization is considered for which a fully parallel primal-dual discrete-time algorithm with fixed step size is derived based on monotone operator splitting method. In this algorithm, the…

Optimization and Control · Mathematics 2020-09-30 S. Sh. Alaviani , A. G. Kelkar

The discrete stochastic dynamics of a random walker in the presence of resetting and memory is analyzed. Resetting and memory effects may compete for certain parameter regime and lead to significant changes in the long time dynamics of the…

Statistical Mechanics · Physics 2023-11-15 Upendra Harbola

We develop a new method for multivariate scalar on multidimensional distribution regression. Traditional approaches typically analyze isolated univariate scalar outcomes or consider unidimensional distributional representations as…

Methodology · Statistics 2023-10-17 Rahul Ghosal , Marcos Matabuena

The objective of the present paper is to develop a minimax theory for the varying coefficient model in a non-asymptotic setting. We consider a high-dimensional sparse varying coefficient model where only few of the covariates are present…

Statistics Theory · Mathematics 2014-05-16 Olga Klopp , Marianna Pensky

When optimizing over-parameterized models, such as deep neural networks, a large set of parameters can achieve zero training error. In such cases, the choice of the optimization algorithm and its respective hyper-parameters introduces…

Machine Learning · Computer Science 2019-12-06 Gauthier Gidel , Francis Bach , Simon Lacoste-Julien

In time series analysis, statistics based on collections of estimators computed from sub-samples play a crucial role in an increasing variety of important applications. Proving results about the joint asymptotic distribution of such…

Statistics Theory · Mathematics 2013-05-27 Stanislav Volgushev , Xiaofeng Shao

Theory and algorithms are developed for detecting changes in the distribution of statistically periodic random processes. The statistical periodicity is modeled using independent and periodically identically distributed processes, a new…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Taposh Banerjee , Prudhvi Gurram , Gene Whipps

New algorithms for computing of asymptotic expansions for stationary distributions of nonlinearly perturbed semi-Markov processes are presented. The algorithms are based on special techniques of sequential phase space reduction, which can…

Probability · Mathematics 2017-03-08 Dmitrii Silvestrov , Sergei Silvestrov

The paper presents a distributed model predictive control (DMPC) scheme for continuous-time nonlinear systems based on the alternating direction method of multipliers (ADMM). A stopping criterion in the ADMM algorithm limits the iterations…

Optimization and Control · Mathematics 2017-06-30 Anja Bestler , Knut Graichen

This paper studies a distributed stochastic optimization problem over random networks with imperfect communications subject to a global constraint, which is the intersection of local constraint sets assigned to agents. The global cost…

Optimization and Control · Mathematics 2016-07-25 Jinlong Lei , Han-Fu Chen , Hai-Tao Fang

The asymptotic behavior of stochastic gradient algorithms is studied. Relying on results from differential geometry (Lojasiewicz gradient inequality), the single limit-point convergence of the algorithm iterates is demonstrated and…

Optimization and Control · Mathematics 2013-09-19 Vladislav B. Tadic

For solving pseudo-convex global optimization problems, we present a novel fully adaptive steepest descent method (or ASDM) without any hard-to-estimate parameters. For the step-size regulation in an $\varepsilon$-normalized direction, we…

Optimization and Control · Mathematics 2021-08-12 Z. R. Gabidullina

We formulate and study a general family of (continuous-time) stochastic dynamics for accelerated first-order minimization of smooth convex functions. Building on an averaging formulation of accelerated mirror descent, we propose a…

Optimization and Control · Mathematics 2017-07-20 Walid Krichene , Peter L. Bartlett

We consider varying-coefficient models for mixed synchronous and asynchronous longitudinal covariates, where asynchronicity refers to the misalignment of longitudinal measurement times within an individual. We propose three different…

Methodology · Statistics 2023-05-30 Congmin Liu , Zhuowei Sun , Hongyuan Cao

The distributed dual ascent is an established algorithm to solve strongly convex multi-agent optimization problems with separable cost functions, in the presence of coupling constraints. In this paper, we study its asynchronous counterpart.…

Optimization and Control · Mathematics 2021-05-05 Mattia Bianchi , Wicak Ananduta , Sergio Grammatico

In this paper we study the asymptotic behavior of a stochastic approximation scheme on two timescales with set-valued drift functions and in the presence of non-additive iterate-dependent Markov noise. It is shown that the recursion on each…

Systems and Control · Computer Science 2016-11-21 Vinayaka Yaji , Shalabh Bhatnagar

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce…

Machine Learning · Computer Science 2023-10-31 Dominik Straub , Matthias Schultheis , Heinz Koeppl , Constantin A. Rothkopf

We study the asymptotic behavior of a diffusion process with small diffusion in a domain $D$. This process is reflected at $\partial D$ with respect to a co-normal direction pointing inside $D$. Our asymptotic result is used to study the…

Probability · Mathematics 2014-04-22 Wenqing Hu , Lucas Tcheuko