English
Related papers

Related papers: On the Asymptotic Bias of the Diffusion-Based Dist…

200 papers

For massive data stored at multiple machines, we propose a distributed subsampling procedure for the composite quantile regression. By establishing the consistency and asymptotic normality of the composite quantile regression estimator from…

Computation · Statistics 2023-01-09 Xiaohui Yuan , Shiting Zhou , Yue Wang

We derive asymptotically optimal statistical decision rules for discrete choice problems when payoffs depend on a partially-identified parameter $\theta$ and the decision maker can use a point-identified parameter $\mu$ to deduce…

Econometrics · Economics 2025-12-19 Timothy Christensen , Hyungsik Roger Moon , Frank Schorfheide

This paper presents a new approach to distributed linear filtering and prediction. The problem under consideration consists of a random dynamical system observed by a multi-agent network of sensors where the network is sparse. Inspired by…

Systems and Control · Electrical Eng. & Systems 2022-03-08 Subhro Das

The objective of this paper is to investigate a new numerical method for the approximation of the self-diffusion matrix of a tagged particle process defined on a grid. While standard numerical methods make use of long-time averages of…

Numerical Analysis · Mathematics 2023-02-27 Jad Dabaghi , Virginie Ehrlacher , Christoph Strössner

Recent results concerning asymptotic Bayes-optimality under sparsity (ABOS) of multiple testing procedures are extended to fairly generally distributed effect sizes under the alternative. An asymptotic framework is considered where both the…

Statistics Theory · Mathematics 2011-07-13 Florian Frommlet , Arijit Chakrabarti , Magdalena Murawska , Malgorzata Bogdan

We consider distributed detection problems over adaptive networks, where dispersed agents learn continually from streaming data by means of local interactions. The simultaneous requirements of adaptation and cooperation are achieved by…

Multiagent Systems · Computer Science 2016-01-27 Vincenzo Matta , Paolo Braca , Stefano Marano , Ali H. Sayed

We consider minimizing a sum of non-smooth objective functions with set constraints in a distributed manner. As to this problem, we propose a distributed algorithm with an exponential convergence rate for the first time. By the exact…

Optimization and Control · Mathematics 2020-01-06 Weijian Li , Xianlin Zeng , Shu Liang , Yiguang Hong

This work studies the learning ability of consensus and diffusion distributed learners from continuous streams of data arising from different but related statistical distributions. Four distinctive features for diffusion learners are…

Optimization and Control · Mathematics 2016-07-19 Zaid J. Towfic , Jianshu Chen , Ali H. Sayed

This paper considers nonconvex distributed constrained optimization over networks, modeled as directed (possibly time-varying) graphs. We introduce the first algorithmic framework for the minimization of the sum of a smooth nonconvex…

Optimization and Control · Mathematics 2018-09-05 Gesualdo Scutari , Ying Sun

Over the last 20 years significant effort has been dedicated to the development of sampling-based motion planning algorithms such as the Rapidly-exploring Random Trees (RRT) and its asymptotically optimal version (e.g. RRT*). However,…

Robotics · Computer Science 2014-05-13 Georgios Papadopoulos , Hanna Kurniawati , Nicholas M. Patrikalakis

This paper proposes distributed algorithms to solve robust convex optimization (RCO) when the constraints are affected by nonlinear uncertainty. We adopt a scenario approach by randomly sampling the uncertainty set. To facilitate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Keyou You , Roberto Tempo , Pei Xie

This paper gives a general method for deriving limiting distributions of complete case statistics for missing data models from corresponding results for the model where all data are observed. This provides a convenient tool for obtaining…

Statistics Theory · Mathematics 2013-02-20 Hira L. Koul , Ursula U. Müller , Anton Schick

The paper studies decentralized optimization over networks, where agents minimize a composite objective consisting of the sum of smooth convex functions--the agents' losses--and an additional nonsmooth convex extended value function. We…

Optimization and Control · Mathematics 2025-08-05 Xiaokai Chen , Ilya Kuruzov , Gesualdo Scutari , Alexander Gasnikov

We introduce a two-stage probabilistic framework for statistical downscaling using unpaired data. Statistical downscaling seeks a probabilistic map to transform low-resolution data from a biased coarse-grained numerical scheme to…

Machine Learning · Computer Science 2023-11-01 Zhong Yi Wan , Ricardo Baptista , Yi-fan Chen , John Anderson , Anudhyan Boral , Fei Sha , Leonardo Zepeda-Núñez

This paper studies some asymptotic properties of adaptive algorithms widely used in optimization and machine learning, and among them Adagrad and Rmsprop, which are involved in most of the blackbox deep learning algorithms. Our setup is the…

Machine Learning · Statistics 2020-12-15 Sébastien Gadat , Ioana Gavra

The seminal paper of Jordan, Kinderlehrer, and Otto introduced what is now widely known as the JKO scheme, an iterative algorithmic framework for computing distributions. This scheme can be interpreted as a Wasserstein gradient flow and has…

Machine Learning · Statistics 2025-01-15 Shang Wu , Yazhen Wang

In this paper, we propose a distributed algorithm for the minimum dominating set problem. For some especial networks, we prove theoretically that the achieved answer by our proposed algorithm is a constant approximation factor of the exact…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-05 Sharareh Alipour , Ehsan Futuhi , Shayan Karimi

We consider exact asymptotics of the minimax risk for global testing against sparse alternatives in the context of high dimensional linear regression. Our results characterize the leading order behavior of this minimax risk in several…

Statistics Theory · Mathematics 2020-03-03 Rajarshi Mukherjee , Subhabrata Sen

We develop and analyze an asynchronous algorithm for distributed convex optimization when the objective writes a sum of smooth functions, local to each worker, and a non-smooth function. Unlike many existing methods, our distributed…

Optimization and Control · Mathematics 2019-12-13 Konstantin Mishchenko , Franck Iutzeler , Jérôme Malick

In this paper, a novel diffusion estimation algorithm is proposed from a probabilistic perspective by combining diffusion strategy and the probabilistic least-mean-squares (PLMS) at all agents. The proposed method diffusion probabilistic…

Signal Processing · Electrical Eng. & Systems 2019-08-27 Sihai Guan , Chun Meng , Bharat Biswal