English
Related papers

Related papers: Systemic Performance Measures from Distributional …

200 papers

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are distributed (unevenly) over an extremely large number of \nodes, but the goal remains to…

Machine Learning · Computer Science 2015-11-12 Jakub Konečný , Brendan McMahan , Daniel Ramage

In this dissertation we propose alternative analysis of distributed stochastic gradient descent (SGD) algorithms that rely on spectral properties of the data covariance. As a consequence we can relate questions pertaining to speedups and…

Optimization and Control · Mathematics 2016-09-03 Avleen S. Bijral

Phasor measurement units (PMUs) have the advantage of providing direct measurements of power states. However, as the number of PMUs in a power system is limited, the traditional supervisory control and data acquisition (SCADA) system cannot…

Systems and Control · Computer Science 2016-07-12 Jian Du , Shaodan Ma , Yik-Chung Wu , H. Vincent Poor

Distributed power control over interference limited network has received an increasing intensity of interest over the past few years. Distributed solutions (like the iterative water-filling, gradient projection, etc.) have been intensively…

Information Theory · Computer Science 2015-05-19 Yong Cheng , Vincent K. N. Lau

Federated learning (FL) is a highly pursued machine learning technique that can train a model centrally while keeping data distributed. Distributed computation makes FL attractive for bandwidth limited applications especially in wireless…

Machine Learning · Computer Science 2020-06-24 Xiang Ma , Haijian Sun , Rose Qingyang Hu

Diffusion probabilistic models (DPMs) have shown remarkable performance in visual synthesis but are computationally expensive due to the need for multiple evaluations during the sampling. Recent predictor-corrector diffusion samplers have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Wenliang Zhao , Haolin Wang , Jie Zhou , Jiwen Lu

This paper proposes distributed estimation procedures for three scalar-on-function regression models: the functional linear model (FLM), the functional non-parametric model (FNPM), and the functional partial linear model (FPLM). The…

Computation · Statistics 2026-01-08 Peilun He , Han Lin Shang , Nan Zou

We introduce Statistical Flow Matching (SFM), a novel and mathematically rigorous flow-matching framework on the manifold of parameterized probability measures inspired by the results from information geometry. We demonstrate the…

Machine Learning · Computer Science 2025-11-26 Chaoran Cheng , Jiahan Li , Jian Peng , Ge Liu

Score estimation is the backbone of score-based generative models (SGMs), especially denoising diffusion probabilistic models (DDPMs). A key result in this area shows that with accurate score estimates, SGMs can efficiently generate samples…

Machine Learning · Statistics 2025-04-08 Sinho Chewi , Alkis Kalavasis , Anay Mehrotra , Omar Montasser

Dynamic fragmentation simulations are essential for predicting material response at high strain rates, yet explicit dynamic simulations that combine an extrinsic cohesive-zone model (CZM) with penalty-based contact often exhibit severe…

Computational Physics · Physics 2025-11-19 Thibault Ghesquière-Diérickx , Jean-François Molinari , Guillaume Anciaux

Federated learning (FL) and split learning (SL) are state-of-the-art distributed machine learning techniques to enable machine learning training without accessing raw data on clients or end devices. However, their \emph{comparative training…

Machine Learning · Computer Science 2021-03-05 Yansong Gao , Minki Kim , Chandra Thapa , Sharif Abuadbba , Zhi Zhang , Seyit A. Camtepe , Hyoungshick Kim , Surya Nepal

This paper considers the problem of distributed estimation in a sensor network, where multiple sensors are deployed to infer the state of a linear time-invariant (LTI) Gaussian system. By proposing a lossless decomposition of Kalman filter,…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Jiaqi Yan , Yilin Mo , Hideaki Ishii

This paper proposes a fully decentralized federated learning (FL) scheme for Internet of Everything (IoE) devices that are connected via multi-hop networks. Because FL algorithms hardly converge the parameters of machine learning (ML)…

Networking and Internet Architecture · Computer Science 2022-10-05 Akihito Taya , Takayuki Nishio , Masahiro Morikura , Koji Yamamoto

We study the compressive diffusion strategies over distributed networks based on the diffusion implementation and adaptive extraction of the information from the compressed diffusion data. We demonstrate that one can achieve a comparable…

Systems and Control · Computer Science 2015-06-18 Muhammed O. Sayin , Suleyman S. Kozat

Distributed algorithms for solving coupled semidefinite programs (SDPs) commonly require many iterations to converge. They also put high computational demand on the computational agents. In this paper we show that in case the coupled…

Optimization and Control · Mathematics 2015-04-30 Sina Khoshfetrat Pakazad , Anders Hansson , Martin S. Andersen , Anders Rantzer

Various distributed optimization methods have been developed for solving problems which have simple local constraint sets and whose objective function is the sum of local cost functions of distributed agents in a network. Motivated by…

Systems and Control · Computer Science 2016-11-17 Tsung-Hui Chang , Angelia Nedić , Anna Scaglione

The inherent heterogeneous structure resulting from user densities and large scale channel effects motivates heterogeneous partial feedback design in heterogeneous networks. In such emerging networks, a distributed scheduling policy which…

Information Theory · Computer Science 2015-06-12 Yichao Huang , Bhaskar D. Rao

Real-time control of distribution networks requires accurate information about the system state. In practice, however, such information is difficult to obtain because real-time measurements are available only at a limited number of…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Oleksii Molodchyk , Omid Mokhtari , Samuel Chevalier , Mads R. Almassalkhi , Timm Faulwasser

For distributed sensor/relay networks, high reliability and power efficiency are often required. However, several implementation issues arise in practice. One such problem is that all the distributed transmitters have limited power supply…

Information Theory · Computer Science 2015-08-05 Po-Chun Fu , Pei-Rong Li , Li-Ming Wei , Chang-Lin Chen , Che Lin

In this paper we discuss a disordered $d$-dimensional Euclidean $\lambda\varphi^{4}$ model. The dominant contribution to the average free energy of this system is written as a series of the replica partition functions of the model. In each…

High Energy Physics - Theory · Physics 2017-09-20 R. Acosta Diaz , G. Menezes , N. F. Svaiter , C. A. D. Zarro