中文
相关论文

相关论文: Higher Dimensional Consensus: Learning in Large-Sc…

200 篇论文

This paper presents NCOTA-DGD, a Decentralized Gradient Descent (DGD) algorithm that combines local gradient descent with a novel Non-Coherent Over-The-Air (NCOTA) consensus scheme to solve distributed machine-learning problems over…

信息论 · 计算机科学 2023-02-06 Nicolò Michelusi

This paper addresses active state estimation with a team of robotic sensors. The states to be estimated are represented by spatially distributed, uncorrelated, stationary vectors. Given a prior belief on the geographic locations of the…

机器人学 · 计算机科学 2018-01-16 Charles Freundlich , Yan Zhang , Michael M. Zavlanos

Decentralized optimization, particularly the class of decentralized composite convex optimization (DCCO) problems, has found many applications. Due to ubiquitous communication congestion and random dropouts in practice, it is highly…

最优化与控制 · 数学 2022-10-12 Changxin Liu , Zirui Zhou , Jian Pei , Yong Zhang , Yang Shi

Complex data in social and natural sciences find effective representation through networks, wherein quantitative and categorical information can be associated with nodes and connecting edges. The internal structure of networks can be…

社会与信息网络 · 计算机科学 2024-08-07 Fabio Morea , Domenico De Stefano

This paper studies the consensus problem of heterogeneous multi-agent systems by the feedforward control and linear quadratic (LQ) optimal control theory. Different from the existing consensus control algorithms, which require to design an…

最优化与控制 · 数学 2024-03-19 Liping Zhang , Huanshui Zhang

Abstract. The advancement of deep learning has coincided with the proliferation of both models and available data. The surge in dataset sizes and the subsequent surge in computational requirements have led to the development of the Dataset…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Jun-Yeong Moon , Jung Uk Kim , Gyeong-Moon Park

ADMM is a popular algorithm for solving convex optimization problems. Applying this algorithm to distributed consensus optimization problem results in a fully distributed iterative solution which relies on processing at the nodes and…

分布式、并行与集群计算 · 计算机科学 2017-01-17 Layla Majzoobi , Farshad Lahouti

Multi-view clustering aims to study the complementary information across views and discover the underlying structure. For solving the relatively high computational cost for the existing approaches, works based on anchor have been presented…

机器学习 · 计算机科学 2024-09-26 Yalan Qin , Nan Pu , Hanzhou Wu , Nicu Sebe

We introduce the problem of asymptotic subspace consensus, which requires the outputs of processes to converge onto a common subspace while remaining inside the convex hull of initial vectors.This is a relaxation of asymptotic consensus in…

分布式、并行与集群计算 · 计算机科学 2026-02-24 Matthias Függer , Thomas Nowak

In this paper, we study distributed consensus in the radio network setting. We produce new upper and lower bounds for this problem in an abstract MAC layer model that captures the key guarantees provided by most wireless MAC layers. In more…

分布式、并行与集群计算 · 计算机科学 2014-05-07 Calvin Newport

Distributed optimization algorithms have been studied extensively in the literature; however, underlying most algorithms is a linear consensus scheme, i.e. averaging variables from neighbors via doubly stochastic matrices. We consider…

最优化与控制 · 数学 2023-03-14 Hsu Kao , Vijay Subramanian

This paper introduces some tools from graph theory and distributed consensus algorithms to construct an optimal, yet robust, hierarchical information sharing structure for large-scale decision making and control problems. The proposed…

系统与控制 · 计算机科学 2012-08-16 Amir Noori

Congestions in wireless sensor networks (WSNs) could potentially cause packet loss, throughput impairment and energy waste. To address this issue, a hop-by-hop cross-layer congestion control scheme (HCCC) built on contention-based MAC…

网络与互联网体系结构 · 计算机科学 2012-01-04 Guowei Wu , Feng Xia , Lin Yao , Yan Zhang , Yanwei Zhu

Distributed Compressive Sensing (DCS) improves the signal recovery performance of multi signal ensembles by exploiting both intra- and inter-signal correlation and sparsity structure. However, the existing DCS was proposed for a very…

信息论 · 计算机科学 2012-11-29 Jeonghun Park , Seunggye Hwang , Janghoon Yang , Dongku Kim

By mimicking brain-like cognition and exploiting parallelism, hyperdimensional computing (HDC) classifiers have been emerging as a lightweight framework to achieve efficient on-device inference. Nonetheless, they have two fundamental…

机器学习 · 计算机科学 2022-04-04 Shijin Duan , Xiaolin Xu , Shaolei Ren

We study asymptotic performance of distributed detection in large scale connected sensor networks. Contrasting to the canonical parallel network where a single node has access to local decisions from all other nodes, each node can only…

信息论 · 计算机科学 2018-10-16 Shengyu Zhu , Biao Chen

Consensus-based decentralized stochastic gradient descent (D-SGD) is a widely adopted algorithm for decentralized training of machine learning models across networked agents. A crucial part of D-SGD is the consensus-based model averaging,…

信息论 · 计算机科学 2025-02-12 Daniel Pérez Herrera , Zheng Chen , Erik G. Larsson

Deep neural networks have achieved remarkable success in various challenging tasks. However, the black-box nature of such networks is not acceptable to critical applications, such as healthcare. In particular, the existence of adversarial…

机器学习 · 计算机科学 2019-09-12 Shaeke Salman , Seyedeh Neelufar Payrovnaziri , Xiuwen Liu , Pablo Rengifo-Moreno , Zhe He

This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation…

机器学习 · 计算机科学 2023-10-11 Haishan Ye , Luo Luo , Ziang Zhou , Tong Zhang

Federated learning performed by a decentralized networks of agents is becoming increasingly important with the prevalence of embedded software on autonomous devices. Bayesian approaches to learning benefit from offering more information as…

机器学习 · 计算机科学 2021-07-16 Vyacheslav Kungurtsev , Adam Cobb , Tara Javidi , Brian Jalaian