English
Related papers

Related papers: Consensus Based Multi-Layer Perceptrons for Edge C…

200 papers

The inference of Neural Networks is usually restricted by the resources (e.g., computing power, memory, bandwidth) on edge devices. In addition to improving the hardware design and deploying efficient models, it is possible to aggregate the…

Machine Learning · Computer Science 2021-11-05 Jun-Liang Lin , Sheng-De Wang

We study a new variant of consensus problems, termed `local average consensus', in networks of agents. We consider the task of using sensor networks to perform distributed measurement of a parameter which has both spatial (in this paper 1D)…

Systems and Control · Computer Science 2013-09-02 Kai Cai , Brian D. O. Anderson , Changbin Yu , Guoqiang Mao

The perceptual loss has been widely used as an effective loss term in image synthesis tasks including image super-resolution, and style transfer. It was believed that the success lies in the high-level perceptual feature representations…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Yifan Liu , Hao Chen , Yu Chen , Wei Yin , Chunhua Shen

Many of the distributed localization algorithms are based on relaxed optimization formulations of the localization problem. These algorithms commonly rely on first-order optimization methods, and hence may require many iterations or…

Optimization and Control · Mathematics 2016-07-19 Sina Khoshfetrat Pakazad , Emre Özkan , Carsten Fritsche , Anders Hansson , Fredrik Gustafsson

Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. For example, language models can improve speech recognition and text entry, and image…

Machine Learning · Computer Science 2023-01-30 H. Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , Blaise Agüera y Arcas

Motivated by the proliferation of Internet-of-Thing (IoT) devices and the rapid advances in the field of deep learning, there is a growing interest in pushing deep learning computations, conventionally handled by the cloud, to the edge of…

Machine Learning · Computer Science 2024-09-25 Marco Palena , Tania Cerquitelli , Carla Fabiana Chiasserini

In this paper, we describe a conceptual design methodology to design distributed neural network architectures that can perform efficient inference within sensor networks with communication bandwidth constraints. The different sensor…

Machine Learning · Computer Science 2022-10-17 Thomas Strypsteen , Alexander Bertrand

The increasing number of wireless devices operating in unlicensed spectrum motivates the development of intelligent adaptive approaches to spectrum access. We consider decentralized contention-based medium access for base stations (BSs)…

Information Theory · Computer Science 2021-10-15 Akash Doshi , Srinivas Yerramalli , Lorenzo Ferrari , Taesang Yoo , Jeffrey G. Andrews

In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication…

Machine Learning · Computer Science 2012-04-17 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

We give the first provably efficient algorithm for learning a one hidden layer convolutional network with respect to a general class of (potentially overlapping) patches. Additionally, our algorithm requires only mild conditions on the…

Machine Learning · Computer Science 2018-02-08 Surbhi Goel , Adam Klivans , Raghu Meka

NextG networks are intended to provide the flexibility of sharing the spectrum with incumbent users and support various spectrum monitoring tasks such as anomaly detection, fault diagnostics, user equipment identification, and…

Networking and Internet Architecture · Computer Science 2022-04-08 Yi Shi , Yalin E. Sagduyu , Tugba Erpek

Federated learning enables many applications benefiting distributed and private datasets of a large number of potential data-holding clients. However, different clients usually have their own particular objectives in terms of the tasks to…

Machine Learning · Computer Science 2022-07-19 Cihat Keçeci , Mohammad Shaqfeh , Hayat Mbayed , Erchin Serpedin

This invited paper presents some novel ideas on how to enhance the performance of consensus algorithms in distributed wireless sensor networks, when communication costs are considered. Of particular interest are consensus algorithms that…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-04 Steffen Limmer , Slawomir Stanczak , Mario Goldenbaum , Renato L. G. Cavalcante

Distributed averaging is among the most relevant cooperative control problems, with applications in sensor and robotic networks, distributed signal processing, data fusion, and load balancing. Consensus and gossip algorithms have been…

Systems and Control · Electrical Eng. & Systems 2023-09-06 Christel Sirocchi , Alessandro Bogliolo

This paper presents novel Gaussian process decentralized data fusion algorithms exploiting the notion of agent-centric support sets for distributed cooperative perception of large-scale environmental phenomena. To overcome the limitations…

Machine Learning · Statistics 2017-11-17 Ruofei Ouyang , Kian Hsiang Low

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

In this paper we propose and analyze a distributed algorithm for achieving globally optimal decisions, either estimation or detection, through a self-synchronization mechanism among linearly coupled integrators initialized with local…

Information Theory · Computer Science 2016-11-15 Gesualdo Scutari , Sergio Barbarossa , Loreto Pescosolido

This paper considers the distributed consensus problem of multi-agent systems with general continuous-time linear dynamics. Two distributed adaptive dynamic consensus protocols are proposed, based on the relative output information of…

Systems and Control · Computer Science 2015-01-20 Zhongkui Li , Xiangdong Liu , Wei Ren , Lihua Xie

This paper proposes a method for accurately estimating the relative position between two nodes with unknown locations in a diffusion-based molecular communication environment. A specialized node structure is designed, combining a central…

Signal Processing · Electrical Eng. & Systems 2025-09-10 Sangjun Hwang , Chan-Byoung Chae

The distributed coordination of robot teams performing complex tasks is challenging to formulate. The different aspects of a complete task such as local planning for obstacle avoidance, global goal coordination and collaborative mapping are…

Robotics · Computer Science 2023-10-04 Aalok Patwardhan , Andrew J. Davison