English
Related papers

Related papers: Efficient All-reduce for Distributed DNN Training …

200 papers

A fundamental problem in wireless networks is the \emph{minimum spanning tree} (MST) problem: given a set $V$ of wireless nodes, compute a spanning tree $T$, so that the total cost of $T$ is minimized. In recent years, there has been a lot…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-06-07 Maleq Khan , V. S. Anil Kumar , Gopal Pandurangan , Guanhong Pei

Deep neural networks (DNNs) have become a widely deployed model for numerous machine learning applications. However, their fixed architecture, substantial training cost, and significant model redundancy make it difficult to efficiently…

Neural and Evolutionary Computing · Computer Science 2019-05-28 Xiaoliang Dai , Hongxu Yin , Niraj K. Jha

This paper presents a deep reinforcement learning (DRL) solution for power control in wireless communications, describes its embedded implementation with WiFi transceivers for a WiFi network system, and evaluates the performance with…

Networking and Internet Architecture · Computer Science 2022-11-03 Ziad El Jamous , Kemal Davaslioglu , Yalin E. Sagduyu

The pioneer deep neural networks (DNNs) have emerged to be deeper or wider for improving their accuracy in various applications of artificial intelligence. However, DNNs are often too heavy to deploy in practice, and it is often required to…

Machine Learning · Computer Science 2018-07-10 Hankook Lee , Jinwoo Shin

In this research paper, an efficient routing protocol for all optical network (AOL) is proposed. The technique uses wavelength division multiplexing (WDM). The proposed one is different from the conventional AOL protocol in transmission of…

Networking and Internet Architecture · Computer Science 2014-07-25 Kazi Sakib , Mosaddek Hossain Kamal , Upama Kabir

Deep neural networks (DNNs) are known to be vulnerable to adversarial examples/attacks, raising concerns about their reliability in safety-critical applications. A number of defense methods have been proposed to train robust DNNs resistant…

Machine Learning · Computer Science 2021-04-23 Yujing Jiang , Xingjun Ma , Sarah Monazam Erfani , James Bailey

Deep neural networks (DNNs) exploit many layers and a large number of parameters to achieve excellent performance. The training process of DNN models generally handles large-scale input data with many sparse features, which incurs high…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Ji Liu , Zhihua Wu , Dianhai Yu , Yanjun Ma , Danlei Feng , Minxu Zhang , Xinxuan Wu , Xuefeng Yao , Dejing Dou

In recent years the field of neuromorphic low-power systems that consume orders of magnitude less power gained significant momentum. However, their wider use is still hindered by the lack of algorithms that can harness the strengths of such…

Neural and Evolutionary Computing · Computer Science 2016-01-19 Peter U. Diehl , Guido Zarrella , Andrew Cassidy , Bruno U. Pedroni , Emre Neftci

Progressing towards a new era of Artificial Intelligence (AI) - enabled wireless networks, concerns regarding the environmental impact of AI have been raised both in industry and academia. Federated Learning (FL) has emerged as a key…

Permutation matrices form an important computational building block frequently used in various fields including e.g., communications, information security and data processing. Optical implementation of permutation operators with relatively…

Optics · Physics 2022-09-09 Deniz Mengu , Yifan Zhao , Anika Tabassum , Mona Jarrahi , Aydogan Ozcan

Energy harvesting (EH) has recently emerged as a promising technique for green communications. To realize its potential, communication protocols need to be redesigned to combat the randomness of the harvested energy. In this paper, we…

Information Theory · Computer Science 2016-11-17 Yaming Luo , Jun Zhang , Khaled B. Letaief

Deep neural networks (DNN) have shown remarkable success in a variety of machine learning applications. The capacity of these models (i.e., number of parameters), endows them with expressive power and allows them to reach the desired…

Machine Learning · Computer Science 2022-04-12 Arturo Marban , Daniel Becking , Simon Wiedemann , Wojciech Samek

The anticipated increase in the count of IoT devices in the coming years motivates the development of efficient algorithms that can help in their effective management while keeping the power consumption low. In this paper, we propose an…

Networking and Internet Architecture · Computer Science 2021-11-02 Inaam Ilahi , Muhammad Usama , Muhammad Omer Farooq , Muhammad Umar Janjua , Junaid Qadir

Contemporary Deep Neural Network (DNN) contains millions of synaptic connections with tens to hundreds of layers. The large computation and memory requirements pose a challenge to the hardware design. In this work, we leverage the intrinsic…

Machine Learning · Computer Science 2017-11-07 Jingyang Zhu , Jingbo Jiang , Xizi Chen , Chi-Ying Tsui

Neural network training is computationally and memory intensive. Sparse training can reduce the burden on emerging hardware platforms designed to accelerate sparse computations, but it can affect network convergence. In this work, we…

Machine Learning · Computer Science 2020-11-03 Md Aamir Raihan , Tor M. Aamodt

Due to the substantial computational cost, training state-of-the-art deep neural networks for large-scale datasets often requires distributed training using multiple computation workers. However, by nature, workers need to frequently…

Machine Learning · Computer Science 2018-02-21 Yusuke Tsuzuku , Hiroto Imachi , Takuya Akiba

Dynamic sparse training (DST) can reduce the computational demands in ANNs, but faces difficulties in keeping peak performance at high sparsity levels. The Cannistraci-Hebb training (CHT) is a brain-inspired method for growing connectivity…

Machine Learning · Computer Science 2026-01-14 Yingtao Zhang , Diego Cerretti , Jialin Zhao , Wenjing Wu , Ziheng Liao , Umberto Michieli , Carlo Vittorio Cannistraci

End-to-end performance estimation and measurement of deep neural network (DNN) systems become more important with increasing complexity of DNN systems consisting of hardware and software components. The methodology proposed in this paper…

Machine Learning · Computer Science 2019-11-19 Michael J. Klaiber , Sebastian Vogel , Axel Acosta , Robert Korn , Leonardo Ecco , Kristine Back , Andre Guntoro , Ingo Feldner

In this article, for the first time, we propose a transformer network-based reinforcement learning (RL) method for power distribution network (PDN) optimization of high bandwidth memory (HBM). The proposed method can provide an optimal…

The deployment of Deep Neural Networks in energy-constrained environments, such as Energy Harvesting Wireless Sensor Networks, presents unique challenges, primarily due to the intermittent nature of power availability. To address these…

Machine Learning · Computer Science 2025-01-28 Cyan Subhra Mishra , Deeksha Chaudhary , Jack Sampson , Mahmut Taylan Knademir , Chita Das