English
Related papers

Related papers: Generalized Sparse and Low-Rank Optimization for U…

200 papers

Deep neural networks (DNNs) have emerged as key enablers of machine learning. Applying larger DNNs to more diverse applications is an important challenge. The computations performed during DNN training and inference are dominated by…

Machine Learning · Computer Science 2018-12-17 Jeremy Kepner , Vijay Gadepally , Hayden Jananthan , Lauren Milechin , Sid Samsi

This paper aims at investigating the achievable performance and the issues that arise in ultra-dense networks (UDNs), when the signal propagation includes both the Line-of-Sight (LOS) and Non-Line-Of-Sight (NLOS) components. Backed by an…

Information Theory · Computer Science 2015-07-08 Carlo Galiotto , Nuno K. Pratas , Linda Doyle , Nicola Marchetti

Ubiquitous artificial intelligence (AI) is considered one of the key services in 6G systems. AI services typically rely on deep neural network (DNN) requiring heavy computation. Hence, in order to support ubiquitous AI, it is crucial to…

Networking and Internet Architecture · Computer Science 2022-07-27 Sehun Jung , Hyang-Won Lee

Unmanned Aerial Vehicles (UAVs) have attracted great interest in the last few years owing to their ability to cover large areas and access difficult and hazardous target zones, which is not the case of traditional systems relying on direct…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-25 Mohammed Jouhari , Abdulla Al-Ali , Emna Baccour , Amr Mohamed , Aiman Erbad , Mohsen Guizani , Mounir Hamdi

We introduce the unbounded depth neural network (UDN), an infinitely deep probabilistic model that adapts its complexity to the training data. The UDN contains an infinite sequence of hidden layers and places an unbounded prior on a…

Machine Learning · Computer Science 2022-09-22 Achille Nazaret , David Blei

Contemporary Deep Neural Network (DNN) contains millions of synaptic connections with tens to hundreds of layers. The large computation and memory requirements pose a challenge to the hardware design. In this work, we leverage the intrinsic…

Machine Learning · Computer Science 2017-11-07 Jingyang Zhu , Jingbo Jiang , Xizi Chen , Chi-Ying Tsui

Full-duplex (FD) communication is an emerging technology that can potentially double the throughput of cellular networks. Preliminary studies in single-cell or small FD network deployments have revealed promising rate gains using…

Information Theory · Computer Science 2016-04-21 Italo Atzeni , Marios Kountouris , George C. Alexandropoulos

Deploying deep neural networks (DNNs) on resource-constrained edge devices such as FPGAs requires a careful balance among latency, power, and hardware resource usage, while maintaining high accuracy. Existing Lookup Table (LUT)-based DNNs…

Hardware Architecture · Computer Science 2026-01-16 Binglei Lou , Ruilin Wu , Philip Leong

The densification and expansion of wireless networks pose new challenges on energy efficiency. With a drastic increase of infrastructure nodes (e.g. ultra-dense deployment of small cells), the total energy consumption may easily exceed an…

Networking and Internet Architecture · Computer Science 2014-08-28 R. L. G. Cavalcante , S. Stańczak , M. Schubert , A. Eisenblätter , U. Türke

Deep Neural Network (DNN) has gained unprecedented performance due to its automated feature extraction capability. This high order performance leads to significant incorporation of DNN models in different Internet of Things (IoT)…

Machine Learning · Computer Science 2020-10-09 Rahul Mishra , Hari Prabhat Gupta , Tanima Dutta

Today 4G mobile systems are evolving to provide IP connectivity for diverse applications and services up to 1Gbps. They are designed to optimize the network performance, improve cost efficiency and facilitate the uptake of mass market…

Networking and Internet Architecture · Computer Science 2015-06-10 Akram Hakiri , Pascal Berthou

Modern deep neural networks have a large number of parameters, making them very hard to train. We propose DSD, a dense-sparse-dense training flow, for regularizing deep neural networks and achieving better optimization performance. In the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-23 Song Han , Jeff Pool , Sharan Narang , Huizi Mao , Enhao Gong , Shijian Tang , Erich Elsen , Peter Vajda , Manohar Paluri , John Tran , Bryan Catanzaro , William J. Dally

Many techniques have been developed, such as model compression, to make Deep Neural Networks (DNNs) inference more efficiently. Nevertheless, DNNs still lack excellent run-time dynamic inference capability to enable users trade-off accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Li Yang , Zhezhi He , Yu Cao , Deliang Fan

Ultra network densification and Massive MIMO are considered major 5G enablers since they promise huge capacity gains by exploiting proximity, spectral and spatial reuse benefits. Both approaches rely on increasing the number of access…

Networking and Internet Architecture · Computer Science 2015-04-10 Antonis G. Gotsis , Stelios Stefanatos , Angeliki Alexiou

Future 5G services are characterised by unprecedented need for high rate, ubiquitous availability, ultra-low latency and high reliability. The fragmented network view that is widespread in current networks will not stand the challenge posed…

Networking and Internet Architecture · Computer Science 2016-12-14 Marco Ruffini

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

Machine Learning · Statistics 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

Artificial neural networks have gone through a recent rise in popularity, achieving state-of-the-art results in various fields, including image classification, speech recognition, and automated control. Both the performance and…

Neural and Evolutionary Computing · Computer Science 2016-11-08 Sean C. Smithson , Guang Yang , Warren J. Gross , Brett H. Meyer

To address the issues of high operational costs and low energy efficiency (EE) caused by the dense deployment of small base stations (s-BSs) in 5G ultra-dense networks (UDNs), this paper first constructs a multi-objective mathematical…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Ruixing Ren , Shan Chen , Xuehan Bao , Pingzheng Ge , Dongming Wang , Junhui Zhao

Most artificial networks today rely on dense representations, whereas biological networks rely on sparse representations. In this paper we show how sparse representations can be more robust to noise and interference, as long as the…

Machine Learning · Computer Science 2019-04-03 Subutai Ahmad , Luiz Scheinkman

This article investigates the performance of an ultra-dense network (UDN) from an energy-efficiency (EE) standpoint leveraging the interplay between stochastic geometry (SG) and mean-field game (MFG) theory. In this setting, base stations…

Information Theory · Computer Science 2016-09-14 Jihong Park , Mehdi Bennis , Seong-Lyun Kim , Mérouane Debbah