English
Related papers

Related papers: Learning to Compensate: A Deep Neural Network Fram…

200 papers

Deep neural networks (DNNs) are powerful learning machines that have enabled breakthroughs in several domains. In this work, we introduce a new retrospective loss to improve the training of deep neural network models by utilizing the prior…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Surgan Jandial , Ayush Chopra , Mausoom Sarkar , Piyush Gupta , Balaji Krishnamurthy , Vineeth Balasubramanian

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

Machine Learning · Computer Science 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

Recently, data-driven approaches motivated by modern deep learning have been applied to optical communications in place of traditional model-based counterparts. The application of deep neural networks (DNN) allows flexible statistical…

Signal Processing · Electrical Eng. & Systems 2019-11-25 Toshiaki Koike-Akino , Ye Wang , David S. Millar , Keisuke Kojima , Kieran Parsons

Recent studies have shown that deep neural networks (DNNs) perform significantly better than shallow networks and Gaussian mixture models (GMMs) on large vocabulary speech recognition tasks. In this paper, we argue that the improved…

Machine Learning · Computer Science 2018-12-06 Dong Yu , Michael L. Seltzer , Jinyu Li , Jui-Ting Huang , Frank Seide

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

With the rapid development of Deep Learning, more and more applications on the cloud and edge tend to utilize large DNN (Deep Neural Network) models for improved task execution efficiency as well as decision-making quality. Due to memory…

Machine Learning · Computer Science 2024-07-02 Jingran Shen , Nikos Tziritas , Georgios Theodoropoulos

Achieving a practical quantum speedup for deep neural networks (DNNs) remains a central yet elusive goal, hindered by the dual challenges of constructing deep architectures and the prohibitive overhead of data loading and measurement. We…

Deep Neural Networks (DNNs) are powerful algorithms that have been proven capable of extracting non-Gaussian information from weak lensing (WL) data sets. Understanding which features in the data determine the output of these nested,…

Cosmology and Nongalactic Astrophysics · Physics 2021-04-14 José Manuel Zorrilla Matilla , Manasi Sharma , Daniel Hsu , Zoltán Haiman

Cooperative beamforming across access points (APs) and fronthaul quantization strategies are essential for cloud radio access network (C-RAN) systems. The nonconvexity of the C-RAN optimization problems, which is stemmed from per-AP power…

Signal Processing · Electrical Eng. & Systems 2021-07-07 Daesung Yu , Hoon Lee , Seok-Hwan Park , Seung-Eun Hong

This paper introduces Progressively Diffused Networks (PDNs) for unifying multi-scale context modeling with deep feature learning, by taking semantic image segmentation as an exemplar application. Prior neural networks, such as ResNet, tend…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Ruimao Zhang , Wei Yang , Zhanglin Peng , Xiaogang Wang , Liang Lin

Deep learning is emerging as a new paradigm for solving inverse imaging problems. However, the deep learning methods often lack the assurance of traditional physics-based methods due to the lack of physical information considerations in…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 Dongdong Chen , Mike E. Davies

In this work we propose a framework for improving the performance of any deep neural network that may suffer from vanishing gradients. To address the vanishing gradient issue, we study a framework, where we insert an intermediate output…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Yi Zhou , Yue Bai , Shuvra S. Bhattacharyya , Heikki Huttunen

There are vast number of configurable parameters in a Radio Access Telecom Network. A significant amount of these parameters is configured by Radio Node or cell based on their deployment setting. Traditional methods rely on domain knowledge…

Machine Learning · Computer Science 2024-06-10 Shirwan Piroti , Ashima Chawla , Tahar Zanouda

Deep generative frameworks including GANs and normalizing flow models have proven successful at filling in missing values in partially observed data samples by effectively learning -- either explicitly or implicitly -- complex,…

Machine Learning · Computer Science 2021-04-06 Edgar A. Bernal

One key communication block in 5G and 6G radios is the active phased array (APA). To ensure reliable operation, efficient and timely fault diagnosis of APAs on-site is crucial. To date, fault diagnosis has relied on measurement of frequency…

Signal Processing · Electrical Eng. & Systems 2023-06-08 Martin H. Nielsen , Yufeng Zhang , Changbin Xue , Jian Ren , Yingzeng Yin , Ming Shen , Gert F. Pedersen

Deep Neural Networks (DNNs) are inherently computation-intensive and also power-hungry. Hardware accelerators such as Field Programmable Gate Arrays (FPGAs) are a promising solution that can satisfy these requirements for both embedded and…

We present a deep learning framework for quantifying and propagating uncertainty in systems governed by non-linear differential equations using physics-informed neural networks. Specifically, we employ latent variable models to construct…

Machine Learning · Statistics 2019-06-26 Yibo Yang , Paris Perdikaris

In this article, we develop an end-to-end wireless communication system using deep neural networks (DNNs), in which DNNs are employed to perform several key functions, including encoding, decoding, modulation, and demodulation. However, an…

Information Theory · Computer Science 2019-03-08 Hao Ye , Le Liang , Geoffrey Ye Li , Biing-Hwang Fred Juang

Artificial intelligence (AI) is envisioned to play a key role in future wireless technologies, with deep neural networks (DNNs) enabling digital receivers to learn to operate in challenging communication scenarios. However, wireless…

Information Theory · Computer Science 2023-05-15 Tomer Raviv , Sangwoo Park , Osvaldo Simeone , Yonina C. Eldar , Nir Shlezinger