English
Related papers

Related papers: Retrosynthetic Planning with Dual Value Networks

200 papers

Modern deep neural networks have a large number of parameters, making them very hard to train. We propose DSD, a dense-sparse-dense training flow, for regularizing deep neural networks and achieving better optimization performance. In the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-23 Song Han , Jeff Pool , Sharan Narang , Huizi Mao , Enhao Gong , Shijian Tang , Erich Elsen , Peter Vajda , Manohar Paluri , John Tran , Bryan Catanzaro , William J. Dally

We introduce the value iteration network (VIN): a fully differentiable neural network with a `planning module' embedded within. VINs can learn to plan, and are suitable for predicting outcomes that involve planning-based reasoning, such as…

Artificial Intelligence · Computer Science 2017-03-22 Aviv Tamar , Yi Wu , Garrett Thomas , Sergey Levine , Pieter Abbeel

With increasing scale in model and dataset size, the training of deep neural networks becomes a massive computational burden. One approach to speed up the training process is Selective Backprop. For this approach, we perform a forward pass…

Machine Learning · Computer Science 2023-12-11 Lukas Balles , Cedric Archambeau , Giovanni Zappella

Virtualized Radio Access Networks (vRANs) are fully configurable and can be implemented at a low cost over commodity platforms to enable network management flexibility. In this paper, a novel vRAN reconfiguration problem is formulated to…

Networking and Internet Architecture · Computer Science 2023-07-07 Fahri Wisnu Murti , Samad Ali , George Iosifidis , Matti Latva-aho

Deep neural networks are among the most widely applied machine learning tools showing outstanding performance in a broad range of tasks. We present a method for folding a deep neural network of arbitrary size into a single neuron with…

Machine Learning · Computer Science 2021-09-15 Florian Stelzer , André Röhm , Raul Vicente , Ingo Fischer , Serhiy Yanchuk

Deep-predictive-coding networks (DPCNs) are hierarchical, generative models. They rely on feed-forward and feed-back connections to modulate latent feature representations of stimuli in a dynamic and context-sensitive manner. A crucial…

Artificial Intelligence · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

Current techniques for deep neural network (DNN) pruning often involve intricate multi-step processes that require domain-specific expertise, making their widespread adoption challenging. To address the limitation, the Only-Train-Once (OTO)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Xidong Wu , Shangqian Gao , Zeyu Zhang , Zhenzhen Li , Runxue Bao , Yanfu Zhang , Xiaoqian Wang , Heng Huang

Deep learning using multi-layer neural networks (NNs) architecture manifests superb power in modern machine learning systems. The trained Deep Neural Networks (DNNs) are typically large. The question we would like to address is whether it…

Computer Vision and Pattern Recognition · Computer Science 2016-07-05 Wei Pan , Hao Dong , Yike Guo

Deep reinforcement learning has achieved remarkable performance in various domains by leveraging deep neural networks for approximating value functions and policies. However, using neural networks to approximate value functions or policy…

Machine Learning · Computer Science 2023-10-31 Yiqin Tan , Ling Pan , Longbo Huang

Deep learning-based single image super-resolution enables very fast and high-visual-quality reconstruction. Recently, an enhanced super-resolution based on generative adversarial network (ESRGAN) has achieved excellent performance in terms…

Image and Video Processing · Electrical Eng. & Systems 2019-11-21 Chih-Chung Hsu , Chia-Hsiang Lin

Deep neural networks (DNNs) are nowadays witnessing a major success in solving many pattern recognition tasks including skeleton-based classification. The deployment of DNNs on edge-devices, endowed with limited time and memory resources,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hichem Sahbi

Deep Neural Networks (DNN) have been successfully used to perform classification and regression tasks, particularly in computer vision based applications. Recently, owing to the widespread deployment of Internet of Things (IoT), we identify…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Arijit Ukil , Antonio Jara , Leandro Marin

Deep Reinforcement Learning (DRL) has become a powerful tool for developing control policies in queueing networks, but the common use of Multi-layer Perceptron (MLP) neural networks in these applications has significant drawbacks. MLP…

Machine Learning · Computer Science 2025-01-22 Jerrod Wigmore , Brooke Shrader , Eytan Modiano

This paper makes one step forward towards characterizing a new family of \textit{model-free} Deep Reinforcement Learning (DRL) algorithms. The aim of these algorithms is to jointly learn an approximation of the state-value function ($V$),…

Machine Learning · Computer Science 2019-10-15 Matthia Sabatelli , Gilles Louppe , Pierre Geurts , Marco A. Wiering

Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch learning setting, which requires the entire training data to be made available prior to the learning task. This is not scalable for many real-world scenarios…

Machine Learning · Computer Science 2017-11-13 Doyen Sahoo , Quang Pham , Jing Lu , Steven C. H. Hoi

Predictive materials synthesis is the primary bottleneck in realizing new functional and quantum materials. Strategies for synthesis of promising materials are currently identified by time-consuming trial and error approaches and there are…

Singular value decomposition (SVD) has a crucial role in model order reduction. It is often utilized in the offline stage to compute basis functions that project the high-dimensional nonlinear problem into a low-dimensionsl model which is,…

Numerical Analysis · Mathematics 2016-11-09 Alessandro Alla , J. Nathan Kutz

Next-gen networks require significant evolution of management to enable automation and adaptively adjust network configuration based on traffic dynamics. The advent of software-defined networking (SDN) and programmable switches enables…

Networking and Internet Architecture · Computer Science 2024-02-08 Akshita Abrol , Purnima Murali Mohan , Tram Truong-Huu

Offline reinforcement learning (RL) has achieved significant advances in domains such as robotic control, autonomous driving, and medical decision-making. Most existing methods primarily focus on training policies that maximize cumulative…

Machine Learning · Computer Science 2025-09-30 Yue Pei , Hongming Zhang , Chao Gao , Martin Müller , Mengxiao Zhu , Hao Sheng , Ziliang Chen , Liang Lin , Haogang Zhu

Speaker-independent speech separation has achieved remarkable performance in recent years with the development of deep neural network (DNN). Various network architectures, from traditional convolutional neural network (CNN) and recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Xue Yang , Changchun Bao