中文
相关论文

相关论文: Designing recurrent neural networks by unfolding a…

200 篇论文

An approach to incorporate deep learning within an iterative image reconstruction framework to reconstruct images from severely incomplete measurement data is presented. Specifically, we utilize a convolutional neural network (CNN) as a…

计算机视觉与模式识别 · 计算机科学 2017-09-05 Brendan Kelly , Thomas P. Matthews , Mark A. Anastasio

Recently, Magnetic Resonance Fingerprinting (MRF) was proposed as a quantitative imaging technique for the simultaneous acquisition of tissue parameters such as relaxation times $T_1$ and $T_2$. Although the acquisition is highly…

Recurrent Neural Networks (RNNs) offer fast inference on long sequences but are hard to optimize and slow to train. Deep state-space models (SSMs) have recently been shown to perform remarkably well on long sequence modeling tasks, and have…

机器学习 · 计算机科学 2023-03-14 Antonio Orvieto , Samuel L Smith , Albert Gu , Anushan Fernando , Caglar Gulcehre , Razvan Pascanu , Soham De

We present DeepFPC, a novel deep neural network designed by unfolding the iterations of the fixed-point continuation algorithm with one-sided l1-norm (FPC-l1), which has been proposed for solving the 1-bit compressed sensing problem. The…

机器学习 · 计算机科学 2019-12-05 Peng Xiao , Bin Liao , Nikos Deligiannis

Advances in image super-resolution (SR) have recently benefited significantly from rapid developments in deep neural networks. Inspired by these recent discoveries, we note that many state-of-the-art deep SR architectures can be…

计算机视觉与模式识别 · 计算机科学 2018-05-09 Wei Han , Shiyu Chang , Ding Liu , Mo Yu , Michael Witbrock , Thomas S. Huang

A core technology that has emerged from the artificial intelligence revolution is the recurrent neural network (RNN). Its unique sequence-based architecture provides a tractable likelihood estimate with stable training paradigms, a…

无序系统与神经网络 · 物理学 2020-07-01 Mohamed Hibat-Allah , Martin Ganahl , Lauren E. Hayward , Roger G. Melko , Juan Carrasquilla

Deep unfolded neural networks are designed by unrolling the iterations of optimization algorithms. They can be shown to achieve faster convergence and higher accuracy than their optimization counterparts. This paper proposes a new…

机器学习 · 计算机科学 2020-10-05 Huynh Van Luong , Boris Joukovsky , Yonina C. Eldar , Nikos Deligiannis

Recurrent Neural Networks (RNNs) are a class of machine learning algorithms used for applications with time-series and sequential data. Recently, there has been a strong interest in executing RNNs on embedded devices. However, difficulties…

神经与进化计算 · 计算机科学 2020-03-23 Nesma M. Rezk , Madhura Purnaprajna , Tomas Nordström , Zain Ul-Abdin

Recurrent Neural Networks (RNN) are widely used to solve a variety of problems and as the quantity of data and the amount of available compute have increased, so have model sizes. The number of parameters in recent state-of-the-art networks…

机器学习 · 计算机科学 2017-11-08 Sharan Narang , Erich Elsen , Gregory Diamos , Shubho Sengupta

Recurrent neural networks (RNNs) have been widely used for processing sequential data. However, RNNs are commonly difficult to train due to the well-known gradient vanishing and exploding problems and hard to learn long-term patterns. Long…

计算机视觉与模式识别 · 计算机科学 2019-10-15 Shuai Li , Wanqing Li , Chris Cook , Ce Zhu , Yanbo Gao

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

神经与进化计算 · 计算机科学 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio

Recurrent neural networks (RNNs) are known to be difficult to train due to the gradient vanishing and exploding problems and thus difficult to learn long-term patterns and construct deep networks. To address these problems, this paper…

计算机视觉与模式识别 · 计算机科学 2020-12-10 Shuai Li , Wanqing Li , Chris Cook , Yanbo Gao

In single image deblurring, the "coarse-to-fine" scheme, i.e. gradually restoring the sharp image on different resolutions in a pyramid, is very successful in both traditional optimization-based methods and recent neural-network-based…

计算机视觉与模式识别 · 计算机科学 2018-02-07 Xin Tao , Hongyun Gao , Yi Wang , Xiaoyong Shen , Jue Wang , Jiaya Jia

In this paper, we present a multimodal Recurrent Neural Network (m-RNN) model for generating novel sentence descriptions to explain the content of images. It directly models the probability distribution of generating a word given previous…

计算机视觉与模式识别 · 计算机科学 2014-10-07 Junhua Mao , Wei Xu , Yi Yang , Jiang Wang , Alan L. Yuille

Integrating deep learning techniques into the video coding framework gains significant improvement compared to the standard compression techniques, especially applying super-resolution (up-sampling) to down-sampling based video coding as…

图像与视频处理 · 电气工程与系统科学 2021-01-19 Man M. Ho , Jinjia Zhou , Gang He

The efficiency of recurrent neural networks (RNNs) in dealing with sequential data has long been established. However, unlike deep, and convolution networks where we can attribute the recognition of a certain feature to every layer, it is…

机器学习 · 计算机科学 2020-01-15 Stefan Horoi , Guillaume Lajoie , Guy Wolf

Learning with recurrent neural networks (RNNs) on long sequences is a notoriously difficult task. There are three major challenges: 1) complex dependencies, 2) vanishing and exploding gradients, and 3) efficient parallelization. In this…

In this paper, we study the problem of node representation learning with graph neural networks. We present a graph neural network class named recurrent graph neural network (RGNN), that address the shortcomings of prior methods. By using…

机器学习 · 计算机科学 2019-08-27 Binxuan Huang , Kathleen M. Carley

Recursive Neural Networks (RvNNs), which compose sequences according to their underlying hierarchical syntactic structure, have performed well in several natural language processing tasks compared to similar models without structural…

计算与语言 · 计算机科学 2021-06-14 Jishnu Ray Chowdhury , Cornelia Caragea

Recurrent Neural Networks (RNNs) and their variants, such as Long-Short Term Memory (LSTM) networks, and Gated Recurrent Unit (GRU) networks, have achieved promising performance in sequential data modeling. The hidden layers in RNNs can be…

计算机视觉与模式识别 · 计算机科学 2018-11-20 Yu Pan , Jing Xu , Maolin Wang , Jinmian Ye , Fei Wang , Kun Bai , Zenglin Xu