English
Related papers

Related papers: DeepRLS: A Recurrent Network Architecture with Lea…

200 papers

Recurrent neural networks (RNNs), temporal convolutions, and neural differential equations (NDEs) are popular families of deep learning models for time-series data, each with unique strengths and tradeoffs in modeling power and…

Machine Learning · Computer Science 2021-10-28 Albert Gu , Isys Johnson , Karan Goel , Khaled Saab , Tri Dao , Atri Rudra , Christopher Ré

The lack of interpretability in current deep learning models causes serious concerns as they are extensively used for various life-critical applications. Hence, it is of paramount importance to develop interpretable deep learning models. In…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Chirag Agarwal , Shahin Khobahi , Arindam Bose , Mojtaba Soltanalian , Dan Schonfeld

The recent advances in deep learning indicate significant progress in the field of single image super-resolution. With the advent of these techniques, high-resolution image with high peak signal to noise ratio (PSNR) and excellent…

Image and Video Processing · Electrical Eng. & Systems 2020-04-09 Meenu Ajith , Aswathy Rajendra Kurup , Manel Martínez-Ramón

Typical Magnetic Resonance Imaging (MRI) scan may take 20 to 60 minutes. Reducing MRI scan time is beneficial for both patient experience and cost considerations. Accelerated MRI scan may be achieved by acquiring less amount of k-space data…

Image and Video Processing · Electrical Eng. & Systems 2020-01-15 Pak Lun Kevin Ding , Zhiqiang Li , Yuxiang Zhou , Baoxin Li

Deep neural networks (DNN) have achieved great success in image restoration. However, most DNN methods are designed as a black box, lacking transparency and interpretability. Although some methods are proposed to combine traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Chong Mou , Qian Wang , Jian Zhang

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Deep learning is emerging as a new paradigm for solving inverse imaging problems. However, the deep learning methods often lack the assurance of traditional physics-based methods due to the lack of physical information considerations in…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 Dongdong Chen , Mike E. Davies

Lossy compression introduces complex compression artifacts, particularly blocking artifacts, ringing effects and blurring. Existing algorithms either focus on removing blocking artifacts and produce blurred output, or restore sharpened…

Computer Vision and Pattern Recognition · Computer Science 2016-08-10 Ke Yu , Chao Dong , Chen Change Loy , Xiaoou Tang

Low-dose CT denoising is a challenging task that has been studied by many researchers. Some studies have used deep neural networks to improve the quality of low-dose CT images and achieved fruitful results. In this paper, we propose a deep…

Image and Video Processing · Electrical Eng. & Systems 2019-02-28 Maryam Gholizadeh-Ansari , Javad Alirezaie , Paul Babyn

We propose an image super-resolution method (SR) using a deeply-recursive convolutional network (DRCN). Our network has a very deep recursive layer (up to 16 recursions). Increasing recursion depth can improve performance without…

Computer Vision and Pattern Recognition · Computer Science 2016-11-14 Jiwon Kim , Jung Kwon Lee , Kyoung Mu Lee

Most multilayer least squares (LS)-based neural networks are structured with two separate stages: unsupervised feature encoding and supervised pattern classification. Once the unsupervised learning is finished, the latent encoding would be…

Machine Learning · Computer Science 2021-03-04 Wandong Zhang , QM Jonathan Wu , Yimin Yang , WG Will Zhao , Tianlei Wang , Hui Zhang

Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, it is rarely used to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Feng Jiang , Wen Tao , Shaohui Liu , Jie Ren , Xun Guo , Debin Zhao

How can local-search methods such as stochastic gradient descent (SGD) avoid bad local minima in training multi-layer neural networks? Why can they fit random labels even given non-convex and non-smooth architectures? Most existing theory…

Machine Learning · Computer Science 2019-05-28 Zeyuan Allen-Zhu , Yuanzhi Li , Zhao Song

Speaker-independent speech separation has achieved remarkable performance in recent years with the development of deep neural network (DNN). Various network architectures, from traditional convolutional neural network (CNN) and recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Xue Yang , Changchun Bao

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

Many approaches to transform classification problems from non-linear to linear by feature transformation have been recently presented in the literature. These notably include sparse coding methods and deep neural networks. However, many of…

Machine Learning · Computer Science 2015-07-08 Alessandro Montalto , Giovanni Tessitore , Roberto Prevete

MRI is an inherently slow process, which leads to long scan time for high-resolution imaging. The speed of acquisition can be increased by ignoring parts of the data (undersampling). Consequently, this leads to the degradation of image…

Image and Video Processing · Electrical Eng. & Systems 2022-02-22 Soumick Chatterjee , Mario Breitkopf , Chompunuch Sarasaen , Hadya Yassin , Georg Rose , Andreas Nürnberger , Oliver Speck

The Recurrent Neural Networks and their variants have shown promising performances in sequence modeling tasks such as Natural Language Processing. These models, however, turn out to be impractical and difficult to train when exposed to very…

Computer Vision and Pattern Recognition · Computer Science 2017-07-07 Yinchong Yang , Denis Krompass , Volker Tresp

In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Kyong Hwan Jin , Michael T. McCann , Emmanuel Froustey , Michael Unser