English
Related papers

Related papers: Recurrent Transformer Networks for Semantic Corres…

200 papers

Recurrent neural networks (RNNs) are widely used throughout neuroscience as models of local neural activity. Many properties of single RNNs are well characterized theoretically, but experimental neuroscience has moved in the direction of…

Machine Learning · Computer Science 2023-01-31 Leo Kozachkov , Michaela Ennis , Jean-Jacques Slotine

Recurrent Neural Networks (RNNs) have been widely used in processing natural language tasks and achieve huge success. Traditional RNNs usually treat each token in a sentence uniformly and equally. However, this may miss the rich semantic…

Computation and Language · Computer Science 2018-11-14 Chang Xu , Weiran Huang , Hongwei Wang , Gang Wang , Tie-Yan Liu

For semantic segmentation of remote sensing images (RSI), trade-off between representation power and location accuracy is quite important. How to get the trade-off effectively is an open question,where current approaches of utilizing very…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Shuang He , Xia Lu , Jason Gu , Haitong Tang , Qin Yu , Kaiyue Liu , Haozhou Ding , Chunqi Chang , Nizhuan Wang

Recurrent neural networks (RNNs) provide state-of-the-art performance in processing sequential data but are memory intensive to train, limiting the flexibility of RNN models which can be trained. Reversible RNNs---RNNs for which the…

Machine Learning · Computer Science 2018-10-26 Matthew MacKay , Paul Vicol , Jimmy Ba , Roger Grosse

Convolutional-deconvolution networks can be adopted to perform end-to-end saliency detection. But, they do not work well with objects of multiple scales. To overcome such a limitation, in this work, we propose a recurrent attentional…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Jason Kuen , Zhenhua Wang , Gang Wang

A core technology that has emerged from the artificial intelligence revolution is the recurrent neural network (RNN). Its unique sequence-based architecture provides a tractable likelihood estimate with stable training paradigms, a…

Disordered Systems and Neural Networks · Physics 2020-07-01 Mohamed Hibat-Allah , Martin Ganahl , Lauren E. Hayward , Roger G. Melko , Juan Carrasquilla

Deep convolutional neural networks (DCNN) have been widely adopted for research on super resolution recently, however previous work focused mainly on stacking as many layers as possible in their model, in this paper, we present a new…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Yiwen Huang , Ming Qin

Invariance to spatial transformations such as translations and rotations is a desirable property and a basic design principle for classification neural networks. However, the commonly used convolutional neural networks (CNNs) are actually…

Machine Learning · Computer Science 2023-06-30 Yihan Wang , Lijia Yu , Xiao-Shan Gao

This paper proposes a new method called Multimodal RNNs for RGB-D scene semantic segmentation. It is optimized to classify image pixels given two input sources: RGB color channels and Depth maps. It simultaneously performs training of two…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Abrar H. Abdulnabi , Bing Shuai , Zhen Zuo , Lap-Pui Chau , Gang Wang

Semantic segmentation in high resolution remote sensing images is a fundamental and challenging task. Convolutional neural networks (CNNs), such as fully convolutional network (FCN) and SegNet, have shown outstanding performance in many…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Lichao Mou , Xiao Xiang Zhu

The main alternatives nowadays to deal with sequences are Recurrent Neural Networks (RNN), Convolutional Neural Networks (CNN) architectures and the Transformer. In this context, RNN's, CNN's and Transformer have most commonly been used as…

Computation and Language · Computer Science 2019-07-02 Carlos Escolano , Marta R. Costa-jussà , Elora Lacroux , Pere-Pau Vázquez

Recently, Neural Networks have been proven extremely effective in many natural language processing tasks such as sentiment analysis, question answering, or machine translation. Aiming to exploit such advantages in the Ontology Learning…

Computation and Language · Computer Science 2016-07-15 Giulio Petrucci , Chiara Ghidini , Marco Rospocher

Applying convolutional neural networks to large images is computationally expensive because the amount of computation scales linearly with the number of image pixels. We present a novel recurrent neural network model that is capable of…

Machine Learning · Computer Science 2014-06-25 Volodymyr Mnih , Nicolas Heess , Alex Graves , Koray Kavukcuoglu

Convolutional neural networks (CNNs) show outstanding performance in many image processing problems, such as image recognition, object detection and image segmentation. Semantic segmentation is a very challenging task that requires…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Fan Jia , Jun Liu , Xue-cheng Tai

Recurrent Neural Networks (RNNs) offer fast inference on long sequences but are hard to optimize and slow to train. Deep state-space models (SSMs) have recently been shown to perform remarkably well on long sequence modeling tasks, and have…

Machine Learning · Computer Science 2023-03-14 Antonio Orvieto , Samuel L Smith , Albert Gu , Anushan Fernando , Caglar Gulcehre , Razvan Pascanu , Soham De

Classical methods of solving spatiotemporal dynamical systems include statistical approaches such as autoregressive integrated moving average, which assume linear and stationary relationships between systems' previous outputs. Development…

Dynamical Systems · Mathematics 2022-02-16 Yonggi Park , Kelum Gajamannage , Dilhani I. Jayathilake , Erik M. Bollt

Long short-term memory (LSTM) recurrent neural networks (RNNs) have been shown to give state-of-the-art performance on many speech recognition tasks, as they are able to provide the learned dynamically changing contextual window of all…

Computation and Language · Computer Science 2016-10-12 Xiangang Li , Xihong Wu

To address the sequential changes of images including poses, in this paper we propose a recurrent regression neural network(RRNN) framework to unify two classic tasks of cross-pose face recognition on still images and video-based face…

Computer Vision and Pattern Recognition · Computer Science 2016-07-26 Yang Li , Wenming Zheng , Zhen Cui

Scene text image super-resolution aims to increase the resolution and readability of the text in low-resolution images. Though significant improvement has been achieved by deep convolutional neural networks (CNNs), it remains difficult to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Jianqi Ma , Zhetong Liang , Lei Zhang

Deep residual networks (ResNets) made a recent breakthrough in deep learning. The core idea of ResNets is to have shortcut connections between layers that allow the network to be much deeper while still being easy to optimize avoiding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Sam Leroux , Pavlo Molchanov , Pieter Simoens , Bart Dhoedt , Thomas Breuel , Jan Kautz