English
Related papers

Related papers: Sequential Learning of Convolutional Features for …

200 papers

Convolutional architectures have recently been shown to be competitive on many sequence modelling tasks when compared to the de-facto standard of recurrent neural networks (RNNs), while providing computational and modeling advantages due to…

Machine Learning · Computer Science 2019-02-19 Emre Aksan , Otmar Hilliges

Text classification is an important and classical problem in natural language processing. There have been a number of studies that applied convolutional neural networks (convolution on regular grid, e.g., sequence) to classification.…

Computation and Language · Computer Science 2018-11-14 Liang Yao , Chengsheng Mao , Yuan Luo

Connectionist temporal classification (CTC) is a popular sequence prediction approach for automatic speech recognition that is typically used with models based on recurrent neural networks (RNNs). We explore whether deep convolutional…

Computation and Language · Computer Science 2018-02-16 Kalpesh Krishna , Liang Lu , Kevin Gimpel , Karen Livescu

In recent years, deep learning-based models have significantly improved the Natural Language Processing (NLP) tasks. Specifically, the Convolutional Neural Network (CNN), initially used for computer vision, has shown remarkable performance…

Computation and Language · Computer Science 2022-03-11 Sanskar Soni , Satyendra Singh Chouhan , Santosh Singh Rathore

Self Normalizing Neural Networks(SNN) proposed on Feed Forward Neural Networks(FNN) outperform regular FNN architectures in various machine learning tasks. Particularly in the domain of Computer Vision, the activation function Scaled…

Computation and Language · Computer Science 2019-05-07 Avinash Madasu , Vijjini Anvesh Rao

Research has shown that Convolutional Neural Networks (CNN) can be effectively applied to text classification as part of a predictive coding protocol. That said, most research to date has been conducted on data sets with short documents…

Information Retrieval · Computer Science 2019-12-23 Robert Keeling , Rishi Chhatwal , Nathaniel Huber-Fliflet , Jianping Zhang , Fusheng Wei , Haozhen Zhao , Shi Ye , Han Qin

Driven by deep learning and the large volume of data, scene text recognition has evolved rapidly in recent years. Formerly, RNN-attention based methods have dominated this field, but suffer from the problem of \textit{attention drift} in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Zhaoyi Wan , Minghang He , Haoran Chen , Xiang Bai , Cong Yao

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

Convolutional Neural Networks (CNNs) have recently achieved remarkably strong performance on the practically important task of sentence classification (kim 2014, kalchbrenner 2014, johnson 2014). However, these models require practitioners…

Computation and Language · Computer Science 2016-04-08 Ye Zhang , Byron Wallace

Compared to sequential learning models, graph-based neural networks exhibit some excellent properties, such as ability capturing global information. In this paper, we investigate graph-based neural networks for text classification problem.…

Computation and Language · Computer Science 2020-02-27 Xien Liu , Xinxin You , Xiao Zhang , Ji Wu , Ping Lv

Neural network models have been demonstrated to be capable of achieving remarkable performance in sentence and document modeling. Convolutional neural network (CNN) and recurrent neural network (RNN) are two mainstream architectures for…

Computation and Language · Computer Science 2015-12-01 Chunting Zhou , Chonglin Sun , Zhiyuan Liu , Francis C. M. Lau

Text recognition in natural scene is a challenging problem due to the many factors affecting text appearance. In this paper, we presents a method that directly transcribes scene text images to text without needing of sophisticated character…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Guo Qiang , Tu Dan , Li Guohui , Lei Jun

This paper presents a new semi-supervised framework with convolutional neural networks (CNNs) for text categorization. Unlike the previous approaches that rely on word embeddings, our method learns embeddings of small text regions from…

Machine Learning · Statistics 2015-11-03 Rie Johnson , Tong Zhang

Learning a matching function between two text sequences is a long standing problem in NLP research. This task enables many potential applications such as question answering and paraphrase identification. This paper proposes Co-Stack…

Computation and Language · Computer Science 2018-10-09 Yi Tay , Luu Anh Tuan , Siu Cheung Hui

With the rapid development of Natural Language Processing (NLP) technologies, text steganography methods have been significantly innovated recently, which poses a great threat to cybersecurity. In this paper, we propose a novel attentional…

Multimedia · Computer Science 2022-02-21 YongJian Bao , Hao Yang , Zhongliang Yang , Sheng Liu , Yongfeng Huang

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Various convolutional neural networks (CNNs) were developed recently that achieved accuracy comparable with that of human beings in computer vision tasks such as image recognition, object detection and tracking, etc. Most of these networks,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Tianchen Wang , Jinjun Xiong , Xiaowei Xu , Yiyu Shi

Scene parsing is an important and challenging prob- lem in computer vision. It requires labeling each pixel in an image with the category it belongs to. Tradition- ally, it has been approached with hand-engineered features from color…

Machine Learning · Statistics 2014-11-18 Rahul Mohan

Convolutional neural networks for computer vision are fairly intuitive. In a typical CNN used in image classification, the first layers learn edges, and the following layers learn some filters that can identify an object. But CNNs for…

Computation and Language · Computer Science 2018-04-04 Prudhvi Raj Dachapally , Srikanth Ramanam

Sound events often occur in unstructured environments where they exhibit wide variations in their frequency content and temporal structure. Convolutional neural networks (CNN) are able to extract higher level features that are invariant to…

Machine Learning · Computer Science 2017-05-31 Emre Çakır , Giambattista Parascandolo , Toni Heittola , Heikki Huttunen , Tuomas Virtanen