English
Related papers

Related papers: Multichannel CNN with Attention for Text Classific…

200 papers

In this paper, we propose multimodal convolutional neural networks (m-CNNs) for matching image and sentence. Our m-CNN provides an end-to-end framework with convolutional architectures to exploit image representation, word composition, and…

Computer Vision and Pattern Recognition · Computer Science 2015-09-01 Lin Ma , Zhengdong Lu , Lifeng Shang , Hang Li

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

Computation and Language · Computer Science 2018-08-29 Yi Yang

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

We report on a series of experiments with convolutional neural networks (CNN) trained on top of pre-trained word vectors for sentence-level classification tasks. We show that a simple CNN with little hyperparameter tuning and static vectors…

Computation and Language · Computer Science 2014-09-04 Yoon Kim

Convolutional neural networks (CNNs) have recently emerged as a popular building block for natural language processing (NLP). Despite their success, most existing CNN models employed in NLP share the same learned (and static) set of filters…

Computation and Language · Computer Science 2018-08-31 Dinghan Shen , Martin Renqiang Min , Yitong Li , Lawrence Carin

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Graph convolutional networks (GCNs) have shown the powerful ability in text structure representation and effectively facilitate the task of text classification. However, challenges still exist in adapting GCN on learning discriminative…

Machine Learning · Computer Science 2019-12-02 Xueya Zhang , Tong Zhang , Wenting Zhao , Zhen Cui , Jian Yang

In NLP, convolutional neural networks (CNNs) have benefited less than recurrent neural networks (RNNs) from attention mechanisms. We hypothesize that this is because the attention in CNNs has been mainly implemented as attentive pooling…

Computation and Language · Computer Science 2018-11-14 Wenpeng Yin , Hinrich Schütze

Sentiment analysis is known as one of the most crucial tasks in the field of natural language processing and Convolutional Neural Network (CNN) is one of those prominent models that is commonly used for this aim. Although convolutional…

Computation and Language · Computer Science 2021-02-24 Hossein Sadr , Mozhdeh Nazari Solimandarabi , Mir Mohsen Pedram , Mohammad Teshnehlab

Recurrent Neural Networks (RNNs) have been widely used in processing natural language tasks and achieve huge success. Traditional RNNs usually treat each token in a sentence uniformly and equally. However, this may miss the rich semantic…

Computation and Language · Computer Science 2018-11-14 Chang Xu , Weiran Huang , Hongwei Wang , Gang Wang , Tie-Yan Liu

We present a new Convolutional Neural Network (CNN) model for text classification that jointly exploits labels on documents and their component sentences. Specifically, we consider scenarios in which annotators explicitly mark sentences (or…

Computation and Language · Computer Science 2016-09-27 Ye Zhang , Iain Marshall , Byron C. Wallace

Research has shown that Convolutional Neural Networks (CNN) can be effectively applied to text classification as part of a predictive coding protocol. That said, most research to date has been conducted on data sets with short documents…

Information Retrieval · Computer Science 2019-12-23 Robert Keeling , Rishi Chhatwal , Nathaniel Huber-Fliflet , Jianping Zhang , Fusheng Wei , Haozhen Zhao , Shi Ye , Han Qin

Convolutional Neural Networks (CNNs) have recently achieved remarkably strong performance on the practically important task of sentence classification (kim 2014, kalchbrenner 2014, johnson 2014). However, these models require practitioners…

Computation and Language · Computer Science 2016-04-08 Ye Zhang , Byron Wallace

Convolutional neural network (CNN) and recurrent neural network (RNN) models have become the mainstream methods for relation classification. We propose a unified architecture, which exploits the advantages of CNN and RNN simultaneously, to…

Computation and Language · Computer Science 2018-07-31 Bin He , Yi Guan , Rui Dai

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Deep learning has gained much success in sentence-level relation classification. For example, convolutional neural networks (CNN) have delivered competitive performance without much effort on feature engineering as the conventional…

Computation and Language · Computer Science 2015-12-29 Dongxu Zhang , Dong Wang

We develop a Deep-Text Recurrent Network (DTRN) that regards scene text reading as a sequence labelling problem. We leverage recent advances of deep convolutional neural networks to generate an ordered high-level sequence from a whole word…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Pan He , Weilin Huang , Yu Qiao , Chen Change Loy , Xiaoou Tang

Aspect-level sentiment classification aims to identify the sentiment polarity towards a specific aspect term in a sentence. Most current approaches mainly consider the semantic information by utilizing attention mechanisms to capture the…

Computation and Language · Computer Science 2021-02-12 Xiaochen Hou , Jing Huang , Guangtao Wang , Xiaodong He , Bowen Zhou

Recent models for image processing are using the Convolutional neural network (CNN) which requires a pixel per pixel analysis of the input image. This method works well. However, it is time-consuming if we have large images. To increase the…

Machine Learning · Computer Science 2019-12-10 Mohamed Karim Belaid

The dominant approaches for named entity recognition (NER) mostly adopt complex recurrent neural networks (RNN), e.g., long-short-term-memory (LSTM). However, RNNs are limited by their recurrent nature in terms of computational efficiency.…

Computation and Language · Computer Science 2019-07-22 Hui Chen , Zijia Lin , Guiguang Ding , Jianguang Lou , Yusen Zhang , Borje Karlsson