English
Related papers

Related papers: ABCNN: Attention-Based Convolutional Neural Networ…

200 papers

Atomic clauses are fundamental text units for understanding complex sentences. Identifying the atomic sentences within complex sentences is important for applications such as summarization, argument mining, discourse analysis, discourse…

Computation and Language · Computer Science 2021-07-01 Yanjun Gao , Ting-hao Huang , Rebecca J. Passonneau

Two recent approaches have achieved state-of-the-art results in image captioning. The first uses a pipelined process where a set of candidate words is generated by a convolutional neural network (CNN) trained on images, and then a maximum…

Computation and Language · Computer Science 2015-10-16 Jacob Devlin , Hao Cheng , Hao Fang , Saurabh Gupta , Li Deng , Xiaodong He , Geoffrey Zweig , Margaret Mitchell

A variety of real-world processes (over networks) produce sequences of data whose complex temporal dynamics need to be studied. More especially, the event timestamps can carry important information about the underlying network dynamics,…

Machine Learning · Computer Science 2017-03-27 Shuai Xiao , Junchi Yan , Mehrdad Farajtabar , Le Song , Xiaokang Yang , Hongyuan Zha

A lot of work has been done to build text-based language models for performing different NLP tasks, but not much research has been done in the case of audio-based language models. This paper proposes a Convolutional Autoencoder based neural…

Computation and Language · Computer Science 2020-09-30 Prakamya Mishra , Pranav Mathur

Contextualized representations from a pre-trained language model are central to achieve a high performance on downstream NLP task. The pre-trained BERT and A Lite BERT (ALBERT) models can be fine-tuned to give state-ofthe-art results in…

Computation and Language · Computer Science 2021-01-27 Hyunjin Choi , Judong Kim , Seongho Joe , Youngjune Gwon

Matching two texts is a fundamental problem in many natural language processing tasks. An effective way is to extract meaningful matching patterns from words, phrases, and sentences to produce the matching score. Inspired by the success of…

Computation and Language · Computer Science 2016-02-23 Liang Pang , Yanyan Lan , Jiafeng Guo , Jun Xu , Shengxian Wan , Xueqi Cheng

Recent artificial neural networks that process natural language achieve unprecedented performance in tasks requiring sentence-level understanding. As such, they could be interesting models of the integration of linguistic information in the…

Computation and Language · Computer Science 2023-02-17 Sophie Arana , Jacques Pesnot Lerousseau , Peter Hagoort

Both the Dictionary Learning (DL) and Convolutional Neural Networks (CNN) are powerful image representation learning systems based on different mechanisms and principles, however whether we can seamlessly integrate them to improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Zhao Zhang , Yulin Sun , Yang Wang , Zhengjun Zha , Shuicheng Yan , Meng Wang

We propose "Areas of Attention", a novel attention-based model for automatic image captioning. Our approach models the dependencies between image regions, caption words, and the state of an RNN language model, using three pairwise…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Marco Pedersoli , Thomas Lucas , Cordelia Schmid , Jakob Verbeek

Convolutional neural networks (CNNs) have been successfully applied to solve the problem of correspondence estimation between semantically related images. Due to non-availability of large training datasets, existing methods resort to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Zakaria Laskar , Juho Kannala

Recently recurrent neural networks (RNNs) have demonstrated the ability to improve scene labeling through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Heng Fan , Haibin Ling

We propose a novel convolutional architecture, named $gen$CNN, for word sequence prediction. Different from previous work on neural network-based language modeling and generation (e.g., RNN or LSTM), we choose not to greedily summarize the…

Computation and Language · Computer Science 2015-04-27 Mingxuan Wang , Zhengdong Lu , Hang Li , Wenbin Jiang , Qun Liu

Word spotting has become a field of strong research interest in document image analysis over the last years. Recently, AttributeSVMs were proposed which predict a binary attribute representation. At their time, this influential method…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Sebastian Sudholt , Gernot Fink

Visual attention is a mechanism closely intertwined with vision and memory. Top-down information influences visual processing through attention. We designed a neural network model inspired by aspects of human visual attention. This model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ruoyang Hu , Robert A. Jacobs

Recurrent neural networks (RNNs) are very good at modelling the flow of text, but typically need to be trained on a far larger corpus than is available for the PAN 2015 Author Identification task. This paper describes a novel approach where…

Computation and Language · Computer Science 2016-08-17 Douglas Bagnall

Similarity is a comparative-subjective measure that varies with the domain within which it is considered. In several NLP applications such as document classification, pattern recognition, chatbot question-answering, sentiment analysis,…

Machine Learning · Computer Science 2021-11-11 Manuela Nayantara Jeyaraj , Dharshana Kasthurirathna

Attention mechanism has been used as an ancillary means to help RNN or CNN. However, the Transformer (Vaswani et al., 2017) recently recorded the state-of-the-art performance in machine translation with a dramatic reduction in training time…

Computation and Language · Computer Science 2017-12-07 Jinbae Im , Sungzoon Cho

Deep neural networks have shown good data modelling capabilities when dealing with challenging and large datasets from a wide range of application areas. Convolutional Neural Networks (CNNs) offer advantages in selecting good features and…

Computation and Language · Computer Science 2018-11-02 Abdulaziz M. Alayba , Vasile Palade , Matthew England , Rahat Iqbal

This paper proposes an adaptive auxiliary task learning based approach for object counting problems. Unlike existing auxiliary task learning based methods, we develop an attention-enhanced adaptively shared backbone network to enable both…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Yanda Meng , Joshua Bridge , Meng Wei , Yitian Zhao , Yihong Qiao , Xiaoyun Yang , Xiaowei Huang , Yalin Zheng

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn