English
Related papers

Related papers: CTRAN: CNN-Transformer-based Network for Natural L…

200 papers

This paper proposes a generic method to learn interpretable convolutional filters in a deep convolutional neural network (CNN) for object classification, where each interpretable filter encodes features of a specific object part. Our method…

Machine Learning · Computer Science 2020-03-13 Quanshi Zhang , Xin Wang , Ying Nian Wu , Huilin Zhou , Song-Chun Zhu

Semantic role labeling (SRL) is the task of identifying the predicate-argument structure of a sentence. It is typically regarded as an important step in the standard NLP pipeline. As the semantic representations are closely related to…

Computation and Language · Computer Science 2017-08-01 Diego Marcheggiani , Ivan Titov

We propose a novel method to accelerate training and inference process of recurrent neural network transducer (RNN-T) based on the guidance from a co-trained connectionist temporal classification (CTC) model. We made a key assumption that…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-01 Yongqiang Wang , Zhehuai Chen , Chengjian Zheng , Yu Zhang , Wei Han , Parisa Haghani

We study the first-order scattering transform as a candidate for reducing the signal processed by a convolutional neural network (CNN). We show theoretical and empirical evidence that in the case of natural images and sufficiently small…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Edouard Oyallon , Eugene Belilovsky , Sergey Zagoruyko , Michal Valko

In this paper, we proposed a sentence encoding-based model for recognizing text entailment. In our approach, the encoding of sentence is a two-stage process. Firstly, average pooling was used over word-level bidirectional LSTM (biLSTM) to…

Computation and Language · Computer Science 2016-05-31 Yang Liu , Chengjie Sun , Lei Lin , Xiaolong Wang

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., explaining knowledge representations hidden in middle conv-layers of the CNN.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Quanshi Zhang , Yu Yang , Yuchen Liu , Ying Nian Wu , Song-Chun Zhu

For about 10 years, detecting the presence of a secret message hidden in an image was performed with an Ensemble Classifier trained with Rich features. In recent years, studies such as Xu et al. have indicated that well-designed…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Mehdi Yedroudj , Frederic Comby , Marc Chaumont

Targeted sentiment classification aims at determining the sentimental tendency towards specific targets. Most of the previous approaches model context and target words with RNN and attention. However, RNNs are difficult to parallelize and…

Computation and Language · Computer Science 2019-09-24 Youwei Song , Jiahai Wang , Tao Jiang , Zhiyue Liu , Yanghui Rao

Semantic parsing aims to map natural language utterances onto machine interpretable meaning representations, aka programs whose execution against a real-world environment produces a denotation. Weakly-supervised semantic parsers are trained…

Computation and Language · Computer Science 2019-09-11 Bailin Wang , Ivan Titov , Mirella Lapata

Transformer is a powerful architecture that achieves superior performance on various sequence learning tasks, including neural machine translation, language understanding, and sequence prediction. At the core of the Transformer is the…

Machine Learning · Computer Science 2019-11-13 Yao-Hung Hubert Tsai , Shaojie Bai , Makoto Yamada , Louis-Philippe Morency , Ruslan Salakhutdinov

Spoken Language Understanding (SLU) is the problem of extracting the meaning from speech utterances. It is typically addressed as a two-step problem, where an Automatic Speech Recognition (ASR) model is employed to convert speech into text,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-04 Elisavet Palogiannidi , Ioannis Gkinis , George Mastrapas , Petr Mizera , Themos Stafylakis

This paper proposes a learning strategy that extracts object-part concepts from a pre-trained convolutional neural network (CNN), in an attempt to 1) explore explicit semantics hidden in CNN units and 2) gradually grow a semantically…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Quanshi Zhang , Ruiming Cao , Ying Nian Wu , Song-Chun Zhu

Sentence matching is a fundamental task of natural language processing with various applications. Most recent approaches adopt attention-based neural models to build word- or phrase-level alignment between two sentences. However, these…

Computation and Language · Computer Science 2021-10-22 Peng Cui , Le Hu , Yuanchao Liu

Intent detection and slot filling are two main tasks for building a spoken language understanding (SLU) system. The two tasks are closely related and the information of one task can be utilized in the other task. Previous studies either…

Computation and Language · Computer Science 2021-03-09 Libo Qin , Tailu Liu , Wanxiang Che , Bingbing Kang , Sendong Zhao , Ting Liu

Character-level convolutional neural networks (char-CNN) require no knowledge of the semantic or syntactic structure of the language they classify. This property simplifies its implementation but reduces its classification accuracy.…

Computation and Language · Computer Science 2020-12-07 Trevor Londt , Xiaoying Gao , Bing Xue , Peter Andreae

Scene text recognition has been a hot research topic in computer vision due to its various applications. The state of the art is the attention-based encoder-decoder framework that learns the mapping between input images and output sequences…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Zhanzhan Cheng , Fan Bai , Yunlu Xu , Gang Zheng , Shiliang Pu , Shuigeng Zhou

Audio captioning aims to automatically generate a natural language description of an audio clip. Most captioning models follow an encoder-decoder architecture, where the decoder predicts words based on the audio features extracted by the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-22 Xinhao Mei , Xubo Liu , Qiushi Huang , Mark D. Plumbley , Wenwu Wang

DEtection TRansformer (DETR) for object detection reaches competitive performance compared with Faster R-CNN via a transformer encoder-decoder architecture. However, trained with scratch transformers, DETR needs large-scale training data…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Zhigang Dai , Bolun Cai , Yugeng Lin , Junying Chen

We propose a novel method that trains a conditional Generative Adversarial Network (GAN) to generate visual interpretations of a Convolutional Neural Network (CNN). To comprehend a CNN, the GAN is trained with information on how the CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 R T Akash Guna , Raul Benitez , O K Sikha

Click-through rate (CTR) Prediction is a crucial task in personalized information retrievals, such as industrial recommender systems, online advertising, and web search. Most existing CTR Prediction models utilize explicit feature…

Information Retrieval · Computer Science 2024-02-19 Honghao Li , Lei Sang , Yi Zhang , Xuyun Zhang , Yiwen Zhang
‹ Prev 1 8 9 10 Next ›