English
Related papers

Related papers: A General-Purpose Tagger with Convolutional Neural…

200 papers

Convolutional Neural Networks (CNNs) excel at extracting local features hierarchically, but their performance in capturing complex correlations hinges heavily on deep architectures, which are usually computationally demanding and difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Chia-Wei Hsing , Wei-Lin Tu

We present an analysis into the inner workings of Convolutional Neural Networks (CNNs) for processing text. CNNs used for computer vision can be interpreted by projecting filters into image space, but for discrete sequence inputs CNNs…

Computation and Language · Computer Science 2020-04-29 Alon Jacovi , Oren Sar Shalom , Yoav Goldberg

We present a simple and effective approach to incorporating syntactic structure into neural attention-based encoder-decoder models for machine translation. We rely on graph-convolutional networks (GCNs), a recent class of neural networks…

Computation and Language · Computer Science 2020-06-22 Jasmijn Bastings , Ivan Titov , Wilker Aziz , Diego Marcheggiani , Khalil Sima'an

Neural network-based algorithms provide a promising approach to jet classification problems, such as boosted top jet tagging. To date, NN-based top taggers demonstrated excellent performance in Monte Carlo studies. In this paper, we…

High Energy Physics - Phenomenology · Physics 2019-03-27 Suyong Choi , Seung J. Lee , Maxim Perelstein

Convolutional neural networks (CNN) have proven to be state of the art methods for many image classification tasks and their use is rapidly increasing in remote sensing problems. One of their major strengths is that, when enough data is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Gonzalo Mateo-García , Luis Gómez-Chova , Gustau Camps-Valls

In this paper, we study the performance of variants of well-known Convolutional Neural Network (CNN) architectures on different audio tasks. We show that tuning the Receptive Field (RF) of CNNs is crucial to their generalization. An…

Sound · Computer Science 2021-05-27 Khaled Koutini , Hamid Eghbal-zadeh , Gerhard Widmer

In this paper we introduce a novel method for segmentation that can benefit from general semantics of Convolutional Neural Network (CNN). Our segmentation proposes visually and semantically coherent image segments. We use binary encoding of…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Mahdyar Ravanbakhsh , Hossein Mousavi , Moin Nabi , Lucio Marcenaro , Carlo Regazzoni

Convolutional Neural Networks (CNNs) have become the state-of-the-art in supervised learning vision tasks. Their convolutional filters are of paramount importance for they allow to learn patterns while disregarding their locations in input…

Machine Learning · Computer Science 2017-10-26 Jean-Charles Vialatte , Vincent Gripon , Grégoire Mercier

Performant Convolutional Neural Network (CNN) architectures must be tailored to specific tasks in order to consider the length, resolution, and dimensionality of the input data. In this work, we tackle the need for problem-specific CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 David M. Knigge , David W. Romero , Albert Gu , Efstratios Gavves , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn , Jan-Jakob Sonke

While Transformer-based and standard Graph Neural Networks (GNNs) have proven to be the best performers in classifying different types of jets, they require substantial computational power. We explore the scope of using a lightweight and…

High Energy Physics - Phenomenology · Physics 2026-02-23 Rajneil Baruah , Subhadeep Mondal , Sunando Kumar Patra , Satyajit Roy

In recent years, deep learning-based models have significantly improved the Natural Language Processing (NLP) tasks. Specifically, the Convolutional Neural Network (CNN), initially used for computer vision, has shown remarkable performance…

Computation and Language · Computer Science 2022-03-11 Sanskar Soni , Satyendra Singh Chouhan , Santosh Singh Rathore

Convolutional neural networks (CNNs) have recently emerged as a popular building block for natural language processing (NLP). Despite their success, most existing CNN models employed in NLP share the same learned (and static) set of filters…

Computation and Language · Computer Science 2018-08-31 Dinghan Shen , Martin Renqiang Min , Yitong Li , Lawrence Carin

We present a deep hierarchical recurrent neural network for sequence tagging. Given a sequence of words, our model employs deep gated recurrent units on both character and word levels to encode morphology and context information, and…

Computation and Language · Computer Science 2016-08-10 Zhilin Yang , Ruslan Salakhutdinov , William Cohen

In the last two years, convolutional neural networks (CNNs) have achieved an impressive suite of results on standard recognition datasets and tasks. CNN-based features seem poised to quickly replace engineered representations, such as SIFT…

Computer Vision and Pattern Recognition · Computer Science 2014-09-23 Pulkit Agrawal , Ross Girshick , Jitendra Malik

Trigrams'n'Tags (TnT) is an efficient statistical part-of-speech tagger. Contrary to claims found elsewhere in the literature, we argue that a tagger based on Markov models performs at least as well as other current approaches, including…

Computation and Language · Computer Science 2007-05-23 Thorsten Brants

The paper proposes the task of universal semantic tagging---tagging word tokens with language-neutral, semantically informative tags. We argue that the task, with its independent nature, contributes to better semantic analysis for…

Computation and Language · Computer Science 2017-10-02 Lasha Abzianidze , Johan Bos

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

The goal of sentence and document modeling is to accurately represent the meaning of sentences and documents for various Natural Language Processing tasks. In this work, we present Dependency Sensitive Convolutional Neural Networks (DSCNN)…

Computation and Language · Computer Science 2016-11-09 Rui Zhang , Honglak Lee , Dragomir Radev

Recent years, the approaches based on neural networks have shown remarkable potential for sentence modeling. There are two main neural network structures: recurrent neural network (RNN) and convolution neural network (CNN). RNN can capture…

Computation and Language · Computer Science 2020-06-30 Zhenyu Liu , Haiwei Huang , Chaohong Lu , Shengfei Lyu

Deep learning has been widely applied and brought breakthroughs in speech recognition, computer vision, and many other domains. The involved deep neural network architectures and computational issues have been well studied in machine…

Machine Learning · Computer Science 2018-07-23 Ding-Xuan Zhou