English
Related papers

Related papers: Structural Attention Neural Networks for improved …

200 papers

Probabilistic sentential decision diagrams are a class of structured-decomposable probabilistic circuits especially designed to embed logical constraints. To adapt the classical LearnSPN scheme to learn the structure of these models, we…

Artificial Intelligence · Computer Science 2021-07-27 Alessandro Antonucci , Alessandro Facchini , Lilith Mattei

Named entity recognition (NER) is highly sensitive to sentential syntactic and semantic properties where entities may be extracted according to how they are used and placed in the running text. To model such properties, one could rely on…

Computation and Language · Computer Science 2020-10-30 Yuyang Nie , Yuanhe Tian , Yan Song , Xiang Ao , Xiang Wan

In this work we investigate the capability of Graph Attention Network for extracting aspect and opinion terms. Aspect and opinion term extraction is posed as a token-level classification task akin to named entity recognition. We use the…

Computation and Language · Computer Science 2024-05-01 Abir Chakraborty

Many common sequential data sources, such as source code and natural language, have a natural tree-structured representation. These trees can be generated by fitting a sequence to a grammar, yielding a hierarchical ordering of the tokens in…

Machine Learning · Computer Science 2019-08-02 Jacob Harer , Chris Reale , Peter Chin

Target-oriented sentiment classification is a fine-grained task of natural language processing to analyze the sentiment polarity of the targets. To improve the performance of sentiment classification, many approaches proposed various…

Computation and Language · Computer Science 2021-02-02 Heng Yang , Biqing Zeng

In-context learning with attention enables large neural networks to make context-specific predictions by selectively focusing on relevant examples. Here, we adapt this idea to supervised learning procedures such as lasso regression and…

Machine Learning · Statistics 2025-12-11 Erin Craig , Robert Tibshirani

Targeted sentiment analysis is the task of jointly predicting target entities and their associated sentiment information. Existing research efforts mostly regard this joint task as a sequence labeling problem, building models that can…

Computation and Language · Computer Science 2019-09-18 Hao Li , Wei Lu

We describe and analyze a simple and effective algorithm for sequence segmentation applied to speech processing tasks. We propose a neural architecture that is composed of two modules trained jointly: a recurrent neural network (RNN) module…

Computation and Language · Computer Science 2016-10-26 Yossi Adi , Joseph Keshet , Emily Cibelli , Matthew Goldrick

In this paper, we define and study a new task called Context-Aware Semantic Expansion (CASE). Given a seed term in a sentential context, we aim to suggest other terms that well fit the context as the seed. CASE has many interesting…

Computation and Language · Computer Science 2020-01-01 Jialong Han , Aixin Sun , Haisong Zhang , Chenliang Li , Shuming Shi

Recurrent neural networks (RNNs) have long been an architecture of interest for computational models of human sentence processing. The recently introduced Transformer architecture outperforms RNNs on many natural language processing tasks…

Computation and Language · Computer Science 2022-03-31 Danny Merkx , Stefan L. Frank

Combining additive models and neural networks allows to broaden the scope of statistical regression and extend deep learning-based approaches by interpretable structured additive predictors at the same time. Existing attempts uniting the…

Machine Learning · Statistics 2022-07-12 David Rügamer , Chris Kolb , Nadja Klein

Sentiment analysis is a field within NLP that has gained importance because it is applied in various areas such as; social media surveillance, customer feedback evaluation and market research. At the same time, distributed systems allow for…

Computation and Language · Computer Science 2025-03-25 Mahak Shah , Akaash Vishal Hazarika , Meetu Malhotra , Sachin C. Patil , Joshit Mohanty

Neural encoder-decoder models of machine translation have achieved impressive results, rivalling traditional translation models. However their modelling formulation is overly simplistic, and omits several key inductive biases built into…

Computation and Language · Computer Science 2016-01-07 Trevor Cohn , Cong Duy Vu Hoang , Ekaterina Vymolova , Kaisheng Yao , Chris Dyer , Gholamreza Haffari

Sentiment analysis on software engineering (SE) texts has been widely used in the SE research, such as evaluating app reviews or analyzing developers sentiments in commit messages. To better support the use of automated sentiment analysis…

Software Engineering · Computer Science 2021-03-25 Kexin Sun , Hui Gao , Hongyu Kuang , Xiaoxing Ma , Guoping Rong , Dong Shao , He Zhang

In this work, we investigate several neural network architectures for fine-grained entity type classification. Particularly, we consider extensions to a recently proposed attentive neural architecture and make three key contributions.…

Computation and Language · Computer Science 2017-02-22 Sonse Shimaoka , Pontus Stenetorp , Kentaro Inui , Sebastian Riedel

In natural language the intended meaning of a word or phrase is often implicit and depends on the context. In this work, we propose a simple yet effective method for sentiment analysis using contextual embeddings and a self-attention…

Computation and Language · Computer Science 2020-10-07 Katarzyna Biesialska , Magdalena Biesialska , Henryk Rybinski

Tree-structured neural networks have proven to be effective in learning semantic representations by exploiting syntactic information. In spite of their success, most existing models suffer from the underfitting problem: they recursively use…

Computation and Language · Computer Science 2017-05-12 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Contextualized representation models such as ELMo (Peters et al., 2018a) and BERT (Devlin et al., 2018) have recently achieved state-of-the-art results on a diverse array of downstream NLP tasks. Building on recent token-level probing work,…

Discourse relations bind smaller linguistic elements into coherent texts. However, automatically identifying discourse relations is difficult, because it requires understanding the semantics of the linked sentences. A more subtle challenge…

Computation and Language · Computer Science 2015-04-29 Yangfeng Ji , Jacob Eisenstein

RST-style discourse parsing plays a vital role in many NLP tasks, revealing the underlying semantic/pragmatic structure of potentially complex and diverse documents. Despite its importance, one of the most prevailing limitations in modern…

Computation and Language · Computer Science 2021-12-14 Patrick Huber , Linzi Xing , Giuseppe Carenini