English
Related papers

Related papers: Structural Attention Neural Networks for improved …

200 papers

We present a novel response generation system that can be trained end to end on large quantities of unstructured Twitter conversations. A neural network architecture is used to address sparsity issues that arise when integrating contextual…

Computation and Language · Computer Science 2015-06-23 Alessandro Sordoni , Michel Galley , Michael Auli , Chris Brockett , Yangfeng Ji , Margaret Mitchell , Jian-Yun Nie , Jianfeng Gao , Bill Dolan

Multimodal sentiment analysis benefits various applications such as human-computer interaction and recommendation systems. It aims to infer the users' bipolar ideas using visual, textual, and acoustic signals. Although researchers affirm…

Machine Learning · Computer Science 2021-06-29 Sana Rahmani , Saeid Hosseini , Raziyeh Zall , Mohammad Reza Kangavari , Sara Kamran , Wen Hua

One of the fundamental principles of contemporary linguistics states that language processing requires the ability to extract recursively nested tree structures. However, it remains unclear whether and how this code could be implemented in…

Computation and Language · Computer Science 2021-01-08 Yair Lakretz , Théo Desbordes , Jean-Rémi King , Benoît Crabbé , Maxime Oquab , Stanislas Dehaene

Sequence modeling has demonstrated state-of-the-art performance on natural language and document understanding tasks. However, it is challenging to correctly serialize tokens in form-like documents in practice due to their variety of layout…

Computation and Language · Computer Science 2022-03-25 Chen-Yu Lee , Chun-Liang Li , Timothy Dozat , Vincent Perot , Guolong Su , Nan Hua , Joshua Ainslie , Renshen Wang , Yasuhisa Fujii , Tomas Pfister

In this paper, to remedy this deficiency, we propose a Linear Attention Mechanism which is approximate to dot-product attention with much less memory and computational costs. The efficient design makes the incorporation between attention…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Rui Li , Jianlin Su , Chenxi Duan , Shunyi Zheng

The growing prosperity of social networks has brought great challenges to the sentimental tendency mining of users. As more and more researchers pay attention to the sentimental tendency of online users, rich research results have been…

Computation and Language · Computer Science 2019-07-04 Donghang Pan , Jingling Yuan , Lin Li , Deming Sheng

We report on a series of experiments with convolutional neural networks (CNN) trained on top of pre-trained word vectors for sentence-level classification tasks. We show that a simple CNN with little hyperparameter tuning and static vectors…

Computation and Language · Computer Science 2014-09-04 Yoon Kim

Fine-grained sentiment analysis involves extracting and organizing sentiment elements from textual data. However, existing approaches often overlook issues of category semantic inclusion and overlap, as well as inherent structural patterns…

Computation and Language · Computer Science 2024-08-01 Jun Zhou , Dongyang Yu , Kamran Aziz , Fangfang Su , Qing Zhang , Fei Li , Donghong Ji

With the popularity of social networks, and e-commerce websites, sentiment analysis has become a more active area of research in the past few years. On a high level, sentiment analysis tries to understand the public opinion about a specific…

Computation and Language · Computer Science 2019-04-14 Shervin Minaee , Elham Azimi , AmirAli Abdolrashidi

In aspect-level sentiment classification (ASC), it is prevalent to equip dominant neural models with attention mechanisms, for the sake of acquiring the importance of each context word on the given aspect. However, such a mechanism tends to…

Computation and Language · Computer Science 2019-06-07 Jialong Tang , Ziyao Lu , Jinsong Su , Yubin Ge , Linfeng Song , Le Sun , Jiebo Luo

Recently, the pre-trained language model, BERT (and its robustly optimized version RoBERTa), has attracted a lot of attention in natural language understanding (NLU), and achieved state-of-the-art accuracy in various NLU tasks, such as…

Computation and Language · Computer Science 2019-09-30 Wei Wang , Bin Bi , Ming Yan , Chen Wu , Zuyi Bao , Jiangnan Xia , Liwei Peng , Luo Si

A new language model for speech recognition is presented. The model develops hidden hierarchical syntactic-like structure incrementally and uses it to extract meaningful information from the word history, thus complementing the locality of…

Computation and Language · Computer Science 2007-05-23 Ciprian Chelba , Frederick Jelinek

Aspect level sentiment classification is a fine-grained sentiment analysis task. To detect the sentiment towards a particular aspect in a sentence, previous studies have developed various attention-based methods for generating…

Computation and Language · Computer Science 2019-08-22 Mengting Hu , Shiwan Zhao , Li Zhang , Keke Cai , Zhong Su , Renhong Cheng , Xiaowei Shen

Generalized linear and additive models are very efficient regression tools but the selection of relevant terms becomes difficult if higher order interactions are needed. In contrast, tree-based methods also known as recursive partitioning…

Methodology · Statistics 2015-04-21 Gerhard Tutz , Moritz Berger

Structured sentiment analysis, which aims to extract the complex semantic structures such as holders, expressions, targets, and polarities, has obtained widespread attention from both industry and academia. Unfortunately, the existing…

Computation and Language · Computer Science 2022-06-01 Qi Zhang , Jie Zhou , Qin Chen , Qingchun Bai , Jun Xiao , Liang He

Sentiment analysis, a popular technique for opinion mining, has been used by the software engineering research community for tasks such as assessing app reviews, developer emotions in issue trackers and developer opinions on APIs. Past…

Computation and Language · Computer Science 2018-12-27 Achyudh Ram , Meiyappan Nagappan

Unsupervised structure learning in high-dimensional time series data has attracted a lot of research interests. For example, segmenting and labelling high dimensional time series can be helpful in behavior understanding and medical…

Machine Learning · Computer Science 2017-05-25 Hao Liu , Haoli Bai , Lirong He , Zenglin Xu

Recursive neural networks (Tree-RNNs) based on dependency trees are ubiquitous in modeling sentence meanings as they effectively capture semantic relationships between non-neighborhood words. However, recognizing semantically dissimilar…

Computation and Language · Computer Science 2022-01-14 Jeena Kleenankandy , K A Abdul Nazeer

Visual attention mechanisms have proven to be integrally important constituent components of many modern deep neural architectures. They provide an efficient and effective way to utilize visual information selectively, which has shown to be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Siddhesh Khandelwal , Leonid Sigal

Argument mining automatically identifies and extracts the structure of inference and reasoning conveyed in natural language arguments. To the best of our knowledge, most of the state-of-the-art works in this field have focused on using…

Computation and Language · Computer Science 2023-02-28 Pranjal Srivastava , Pranav Bhatnagar , Anurag Goel