English
Related papers

Related papers: Contextualized Non-local Neural Networks for Seque…

200 papers

Text classification plays an important role in various downstream text-related tasks, such as sentiment analysis, fake news detection, and public opinion analysis. Recently, text classification based on Graph Neural Networks (GNNs) has made…

Computation and Language · Computer Science 2025-12-24 Zuo Wang , Ye Yuan

Recently, graph neural networks (GNNs) have been widely used for document classification. However, most existing methods are based on static word co-occurrence graphs without sentence-level information, which poses three challenges:(1) word…

Computation and Language · Computer Science 2022-03-22 Yinhua Piao , Sangseon Lee , Dohoon Lee , Sun Kim

The goal of sentence and document modeling is to accurately represent the meaning of sentences and documents for various Natural Language Processing tasks. In this work, we present Dependency Sensitive Convolutional Neural Networks (DSCNN)…

Computation and Language · Computer Science 2016-11-09 Rui Zhang , Honglak Lee , Dragomir Radev

Graph Neural Networks (GNNs) have gained momentum in graph representation learning and boosted the state of the art in a variety of areas, such as data mining (\emph{e.g.,} social network analysis and recommender systems), computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Chaoqi Chen , Yushuang Wu , Qiyuan Dai , Hong-Yu Zhou , Mutian Xu , Sibei Yang , Xiaoguang Han , Yizhou Yu

Recently, Graph Neural Networks (GNNs) have greatly advanced the task of graph classification. Typically, we first build a unified GNN model with graphs in a given training set and then use this unified model to predict labels of all the…

Machine Learning · Computer Science 2021-12-15 Yiqi Wang , Yao Ma , Wei Jin , Chaozhuo Li , Charu Aggarwal , Jiliang Tang

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Sequence-to-sequence learning with neural networks has become the de facto standard for sequence prediction tasks. This approach typically models the local distribution over the next word with a powerful neural network that can condition on…

Computation and Language · Computer Science 2021-11-17 Yoon Kim

Recommendations can greatly benefit from good representations of the user state at recommendation time. Recent approaches that leverage Recurrent Neural Networks (RNNs) for session-based recommendations have shown that Deep Learning models…

Information Retrieval · Computer Science 2017-06-26 Elena Smirnova , Flavian Vasile

Recently, text classification model based on graph neural network (GNN) has attracted more and more attention. Most of these models adopt a similar network paradigm, that is, using pre-training node embedding initialization and two-layer…

Computation and Language · Computer Science 2023-01-26 Jiayuan Chen , Boyu Zhang , Yinfei Xu , Meng Wang

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to…

Machine Learning · Computer Science 2019-11-14 Michael Lingzhi Li , Meng Dong , Jiawei Zhou , Alexander M. Rush

We explore the use of graph neural networks (GNNs) to model spatial processes in which there is no a priori graphical structure. Similar to finite element analysis, we assign nodes of a GNN to spatial locations and use a computational…

Machine Learning · Computer Science 2019-11-19 Ferran Alet , Adarsh K. Jeewajee , Maria Bauza , Alberto Rodriguez , Tomas Lozano-Perez , Leslie Pack Kaelbling

Morphological declension, which aims to inflect nouns to indicate number, case and gender, is an important task in natural language processing (NLP). This research proposal seeks to address the degree to which Recurrent Neural Networks…

Computation and Language · Computer Science 2018-10-10 Sina Ahmadi

This paper deals with the unification of local and non-local signal processing on graphs within a single convolutional neural network (CNN) framework. Building upon recent works on graph CNNs, we propose to use convolutional layers that…

Computer Vision and Pattern Recognition · Computer Science 2017-07-10 Gilles Puy , Srdan Kitic , Patrick Pérez

Contextually Guided Convolutional Neural Networks (CG-CNNs) employ self-supervision and contextual information to develop transferable features across diverse domains, including visual, tactile, temporal, and textual data. This work…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Olcay Kursun , Ahmad Patooghy , Peyman Poursani , Oleg V. Favorov

This thesis presents a local-to-global perspective on graph neural networks (GNN), the leading architecture to process graph-structured data. After categorizing GNN into local Message Passing Neural Networks (MPNN) and global Graph…

Machine Learning · Computer Science 2023-06-21 Chen Cai

Convolutional neural networks (CNNs) have been recently used for a variety of histology image analysis. However, availability of a large dataset is a major prerequisite for training a CNN which limits its use by the computational pathology…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Ruqayya Awan , Navid Alemi Koohbanani , Muhammad Shaban , Anna Lisowska , Nasir Rajpoot

Due to their inherent capability in semantic alignment of aspects and their context words, attention mechanism and Convolutional Neural Networks (CNNs) are widely applied for aspect-based sentiment classification. However, these models lack…

Computation and Language · Computer Science 2019-10-15 Chen Zhang , Qiuchi Li , Dawei Song

Graph representation learning has become a crucial task in machine learning and data mining due to its potential for modeling complex structures such as social networks, chemical compounds, and biological systems. Spiking neural networks…

Artificial Intelligence · Computer Science 2024-03-27 Huifeng Yin , Mingkun Xu , Jing Pei , Lei Deng

We present two architectures for multi-task learning with neural sequence models. Our approach allows the relationships between different tasks to be learned dynamically, rather than using an ad-hoc pre-defined structure as in previous…

Computation and Language · Computer Science 2018-11-27 Pengfei Liu , Jie Fu , Yue Dong , Xipeng Qiu , Jackie Chi Kit Cheung

Graph Convolutional Networks (GCNs) have attracted increasing interests for the task of skeleton-based action recognition. The key lies in the design of the graph structure, which encodes skeleton topology information. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Fanfan Ye , Shiliang Pu , Qiaoyong Zhong , Chao Li , Di Xie , Huiming Tang