English
Related papers

Related papers: Be More with Less: Hypergraph Attention Networks f…

200 papers

Textual Attributed Graphs (TAGs) are crucial for modeling complex real-world systems, yet leveraging large language models (LLMs) for TAGs presents unique challenges due to the gap between sequential text processing and graph-structured…

Machine Learning · Computer Science 2025-05-09 Zhengyu Hu , Yichuan Li , Zhengyu Chen , Jingang Wang , Han Liu , Kyumin Lee , Kaize Ding

Graph or network data is ubiquitous in the real world, including social networks, information networks, traffic networks, biological networks and various technical networks. The non-Euclidean nature of graph data poses the challenge for…

Social and Information Networks · Computer Science 2019-09-06 Junjie Huang , Huawei Shen , Liang Hou , Xueqi Cheng

Pretrained transformer-based Language Models (LMs) are well-known for their ability to achieve significant improvement on text classification tasks with their powerful word embeddings, but their black-box nature, which leads to a lack of…

Computation and Language · Computer Science 2024-12-23 Ximing Wen , Wenjuan Tan , Rosina O. Weber

Document classification is a challenging task with important applications. The deep learning approaches to the problem have gained much attention recently. Despite the progress, the proposed models do not incorporate the knowledge of the…

Computation and Language · Computer Science 2019-10-15 Jader Abreu , Luis Fred , David Macêdo , Cleber Zanchettin

This paper explores the applications and challenges of graph neural networks (GNNs) in processing complex graph data brought about by the rapid development of the Internet. Given the heterogeneity and redundancy problems that graph data…

Machine Learning · Computer Science 2024-10-24 Jianjun Wei , Yue Liu , Xin Huang , Xin Zhang , Wenyi Liu , Xu Yan

Graph-based text representation focuses on how text documents are represented as graphs for exploiting dependency information between tokens and documents within a corpus. Despite the increasing interest in graph representation learning,…

Computation and Language · Computer Science 2022-10-13 Wenzhe Li , Nikolaos Aletras

The demand for text classification is growing significantly in web searching, data mining, web ranking, recommendation systems, and so many other fields of information and technology. This paper illustrates the text classification process…

Computation and Language · Computer Science 2025-09-03 Sadia Zaman Mishu , S M Rafiuddin

Subgraph representation learning based on Graph Neural Network (GNN) has exhibited broad applications in scientific advancements, such as predictions of molecular structure-property relationships and collective cellular function. In…

Machine Learning · Computer Science 2022-10-17 Yili Shen , Xiao Liu , Cheng-Wei Ju , Jiaxu Yan , Jun Yi , Zhou Lin , Hui Guan

Recently, graph neural networks (GNNs) have been widely used for document classification. However, most existing methods are based on static word co-occurrence graphs without sentence-level information, which poses three challenges:(1) word…

Computation and Language · Computer Science 2022-03-22 Yinhua Piao , Sangseon Lee , Dohoon Lee , Sun Kim

Graph neural networks (GNNs), as a group of powerful tools for representation learning on irregular data, have manifested superiority in various downstream tasks. With unstructured texts represented as concept maps, GNNs can be exploited…

Information Retrieval · Computer Science 2022-01-14 Hejie Cui , Jiaying Lu , Yao Ge , Carl Yang

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Self-supervised learning is currently gaining a lot of attention, as it allows neural networks to learn robust representations from large quantities of unlabeled data. Additionally, multi-task learning can further improve representation…

Machine Learning · Computer Science 2020-12-07 Franco Manessi , Alessandro Rozza

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Graph Neural Networks (GNNs) have been widely used to learn representations on graphs and tackle many real-world problems from a wide range of domains. In this paper we propose wsGAT, an extension of the Graph Attention Network (GAT)…

Social and Information Networks · Computer Science 2022-02-01 Marco Grassia , Giuseppe Mangioni

Graphs play an important role in many applications. Recently, Graph Neural Networks (GNNs) have achieved promising results in graph analysis tasks. Some state-of-the-art GNN models have been proposed, e.g., Graph Convolutional Networks…

Machine Learning · Computer Science 2021-09-29 Yaoman Li , Irwin King

Text classification is a primary task in natural language processing (NLP). Recently, graph neural networks (GNNs) have developed rapidly and been applied to text classification tasks. As a special kind of graph data, the tree has a simpler…

Computation and Language · Computer Science 2022-08-23 Chong Zhang , He Zhu , Xingyu Peng , Junran Wu , Ke Xu

As urban environments grow, the modelling of transportation systems becomes increasingly complex. This paper advances the field of travel demand modelling by introducing advanced Graph Neural Network (GNN) architectures as surrogate models,…

Machine Learning · Computer Science 2025-03-21 Nikita Makarov , Santhanakrishnan Narayanan , Constantinos Antoniou

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

Machine Learning · Computer Science 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Hypergraphs, with their capacity to depict high-order relationships, have emerged as a significant extension of traditional graphs. Although Graph Neural Networks (GNNs) have remarkable performance in graph representation learning, their…

Machine Learning · Computer Science 2024-11-07 Khaled Mohammed Saifuddin , Mehmet Emin Aktas , Esra Akbas