English
Related papers

Related papers: SimTeG: A Frustratingly Simple Approach Improves T…

200 papers

Graph neural networks (GNNs) have received massive attention in the field of machine learning on graphs. Inspired by the success of neural networks, a line of research has been conducted to train GNNs to deal with various tasks, such as…

Machine Learning · Computer Science 2022-04-11 Manh Tuan Do , Noseong Park , Kijung Shin

Large Language Models (LLMs) have demonstrated strong capabilities in various natural language processing tasks; however, their application to graph-related problems remains limited, primarily due to scalability constraints and the absence…

Machine Learning · Computer Science 2025-05-08 Hyun Lee , Chris Yi , Maminur Islam , B. D. S. Aritra

Recently, researches have explored the graph neural network (GNN) techniques on text classification, since GNN does well in handling complex structures and preserving global information. However, previous methods based on GNN are mainly…

Computation and Language · Computer Science 2019-10-09 Lianzhe Huang , Dehong Ma , Sujian Li , Xiaodong Zhang , Houfeng WANG

The key to the text classification task is language representation and important information extraction, and there are many related studies. In recent years, the research on graph neural network (GNN) in text classification has gradually…

Computation and Language · Computer Science 2022-09-16 Shuai Hua , Xinxin Li , Yunpeng Jing , Qunfeng Liu

Large language models (LLMs) have demonstrated remarkable in-context reasoning capabilities across a wide range of tasks, particularly with unstructured inputs such as language or images. However, LLMs struggle to handle structured data,…

Machine Learning · Computer Science 2025-02-20 Jintang Li , Ruofan Wu , Yuchang Zhu , Huizhe Zhang , Liang Chen , Zibin Zheng

In the field of natural language processing, text classification, as a basic task, has important research value and application prospects. Traditional text classification methods usually rely on feature representations such as the bag of…

Computation and Language · Computer Science 2024-08-29 Erdi Gao , Haowei Yang , Dan Sun , Haohao Xia , Yuhan Ma , Yuanjing Zhu

Large scale pretrained models have revolutionized Natural Language Processing (NLP) and Computer Vision (CV), showcasing remarkable cross domain generalization abilities. However, in graph learning, models are typically trained on…

Computation and Language · Computer Science 2025-10-03 Ruyue Liu , Rong Yin , Xiangzhen Bo , Xiaoshuai Hao , Yong Liu , Jinwen Zhong , Can Ma , Weiping Wang

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance in tasks such as node classification and link prediction. However, most existing GNNs are designed to learn…

Machine Learning · Computer Science 2020-02-06 Seongjun Yun , Minbyul Jeong , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

The text-attributed graph (TAG) is one kind of important real-world graph-structured data with each node associated with raw texts. For TAGs, traditional few-shot node classification methods directly conduct training on the pre-processed…

Social and Information Networks · Computer Science 2024-07-23 Huanjing Zhao , Beining Yang , Yukuo Cen , Junyu Ren , Chenhui Zhang , Yuxiao Dong , Evgeny Kharlamov , Shu Zhao , Jie Tang

Can we combine heterogenous graph structure with text to learn high-quality semantic and behavioural representations? Graph neural networks (GNN)s encode numerical node attributes and graph structure to achieve impressive performance in a…

Machine Learning · Computer Science 2022-06-23 Vassilis N. Ioannidis , Xiang Song , Da Zheng , Houyu Zhang , Jun Ma , Yi Xu , Belinda Zeng , Trishul Chilimbi , George Karypis

Representation learning on graphs has been gaining attention due to its wide applicability in predicting missing links, and classifying and recommending nodes. Most embedding methods aim to preserve certain properties of the original graph…

Social and Information Networks · Computer Science 2019-09-13 Palash Goyal , Di Huang , Sujit Rokka Chhetri , Arquimedes Canedo , Jaya Shree , Evan Patterson

Graph-structured data is prevalent in the real world. Recently, due to the powerful emergent capabilities, Large Language Models (LLMs) have shown promising performance in modeling graphs. The key to effectively applying LLMs on graphs is…

Computation and Language · Computer Science 2024-10-16 Haitong Luo , Xuying Meng , Suhang Wang , Tianxiang Zhao , Fali Wang , Hanyun Cao , Yujun Zhang

Graphs have a superior ability to represent relational data, like chemical compounds, proteins, and social networks. Hence, graph-level learning, which takes a set of graphs as input, has been applied to many tasks including comparison,…

Machine Learning · Computer Science 2023-05-26 Zhenyu Yang , Ge Zhang , Jia Wu , Jian Yang , Quan Z. Sheng , Shan Xue , Chuan Zhou , Charu Aggarwal , Hao Peng , Wenbin Hu , Edwin Hancock , Pietro Liò

Dynamic interactions between entities are prevalent in domains like social platforms, financial systems, healthcare, and e-commerce. These interactions can be effectively represented as time-evolving graphs, where predicting future…

Machine Learning · Computer Science 2026-01-21 Sidharth Agarwal , Tanishq Dubey , Shubham Gupta , Srikanta Bedathur

End-to-end training of graph neural networks (GNN) on large graphs presents several memory and computational challenges, and limits the application to shallow architectures as depth exponentially increases the memory and space complexities.…

Machine Learning · Computer Science 2023-09-06 Oscar Pina , Verónica Vilaplana

Pretrained Language Models (PLMs) such as BERT have revolutionized the landscape of Natural Language Processing (NLP). Inspired by their proliferation, tremendous efforts have been devoted to Pretrained Graph Models (PGMs). Owing to the…

Machine Learning · Computer Science 2022-03-22 Jun Xia , Yanqiao Zhu , Yuanqi Du , Stan Z. Li

This work studies self-supervised graph learning for text-attributed graphs (TAGs) where nodes are represented by textual attributes. Unlike traditional graph contrastive methods that perturb the numerical feature space and alter the…

Machine Learning · Computer Science 2024-06-19 Yi Fang , Dongzhe Fan , Daochen Zha , Qiaoyu Tan

Discrete-Time Dynamic Graphs (DTDGs), which are prevalent in real-world implementations and notable for their ease of data acquisition, have garnered considerable attention from both academic researchers and industry practitioners. The…

Machine Learning · Computer Science 2024-07-29 Xi Chen , Yun Xiong , Siwei Zhang , Jiawei Zhang , Yao Zhang , Shiyang Zhou , Xixi Wu , Mingyang Zhang , Tengfei Liu , Weiqiang Wang

Graph representation learning is a fast-growing field where one of the main objectives is to generate meaningful representations of graphs in lower-dimensional spaces. The learned embeddings have been successfully applied to perform various…

Machine Learning · Computer Science 2021-12-21 Md. Khaledur Rahman , Ariful Azad

Multimodal-attributed graphs (MAGs) are a fundamental data structure for multimodal graph learning (MGL), enabling both graph-centric and modality-centric tasks. However, our empirical analysis reveals inherent topology quality limitations…

Machine Learning · Computer Science 2026-03-31 Yinlin Zhu , Xunkai Li , Di Wu , Wang Luo , Miao Hu , Di Wu