English
Related papers

Related papers: LLM-driven Knowledge Distillation for Dynamic Text…

200 papers

Unsupervised representation learning for dynamic graphs has attracted a lot of research attention in recent years. Compared with static graph, the dynamic graph is a comprehensive embodiment of both the intrinsic stable characteristics of…

Social and Information Networks · Computer Science 2023-08-17 Kaike Zhang , Qi Cao , Gaolin Fang , Bingbing Xu , Hongjian Zou , Huawei Shen , Xueqi Cheng

Reasoning over temporal knowledge graphs (TKGs) is fundamental to improving the efficiency and reliability of intelligent decision-making systems and has become a key technological foundation for future artificial intelligence applications.…

Computation and Language · Computer Science 2026-01-05 Wang Xing , Wei Song , Siyu Lin , Chen Wu , Zhesi Li , Man Wang

Text-attributed graphs (TAGs) have emerged as a powerful representation for modeling complex relationships across diverse domains. With the rise of large language models (LLMs), there is growing interest in leveraging their capabilities for…

Machine Learning · Computer Science 2025-07-29 Jianyuan Bo , Hao Wu , Yuan Fang

With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models…

Machine Learning · Computer Science 2024-12-18 Xunkai Li , Zhengyu Wu , Jiayi Wu , Hanwen Cui , Jishuo Jia , Rong-Hua Li , Guoren Wang

Dynamic knowledge graphs (DKGs) are popular structures to express different types of connections between objects over time. They can also serve as an efficient mathematical tool to represent information extracted from complex unstructured…

Computational Finance · Quantitative Finance 2024-12-24 Xiaohui Victor Li , Francesco Sanna Passino

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Text-Attributed Graphs (TAGs) are graphs of connected textual documents. Graph models can efficiently learn TAGs, but their training heavily relies on human-annotated labels, which are scarce or even unavailable in many applications. Large…

Computation and Language · Computer Science 2024-08-07 Bo Pan , Zheng Zhang , Yifei Zhang , Yuntong Hu , Liang Zhao

Graph Neural Networks (GNNs) have revolutionized graph-based machine learning, but their heavy computational demands pose challenges for latency-sensitive edge devices in practical industrial applications. In response, a new wave of…

Machine Learning · Computer Science 2024-05-24 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang

Text-attributed graphs (TAGs) present unique challenges in representation learning by requiring models to capture both the semantic richness of node-associated texts and the structural dependencies of the graph. While graph neural networks…

Computation and Language · Computer Science 2026-05-26 Azadeh Beiranvand , Seyed Mehdi Vahidipour

GNN-to-MLP distillation aims to utilize knowledge distillation (KD) to learn computationally-efficient multi-layer perceptron (student MLP) on graph data by mimicking the output representations of teacher GNN. Existing methods mainly make…

Machine Learning · Computer Science 2024-03-07 Ling Yang , Ye Tian , Minkai Xu , Zhongyi Liu , Shenda Hong , Wei Qu , Wentao Zhang , Bin Cui , Muhan Zhang , Jure Leskovec

Learning from Text-Attributed Graphs (TAGs) has attracted significant attention due to its wide range of real-world applications. The rapid evolution of language models (LMs) has revolutionized the way we process textual data, which…

Machine Learning · Computer Science 2024-10-25 Rui Xue , Xipeng Shen , Ruozhou Yu , Xiaorui Liu

Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node embeddings through shallow embedding learning using GNNs,…

Artificial Intelligence · Computer Science 2025-02-13 Chuanqi Shi , Yiyi Tao , Hang Zhang , Lun Wang , Shaoshuai Du , Yixian Shen , Yanxin Shen

Recent research on deep graph learning has shifted from static to dynamic graphs, motivated by the evolving behaviors observed in complex real-world systems. However, the temporal extension in dynamic graphs poses significant data…

Machine Learning · Computer Science 2025-06-17 Dong Chen , Shuai Zheng , Yeyu Yan , Muhao Xu , Zhenfeng Zhu , Yao Zhao , Kunlun He

Dynamic graphs arise in various real-world applications, and it is often welcomed to model the dynamics directly in continuous time domain for its flexibility. This paper aims to design an easy-to-use pipeline (termed as EasyDGL which is…

Machine Learning · Computer Science 2024-08-20 Chao Chen , Haoyu Geng , Nianzu Yang , Xiaokang Yang , Junchi Yan

Temporal Knowledge Graphs (TKGs), as an extension of static Knowledge Graphs (KGs), incorporate the temporal feature to express the transience of knowledge by describing when facts occur. TKG extrapolation aims to infer possible future…

Artificial Intelligence · Computer Science 2025-05-30 Hao Dong , Ziyue Qiao , Zhiyuan Ning , Qi Hao , Yi Du , Pengyang Wang , Yuanchun Zhou

Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool.…

Computation and Language · Computer Science 2025-02-10 Zehong Wang , Sidney Liu , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

Textual Attributed Graphs (TAGs) are crucial for modeling complex real-world systems, yet leveraging large language models (LLMs) for TAGs presents unique challenges due to the gap between sequential text processing and graph-structured…

Machine Learning · Computer Science 2025-05-09 Zhengyu Hu , Yichuan Li , Zhengyu Chen , Jingang Wang , Han Liu , Kyumin Lee , Kaize Ding

Recently published graph neural networks (GNNs) show promising performance at social event detection tasks. However, most studies are oriented toward monolingual data in languages with abundant training samples. This has left the more…

Machine Learning · Computer Science 2023-04-03 Jiaqian Ren , Hao Peng , Lei Jiang , Jia Wu , Yongxin Tong , Lihong Wang , Xu Bai , Bo Wang , Qiang Yang

Graph-based personality detection constructs graph structures from textual data, particularly social media posts. Current methods often struggle with sparse or noisy data and rely on static graphs, limiting their ability to capture dynamic…

Computation and Language · Computer Science 2025-04-04 Lingzhi Shen , Yunfei Long , Xiaohao Cai , Guanming Chen , Yuhan Wang , Imran Razzak , Shoaib Jameel

Dynamic graph representation learning strategies are based on different neural architectures to capture the graph evolution over time. However, the underlying neural architectures require a large amount of parameters to train and suffer…

Machine Learning · Computer Science 2020-11-12 Stefanos Antaris , Dimitrios Rafailidis