English
Related papers

Related papers: Can Representation Gaps Be the Key to Enhancing Ro…

200 papers

Link prediction is a crucial task in many downstream applications of graph machine learning. To this end, Graph Neural Network (GNN) is a widely used technique for link prediction, mainly in transductive settings, where the goal is to…

Machine Learning · Computer Science 2025-03-06 Ahmed E. Samy , Zekarias T. Kefato , Sarunas Girdzijauskas

Graph Neural Networks (GNNs) are widely adopted in Web-related applications, serving as a core technique for learning from graph-structured data, such as text-attributed graphs. Yet in real-world scenarios, such graphs exhibit deficiencies…

Machine Learning · Computer Science 2025-10-03 Zhaoyan Wang , Zheng Gao , Arogya Kharel , In-Young Ko

Graph learning is a prevalent domain that endeavors to learn the intricate relationships among nodes and the topological structure of graphs. Over the years, graph learning has transcended from graph theory to graph data mining. With the…

Artificial Intelligence · Computer Science 2024-09-24 Shaopeng Wei , Jun Wang , Yu Zhao , Xingyan Chen , Qing Li , Fuzhen Zhuang , Ji Liu , Fuji Ren , Gang Kou

Dynamic graph representation learning has emerged as a crucial research area, driven by the growing need for analyzing time-evolving graph data in real-world applications. While recent approaches leveraging recurrent neural networks (RNNs)…

Machine Learning · Computer Science 2024-10-28 Shengxiang Hu , Guobing Zou , Song Yang , Shiyi Lin , Yanglan Gan , Bofeng Zhang

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

Large Language Models have emerged as a promising approach for graph learning due to their powerful reasoning capabilities. However, existing methods exhibit systematic performance degradation on structurally important nodes such as bridges…

Recent improvements in KG-to-text generation are due to additional auxiliary pre-training tasks designed to give the fine-tune task a boost in performance. These tasks require extensive computational resources while only suggesting marginal…

Computation and Language · Computer Science 2023-05-19 Anthony Colas , Mehrdad Alvandipour , Daisy Zhe Wang

Self-supervised node representation learning aims to learn node representations from unlabelled graphs that rival the supervised counterparts. The key towards learning informative node representations lies in how to effectively gain…

Machine Learning · Computer Science 2023-02-13 Wei Dong , Dawei Yan , Peng Wang

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Multi-graph learning is crucial for extracting meaningful signals from collections of heterogeneous graphs. However, effectively integrating information across graphs with differing topologies, scales, and semantics, often in the absence of…

Machine Learning · Computer Science 2026-02-02 Zahra Moslemi , Ziyi Liang , Norbert Fortin , Babak Shahbaba

The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to…

Computation and Language · Computer Science 2023-10-10 Ziwei Chai , Tianjie Zhang , Liang Wu , Kaiqiao Han , Xiaohai Hu , Xuanwen Huang , Yang Yang

Heterogeneous graphs are widely present in real-world complex networks, where the diversity of node and relation types leads to complex and rich semantics. Efforts for modeling complex relation semantics in heterogeneous graphs are…

Computation and Language · Computer Science 2025-11-25 Wenda Li , Tongya Zheng , Shunyu Liu , Yu Wang , Kaixuan Chen , Hanyang Yuan , Bingde Hu , Zujie Ren , Mingli Song , Gang Chen

Machine learning on graph structured data has attracted much research interest due to its ubiquity in real world data. However, how to efficiently represent graph data in a general way is still an open problem. Traditional methods use…

Machine Learning · Computer Science 2019-11-14 Jiaqi Ma , Qiaozhu Mei

Large language models (LLMs) often struggle with knowledge-intensive tasks due to hallucinations and outdated parametric knowledge. While Retrieval-Augmented Generation (RAG) addresses this by integrating external corpora, its effectiveness…

Computation and Language · Computer Science 2026-02-04 Su Dong , Qinggang Zhang , Yilin Xiao , Shengyuan Chen , Chuang Zhou , Xiao Huang

ChatGPT said: Text-attributed graphs, where nodes and edges contain rich textual information, are widely used across diverse domains. A central challenge in this setting is question answering, which requires jointly leveraging unstructured…

Computation and Language · Computer Science 2025-12-23 Lihui Liu

Supervised learning with tabular data presents unique challenges, including low data sizes, the absence of structural cues, and heterogeneous features spanning both categorical and continuous domains. Unlike vision and language tasks, where…

Machine Learning · Computer Science 2025-12-18 Yunze Leng , Rohan Ghosh , Mehul Motani

When training transformers on graph-structured data, incorporating information about the underlying topology is crucial for good performance. Topological masking, a type of relative position encoding, achieves this by upweighting or…

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

Computation and Language · Computer Science 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks. For structured data, such as knowledge graphs, Graph…

Information Retrieval · Computer Science 2026-03-05 Haoyu Han , Li Ma , Yu Wang , Harry Shomer , Yongjia Lei , Zhisheng Qi , Kai Guo , Zhigang Hua , Bo Long , Hui Liu , Charu C. Aggarwal , Jiliang Tang

Recent years have witnessed rapid advances in graph representation learning, with the continuous embedding approach emerging as the dominant paradigm. However, such methods encounter issues regarding parameter efficiency, interpretability,…

Machine Learning · Computer Science 2026-01-22 Qika Lin , Zhen Peng , Kaize Shi , Kai He , Yiming Xu , Jian Zhang , Erik Cambria , Mengling Feng