English
Related papers

Related papers: Hierarchical Compression of Text-Rich Graphs via L…

200 papers

Enlarging the context window of large language models (LLMs) has become a crucial research area, particularly for applications involving extremely long texts. In this work, we propose a novel training-free framework for processing long…

Computation and Language · Computer Science 2024-10-15 Zihan Zhou , Chong Li , Xinyi Chen , Shuo Wang , Yu Chao , Zhili Li , Haoyu Wang , Rongqiao An , Qi Shi , Zhixing Tan , Xu Han , Xiaodong Shi , Zhiyuan Liu , Maosong Sun

Text classification is a critical research topic with broad applications in natural language processing. Recently, graph neural networks (GNNs) have received increasing attention in the research community and demonstrated their promising…

Computation and Language · Computer Science 2020-11-03 Kaize Ding , Jianling Wang , Jundong Li , Dingcheng Li , Huan Liu

In recent years, the fields of natural language processing (NLP) and information retrieval (IR) have made tremendous progress thanksto deep learning models like Recurrent Neural Networks (RNNs), Gated Recurrent Units (GRUs) and Long…

Computation and Language · Computer Science 2021-06-15 Manish Gupta , Puneet Agrawal

As the market for illicit drugs remains extremely profitable, major online platforms have become direct-to-consumer intermediaries for illicit drug trafficking participants. These online activities raise significant social concerns that…

Machine Learning · Computer Science 2025-03-05 Tianyi Ma , Yiyue Qian , Zehong Wang , Zheyuan Zhang , Chuxu Zhang , Yanfang Ye

Large Language Models (LLMs) have demonstrated substantial efficacy in advancing graph-structured data analysis. Prevailing LLM-based graph methods excel in adapting LLMs to text-rich graphs, wherein node attributes are text descriptions.…

Artificial Intelligence · Computer Science 2025-06-04 Dongzhe Fan , Yi Fang , Jiajin Liu , Djellel Difallah , Qiaoyu Tan

Existing benchmarks like NLGraph and GraphQA evaluate LLMs on graphs by focusing mainly on pairwise relationships, overlooking the high-order correlations found in real-world data. Hypergraphs, which can model complex beyond-pairwise…

Artificial Intelligence · Computer Science 2024-10-17 Yifan Feng , Chengwu Yang , Xingliang Hou , Shaoyi Du , Shihui Ying , Zongze Wu , Yue Gao

Recently, researches have explored the graph neural network (GNN) techniques on text classification, since GNN does well in handling complex structures and preserving global information. However, previous methods based on GNN are mainly…

Computation and Language · Computer Science 2019-10-09 Lianzhe Huang , Dehong Ma , Sujian Li , Xiaodong Zhang , Houfeng WANG

Various human-designed prompt engineering techniques have been proposed to improve problem solvers based on Large Language Models (LLMs), yielding many disparate code bases. We unify these approaches by describing LLM-based agents as…

Artificial Intelligence · Computer Science 2024-08-23 Mingchen Zhuge , Wenyi Wang , Louis Kirsch , Francesco Faccio , Dmitrii Khizbullin , Jürgen Schmidhuber

Recent advances in machine learning, particularly Large Language Models (LLMs) such as BERT and GPT, provide rich contextual embeddings that improve text representation. However, current document clustering approaches often ignore the…

Computation and Language · Computer Science 2024-12-20 Imed Keraghel , Mohamed Nadif

The exponential growth of data generated on the Internet in the current information age is a driving force for the digital economy. Extraction of information is the major value in an accumulated big data. Big data dependency on statistical…

Benchmarking the capabilities and limitations of large language models (LLMs) in graph-related tasks is becoming an increasingly popular and crucial area of research. Recent studies have shown that LLMs exhibit a preliminary ability to…

Machine Learning · Computer Science 2025-04-22 Xinnan Dai , Haohao Qu , Yifen Shen , Bohang Zhang , Qihao Wen , Wenqi Fan , Dongsheng Li , Jiliang Tang , Caihua Shan

Improving the general capabilities of large language models (LLMs) is an active research topic. As a common data structure in many real-world domains, understanding graph data is a crucial part of advancing general intelligence. To this…

Artificial Intelligence · Computer Science 2025-11-19 Zihan Luo , Xiran Song , Hong Huang , Jianxun Lian , Chenhao Zhang , Jinqi Jiang , Xing Xie , Hai Jin

Knowledge graphs (KGs) are vital for knowledge-intensive tasks and have shown promise in reducing hallucinations in large language models (LLMs). However, constructing high-quality KGs remains difficult, requiring accurate information…

Computation and Language · Computer Science 2025-10-14 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Bo Xiong , Fiona Liausvia , Dongkyu Choi , Boon Kiat Quek

Leveraging Graph Neural Networks (GNNs) as graph encoders and aligning the resulting representations with Large Language Models (LLMs) through alignment instruction tuning has become a mainstream paradigm for constructing Graph Language…

Machine Learning · Computer Science 2026-05-13 Haibo Chen , Xin Wang , Jiaheng Chao , Ling Feng , Wenwu Zhu

Following the milestones in large language models (LLMs) and multimodal models, we have seen a surge in applying LLMs to biochemical tasks. Leveraging graph features and molecular text representations, LLMs can tackle various tasks, such as…

Machine Learning · Computer Science 2025-02-14 Chengxin Hu , Hao Li , Yihe Yuan , Jing Li , Ivor Tsang

Long-context capabilities are essential for large language models (LLMs) to tackle complex and long-input tasks. Despite numerous efforts made to optimize LLMs for long contexts, challenges persist in robustly processing long inputs. In…

Computation and Language · Computer Science 2024-11-06 Shilong Li , Yancheng He , Hangyu Guo , Xingyuan Bu , Ge Bai , Jie Liu , Jiaheng Liu , Xingwei Qu , Yangguang Li , Wanli Ouyang , Wenbo Su , Bo Zheng

Model pre-training on large text corpora has been demonstrated effective for various downstream applications in the NLP domain. In the graph mining domain, a similar analogy can be drawn for pre-training graph models on large graphs in the…

Computation and Language · Computer Science 2023-06-06 Han Xie , Da Zheng , Jun Ma , Houyu Zhang , Vassilis N. Ioannidis , Xiang Song , Qing Ping , Sheng Wang , Carl Yang , Yi Xu , Belinda Zeng , Trishul Chilimbi

There has been an increased interest in discovering heuristics for combinatorial problems on graphs through machine learning. While existing techniques have primarily focused on obtaining high-quality solutions, scalability to billion-sized…

Machine Learning · Computer Science 2020-12-04 Sahil Manchanda , Akash Mittal , Anuj Dhawan , Sourav Medya , Sayan Ranu , Ambuj Singh

Machine learning in materials science faces challenges due to limited experimental data, as generating synthesis data is costly and time-consuming, especially with in-house experiments. Mining data from existing literature introduces issues…

Computational Physics · Physics 2025-03-11 Devi Dutta Biswajeet , Sara Kadkhodaei

Hypergraphs are characterized by complex topological structure, representing higher-order interactions among multiple entities through hyperedges. Lately, hypergraph-based deep learning methods to learn informative data representations for…

Machine Learning · Computer Science 2024-09-30 Adrián Bazaga , Pietro Liò , Gos Micklem