English
Related papers

Related papers: Efficient End-to-end Language Model Fine-tuning on…

200 papers

Dynamic Text-Attribute Graphs (DyTAGs), characterized by time-evolving graph interactions and associated text attributes, are prevalent in real-world applications. Existing methods, such as Graph Neural Networks (GNNs) and Large Language…

Computation and Language · Computer Science 2025-09-24 Yunan Wang , Jianxin Li , Ziwei Zhang

Graph-based methods have been demonstrated as one of the most effective approaches for semi-supervised learning, as they can exploit the connectivity patterns between labeled and unlabeled data samples to improve learning performance.…

Machine Learning · Computer Science 2019-07-01 Qimai Li , Xiao-Ming Wu , Han Liu , Xiaotong Zhang , Zhichao Guan

Recent prevailing works on graph machine learning typically follow a similar methodology that involves designing advanced variants of graph neural networks (GNNs) to maintain the superior performance of GNNs on different graphs. In this…

Machine Learning · Computer Science 2024-06-07 Yiran Qiao , Xiang Ao , Yang Liu , Jiarong Xu , Xiaoqian Sun , Qing He

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Computation and Language · Computer Science 2025-09-30 Qinggang Zhang , Shengyuan Chen , Yuanchen Bei , Zheng Yuan , Huachi Zhou , Zijin Hong , Hao Chen , Yilin Xiao , Chuang Zhou , Junnan Dong , Yi Chang , Xiao Huang

Various human-designed prompt engineering techniques have been proposed to improve problem solvers based on Large Language Models (LLMs), yielding many disparate code bases. We unify these approaches by describing LLM-based agents as…

Artificial Intelligence · Computer Science 2024-08-23 Mingchen Zhuge , Wenyi Wang , Louis Kirsch , Francesco Faccio , Dmitrii Khizbullin , Jürgen Schmidhuber

The application of large language models (LLMs) to graph data has attracted a lot of attention recently. LLMs allow us to use deep contextual embeddings from pretrained models in text-attributed graphs, where shallow embeddings are often…

Artificial Intelligence · Computer Science 2025-02-19 Shima Khoshraftar , Niaz Abedini , Amir Hajian

The integration of Large Language Models (LLMs) with Graph Representation Learning (GRL) marks a significant evolution in analyzing complex data structures. This collaboration harnesses the sophisticated linguistic capabilities of LLMs to…

Machine Learning · Computer Science 2024-02-12 Qiheng Mao , Zemin Liu , Chenghao Liu , Zhuo Li , Jianling Sun

Adapter-style efficient transfer learning (ETL) has shown excellent performance in the tuning of vision-language models (VLMs) under the low-data regime, where only a few additional parameters are introduced to excavate the task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Xin Li , Dongze Lian , Zhihe Lu , Jiawang Bai , Zhibo Chen , Xinchao Wang

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

Large Language Models (LLMs) have become a cornerstone in Natural Language Processing (NLP), achieving impressive performance in text generation. Their token-level representations capture rich, human-aligned semantics. However, pooling…

Computation and Language · Computer Science 2025-09-25 Benedikt Roth , Stephan Rappensperger , Tianming Qiu , Hamza Imamović , Julian Wörmann , Hao Shen

Pre-training Graph Foundation Models (GFMs) on text-attributed graphs (TAGs) is central to web-scale applications such as search, recommendation, and knowledge discovery. However, existing CLIP-style graph-text aligners face two key…

Machine Learning · Computer Science 2025-10-23 Yuhang Liu , Minglai Shao , Zengyi Wo , Yunlong Chu , Bing Hao , Shengzhong Liu , Ruijie Wang , Jianxin Li

Graph neural networks (GNNs) have received much attention recently because of their excellent performance on graph-based tasks. However, existing research on GNNs focuses on designing more effective models without considering much about the…

Machine Learning · Computer Science 2021-04-20 Han Yang , Xiao Yan , Xinyan Dai , Yongqiang Chen , James Cheng

Recent advancements in Multimodal Large Language Models (MLLMs) have generated significant interest in their ability to autonomously interact with and interpret Graphical User Interfaces (GUIs). A major challenge in these systems is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hai-Ming Xu , Qi Chen , Lei Wang , Lingqiao Liu

Representation learning on text-attributed graphs (TAGs) has attracted significant interest due to its wide-ranging real-world applications, particularly through Graph Neural Networks (GNNs). Traditional GNN methods focus on encoding the…

Machine Learning · Computer Science 2024-10-07 Xingyu Ji , Jiale Liu , Lu Li , Maojun Wang , Zeyu Zhang

Fine-tuning Large Language Models (LLMs) is now a common approach for text classification in a wide range of applications. When labeled documents are scarce, active learning helps save annotation efforts but requires retraining of massive…

Machine Learning · Computer Science 2024-02-27 Artem Vysogorets , Achintya Gopal

Textual Attribute Graphs (TAGs) are critical for modeling complex networks like citation networks, but effective node classification remains challenging due to difficulties in integrating rich semantics from text with structural graph…

Machine Learning · Computer Science 2025-08-11 Rituparna Datta , Nibir Chandra Mandal

Recently, research on Text-Attributed Graphs (TAGs) has gained significant attention due to the prevalence of free-text node features in real-world applications and the advancements in Large Language Models (LLMs) that bolster TAG…

Machine Learning · Computer Science 2025-02-25 Yun Zhu , Haizhou Shi , Xiaotang Wang , Yongchao Liu , Yaoke Wang , Boci Peng , Chuntao Hong , Siliang Tang

Large language models (LLMs) like ChatGPT, exhibit powerful zero-shot and instruction-following capabilities, have catalyzed a revolutionary transformation across diverse fields, especially for open-ended tasks. While the idea is less…

Artificial Intelligence · Computer Science 2024-02-29 Mengmei Zhang , Mingwei Sun , Peng Wang , Shen Fan , Yanhu Mo , Xiaoxiao Xu , Hong Liu , Cheng Yang , Chuan Shi

Computational social science (CSS) practitioners often rely on human-labeled data to fine-tune supervised text classifiers. We assess the potential for researchers to augment or replace human-generated training data with surrogate training…

Computation and Language · Computer Science 2024-06-26 Nicholas Pangakis , Samuel Wolken

Despite the superior performance of large language models to generate natural language texts, it is hard to generate texts with correct logic according to a given task, due to the difficulties for neural models to capture implied rules from…

Computation and Language · Computer Science 2024-07-08 Fan Zhang , Kebing Jin , Hankz Hankui Zhuo