English
Related papers

Related papers: G2T-LLM: Graph-to-Tree Text Encoding for Molecule …

200 papers

Molecular understanding is central to advancing areas such as scientific discovery, yet Large Language Models (LLMs) struggle to understand molecular graphs effectively. Existing graph-LLM bridges often adapt the Q-Former-style connector…

Machine Learning · Computer Science 2026-03-03 Zihao Jing , Qiuhao Zeng , Ruiyi Fang , Yan Sun , Boyu Wang , Pingzhao Hu

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Large Vision-Language…

Machine Learning · Computer Science 2024-11-05 Jinyoung Park , Minseong Bae , Dohwan Ko , Hyunwoo J. Kim

Transformer neural networks show promising capabilities, in particular for uses in materials analysis, design and manufacturing, including their capacity to work effectively with both human language, symbols, code, and numerical data. Here…

Computation and Language · Computer Science 2023-11-01 Markus J. Buehler

Graph Databases (Graph DB) find extensive application across diverse domains such as finance, social networks, and medicine. Yet, the translation of Natural Language (NL) into the Graph Query Language (GQL), referred to as NL2GQL, poses…

Computation and Language · Computer Science 2024-09-06 Yuanyuan Liang , Keren Tan , Tingyu Xie , Wenbiao Tao , Siyuan Wang , Yunshi Lan , Weining Qian

While large language models (LLMs) have integrated images, adapting them to graphs remains challenging, limiting their applications in materials and drug design. This difficulty stems from the need for coherent autoregressive generation…

Machine Learning · Computer Science 2024-10-08 Gang Liu , Michael Sun , Wojciech Matusik , Meng Jiang , Jie Chen

Knowledge of the medical decision process, which can be modeled as medical decision trees (MDTs), is critical to build clinical decision support systems. However, the current MDT construction methods rely heavily on time-consuming and…

Computation and Language · Computer Science 2024-01-05 Wei Zhu , Wenfeng Li , Xing Tian , Pengfei Wang , Xiaoling Wang , Jin Chen , Yuanbin Wu , Yuan Ni , Guotong Xie

Long-form generation is crucial for a wide range of practical applications, typically categorized into short-to-long and long-to-long generation. While short-to-long generations have received considerable attention, generating long texts…

Computation and Language · Computer Science 2025-04-16 Haoyu Wang , Yujia Fu , Zhu Zhang , Shuo Wang , Zirui Ren , Xiaorong Wang , Zhili Li , Chaoqun He , Bo An , Zhiyuan Liu , Maosong Sun

Large language models (LLMs) have been widely employed for graph-to-text generation tasks. However, the process of finetuning LLMs requires significant training resources and annotation work. In this paper, we explore the capability of…

Computation and Language · Computer Science 2023-07-28 Shuzhou Yuan , Michael Färber

Understanding the function of individual neurons within language models is essential for mechanistic interpretability research. We propose $\textbf{Neuron to Graph (N2G)}$, a tool which takes a neuron and its dataset examples, and…

Machine Learning · Computer Science 2023-04-26 Alex Foote , Neel Nanda , Esben Kran , Ionnis Konstas , Fazl Barez

Analyzing network topologies and communication graphs plays a crucial role in contemporary network management. However, the absence of a cohesive approach leads to a challenging learning curve, heightened errors, and inefficiencies. In this…

Networking and Internet Architecture · Computer Science 2023-08-14 Sathiya Kumaran Mani , Yajie Zhou , Kevin Hsieh , Santiago Segarra , Ranveer Chandra , Srikanth Kandula

Decoding and expressing brain activity in a comprehensible form is a challenging frontier in AI. This paper presents Thought2Text, which uses instruction-tuned Large Language Models (LLMs) fine-tuned with EEG data to achieve this goal. The…

Computation and Language · Computer Science 2025-12-02 Abhijit Mishra , Shreya Shukla , Jose Torres , Jacek Gwizdka , Shounak Roychowdhury

Goal-oriented de novo molecule design, namely generating molecules with specific property or substructure constraints, is a crucial yet challenging task in drug discovery. Existing methods, such as Bayesian optimization and reinforcement…

Computational Engineering, Finance, and Science · Computer Science 2025-02-28 Chuanliu Fan , Ziqiang Cao , Zicheng Ma , Nan Yu , Yimin Peng , Jun Zhang , Yiqin Gao , Guohong Fu

Large language models (LLMs) are widely applied in various natural language processing tasks such as question answering and machine translation. However, due to the lack of labeled data and the difficulty of manual annotation for…

Artificial Intelligence · Computer Science 2026-05-27 Xuan Lin , Long Chen , Yile Wang , Yangyang Chen , Xiangxiang Zeng

Graphs are an essential data structure utilized to represent relationships in real-world scenarios. Prior research has established that Graph Neural Networks (GNNs) deliver impressive outcomes in graph-centric tasks, such as link prediction…

Machine Learning · Computer Science 2024-09-12 Xubin Ren , Jiabin Tang , Dawei Yin , Nitesh Chawla , Chao Huang

How can we best encode structured data into sequential form for use in large language models (LLMs)? In this work, we introduce a parameter-efficient method to explicitly represent structured data for LLMs. Our method, GraphToken, learns an…

Machine Learning · Computer Science 2024-02-09 Bryan Perozzi , Bahare Fatemi , Dustin Zelle , Anton Tsitsulin , Mehran Kazemi , Rami Al-Rfou , Jonathan Halcrow

Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs…

Recently, there has been a surge of interest in extending the success of large language models (LLMs) from texts to molecules. Most existing approaches adopt a graph neural network to represent a molecule as a series of node tokens for…

Computation and Language · Computer Science 2025-06-09 Yongqiang Chen , Quanming Yao , Juzheng Zhang , James Cheng , Yatao Bian

Recent progress in Graph Neural Networks (GNNs) has greatly enhanced the ability to model complex molecular structures for predicting properties. Nevertheless, molecular data encompasses more than just graph structures, including textual…

Machine Learning · Computer Science 2024-06-04 Junjie Xu , Zongyu Wu , Minhua Lin , Xiang Zhang , Suhang Wang

Transforming unstructured text into structured and meaningful forms, organized by useful category labels, is a fundamental step in text mining for downstream analysis and application. However, most existing methods for producing label…

Molecular Relational Learning (MRL) aims to understand interactions between molecular pairs, playing a critical role in advancing biochemical research. With the recent development of large language models (LLMs), a growing number of studies…

Machine Learning · Computer Science 2025-06-03 Zhuo Chen , Yizhen Zheng , Huan Yee Koh , Hongxin Xiang , Linjiang Chen , Wenjie Du , Yang Wang