English
Related papers

Related papers: Scaling GraphLLM with Bilevel-Optimized Sparse Que…

200 papers

Large Language Models (LLMs) struggle with complex Text-to-SQL queries that demand both sophisticated mathematical reasoning and intricate schema navigation. Existing methods often tackle these challenges in isolation, creating a fractured…

Artificial Intelligence · Computer Science 2025-09-25 Xutao Mao , Tao Liu , Hongying Zan

Large Language Models (LLMs) often struggle with inherent knowledge boundaries and hallucinations, limiting their reliability in knowledge-intensive tasks. While Retrieval-Augmented Generation (RAG) mitigates these issues, it frequently…

Artificial Intelligence · Computer Science 2026-02-25 Yuqi Huang , Ning Liao , Kai Yang , Anning Hu , Shengchao Hu , Xiaoxing Wang , Junchi Yan

Integrating textual graphs into Large Language Models (LLMs) is promising for complex graph-based QA. However, a key bottleneck is retrieving informative yet compact subgraphs that fit the LLM context. Existing retrievers often struggle,…

Computation and Language · Computer Science 2026-04-23 Ge Chang , Jinbo Su , Jiacheng Liu , Pengfei Yang , Yuhao Shang , Huiwen Zheng , Hongli Ma , Yan Liang , Yuanchun Li , Yunxin Liu

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal…

Machine Learning · Computer Science 2025-05-12 Ruxue Shi , Hengrui Gu , Xu Shen , Xin Wang

Recent deployments of learned query optimizers use expensive neural networks and ad-hoc search policies. To address these issues, we introduce \textsc{LimeQO}, a framework for offline query optimization leveraging low-rank learning to…

Databases · Computer Science 2025-04-10 Zixuan Yi , Yao Tian , Zachary G. Ives , Ryan Marcus

Graph-based retrieval-augmented generation (RAG) enables large language models (LLMs) to incorporate structured knowledge via graph retrieval as contextual input, enhancing more accurate and context-aware reasoning. We observe that for…

Machine Learning · Computer Science 2025-05-20 Qiuyu Zhu , Liang Zhang , Qianxiong Xu , Cheng Long , Jie Zhang

The latest advancements in large language models (LLMs) have revolutionized the field of natural language processing (NLP). Inspired by the success of LLMs in NLP tasks, some recent work has begun investigating the potential of applying…

Artificial Intelligence · Computer Science 2025-02-25 Shengyin Sun , Yuxiang Ren , Jiehao Chen , Chen Ma

The ubiquity and value of tables as semi-structured data across various domains necessitate advanced methods for understanding their complexity and vast amounts of information. Despite the impressive capabilities of large language models…

Computation and Language · Computer Science 2024-11-14 Deyi Ji , Lanyun Zhu , Siqi Gao , Peng Xu , Hongtao Lu , Jieping Ye , Feng Zhao

Large language models (LLMs) have shown remarkable potential in processing long sequences and complex reasoning tasks, yet efficiently serving these models remains challenging due to the quadratic computational complexity of attention in…

Computation and Language · Computer Science 2025-04-22 Shang Yang , Junxian Guo , Haotian Tang , Qinghao Hu , Guangxuan Xiao , Jiaming Tang , Yujun Lin , Zhijian Liu , Yao Lu , Song Han

Graphs are a powerful tool for representing and analyzing complex relationships in real-world applications such as social networks, recommender systems, and computational finance. Reasoning on graphs is essential for drawing inferences…

Machine Learning · Computer Science 2023-10-10 Bahare Fatemi , Jonathan Halcrow , Bryan Perozzi

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

Traditional post-training quantization (PTQ) is considered an effective approach to reduce model size and accelerate inference of large-scale language models (LLMs). However, existing low-rank PTQ methods require costly fine-tuning to…

Machine Learning · Computer Science 2026-01-12 Hongyaoxing Gul , Lijuan Hu , Shuzi Niu , Fangfang Liu

Retrieval-Augmented Large Language Models (LLMs), which incorporate the non-parametric knowledge from external knowledge bases into LLMs, have emerged as a promising approach to enhancing response accuracy in several tasks, such as…

Computation and Language · Computer Science 2024-03-29 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Large data applications rely on storing data in massive, sparse graphs with millions to trillions of nodes. Graph-based methods, such as node prediction, aim for computational efficiency regardless of graph size. Techniques like localized…

Data Structures and Algorithms · Computer Science 2025-07-08 Yushen Huang , Ertai Luo , Reza Babenezhad , Yifan Sun

Large language models (LLMs) are increasingly used to complete complex tasks by selecting and coordinating external tools across multiple steps. This requires aligning tool choices with subtask intent while satisfying directional execution…

Machine Learning · Computer Science 2026-05-13 Xinyi Gao , Xinyu Ren , Junliang Yu , Tong Chen , Quoc Viet Hung Nguyen , Hongzhi Yin

As large language models (LLMs) continue to scale up, their performance on various downstream tasks has significantly improved. However, evaluating their capabilities has become increasingly expensive, as performing inference on a large…

Computation and Language · Computer Science 2026-02-10 Taolin Zhang , Hang Guo , Wang Lu , Tao Dai , Shu-Tao Xia , Jindong Wang

Charts are widely used to present complex information. Deriving meaningful insights in real-world contexts often requires interpreting multiple related charts together. Research on understanding multi-chart images has not been extensively…

Computation and Language · Computer Science 2026-04-24 Azher Ahmed Efat , Seok Hwan Song , Wallapak Tavanapong

Graph database query languages feature expressive, yet computationally expensive pattern matching capabilities. Answering optional query clauses in SPARQL for instance renders the query evaluation problem immediately Pspace-complete.…

Databases · Computer Science 2018-10-23 Stephan Mennicke , Jan-Christoph Kalo , Denis Nagel , Hermann Kroll , Wolf-Tilo Balke

Structured reasoning over natural language inputs remains a core challenge in artificial intelligence, as it requires bridging the gap between unstructured linguistic expressions and formal logical representations. In this paper, we propose…

Artificial Intelligence · Computer Science 2025-07-14 Keying Yang , Hao Wang , Kai Yang

Bilevel optimization problems arise in many applications where decisions must account for the optimal response of another system, such as in game-theoretic settings. However, these problems are notoriously challenging, as even linear…

Optimization and Control · Mathematics 2026-05-21 Eliabelle Mauduit , Eloïse Berthier , Andrea Simonetto