English
Related papers

Related papers: Scaling GraphLLM with Bilevel-Optimized Sparse Que…

200 papers

Current tabling systems suffer from an increase in space complexity, time complexity or both when dealing with sequences due to the use of data structures for tabled subgoals and answers and the need to copy terms into and from the table…

Programming Languages · Computer Science 2012-10-08 Neng-Fa Zhou , Christian Theil Have

Large Language Models (LLMs) have demonstrated impressive performance on a range of Natural Language Processing (NLP) tasks. Unfortunately, the immense amount of computations and memory accesses required for LLM training makes them…

Machine Learning · Computer Science 2023-03-10 Guo Yang , Daniel Lo , Robert Mullins , Yiren Zhao

Large Language Models (LLMs) reasoning processes are challenging to analyze due to their complexity and the lack of organized visualization tools. We present ReasonGraph, a web-based platform for visualizing and analyzing LLM reasoning…

Computation and Language · Computer Science 2025-03-07 Zongqian Li , Ehsan Shareghi , Nigel Collier

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Artificial Intelligence · Computer Science 2025-10-01 Yingqian Cui , Zhenwei Dai , Pengfei He , Bing He , Hui Liu , Xianfeng Tang , Jingying Zeng , Suhang Wang , Yue Xing , Jiliang Tang , Benoit Dumoulin

Temporal tabular question answering presents a significant challenge for Large Language Models (LLMs), requiring robust reasoning over structured data, which is a task where traditional prompting methods often fall short. These methods face…

Computation and Language · Computer Science 2025-06-09 Atharv Kulkarni , Kushagra Dixit , Vivek Srikumar , Dan Roth , Vivek Gupta

Graph comparison is a fundamental operation in data mining and information retrieval. Due to the combinatorial nature of graphs, it is hard to balance the expressiveness of the similarity measure and its scalability. Spectral analysis…

Social and Information Networks · Computer Science 2020-03-04 Anton Tsitsulin , Marina Munkhoeva , Bryan Perozzi

Graph problems are fundamentally challenging for large language models (LLMs). While LLMs excel at processing unstructured text, graph tasks require reasoning over explicit structure, permutation invariance, and computationally complex…

Machine Learning · Computer Science 2026-04-23 Angelo Zangari , Peyman Baghershahi , Sourav Medya

Large Language Models (LLMs) demonstrate strong reasoning abilities but face limitations such as hallucinations and outdated knowledge. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) addresses these issues by grounding LLM…

Computation and Language · Computer Science 2025-03-04 Mufei Li , Siqi Miao , Pan Li

Designing and implementing efficient, provably correct parallel machine learning (ML) algorithms is challenging. Existing high-level parallel abstractions like MapReduce are insufficiently expressive while low-level tools like MPI and…

Machine Learning · Computer Science 2010-06-28 Yucheng Low , Joseph Gonzalez , Aapo Kyrola , Danny Bickson , Carlos Guestrin , Joseph M. Hellerstein

Most modern Text2SQL systems prompt large language models (LLMs) with entire schemas -- mostly column information -- alongside the user's question. While effective on small databases, this approach fails on real-world schemas that exceed…

Databases · Computer Science 2025-12-19 Thanh Dat Hoang , Thanh Tam Nguyen , Thanh Trung Huynh , Hongzhi Yin , Quoc Viet Hung Nguyen

Neural networks have recently been proposed for multi-label classification because they are able to capture and model label dependencies in the output layer. In this work, we investigate limitations of BP-MLL, a neural network (NN)…

Machine Learning · Computer Science 2020-12-09 Jinseok Nam , Jungi Kim , Eneldo Loza Mencía , Iryna Gurevych , Johannes Fürnkranz

Table understanding is key to addressing challenging downstream tasks such as table-based question answering and fact verification. Recent works have focused on leveraging Chain-of-Thought and question decomposition to solve complex…

Computation and Language · Computer Science 2025-08-26 Thi-Nhung Nguyen , Hoang Ngo , Dinh Phung , Thuy-Trang Vu , Dat Quoc Nguyen

To migrate the remarkable successes of Large Language Models (LLMs), the community has made numerous efforts to generalize them to the table reasoning tasks for the widely deployed tabular data. Despite that, in this work, by showing a…

Computation and Language · Computer Science 2026-01-08 Liyao Li , Chao Ye , Wentao Ye , Yifei Sun , Zhe Jiang , Haobo Wang , Jiaming Tian , Yiming Zhang , Ningtao Wang , Xing Fu , Gang Chen , Junbo Zhao

Virtualization-based obfuscation produces extremely large and structurally complex binaries, posing challenges for LLM-based analysis due to input size limits and the need for large-scale labeled data. We address this by focusing on…

Cryptography and Security · Computer Science 2026-05-12 Sangjun An , Hyeyeon Park , Yejin Son , Seoksu Lee , Eun-Sun Cho

We introduce the lookahead-bounded Q-learning (LBQL) algorithm, a new, provably convergent variant of Q-learning that seeks to improve the performance of standard Q-learning in stochastic environments through the use of ``lookahead'' upper…

Machine Learning · Computer Science 2020-06-30 Ibrahim El Shar , Daniel R. Jiang

Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and, as a result, falls short in handling networked documents which are very popular in many applications such as citation graphs, social media, and…

Machine Learning · Computer Science 2025-07-15 Yuntong Hu , Zhihan Lei , Zheng Zhang , Bo Pan , Chen Ling , Liang Zhao

Current neural architecture search (NAS) strategies focus only on finding a single, good, architecture. They offer little insight into why a specific network is performing well, or how we should modify the architecture if we want further…

Machine Learning · Computer Science 2021-02-22 Binxin Ru , Xingchen Wan , Xiaowen Dong , Michael Osborne

LLMs have shown impressive progress in natural language processing. However, they still face significant challenges in TableQA, where real-world complexities such as diverse table structures, multilingual data, and domain-specific reasoning…

Computation and Language · Computer Science 2025-09-23 Junnan Zhu , Jingyi Wang , Bohan Yu , Xiaoyu Wu , Junbo Li , Lei Wang , Nan Xu

Designing and implementing efficient, provably correct parallel machine learning (ML) algorithms is challenging. Existing high-level parallel abstractions like MapReduce are insufficiently expressive while low-level tools like MPI and…

Machine Learning · Computer Science 2014-08-12 Yucheng Low , Joseph E. Gonzalez , Aapo Kyrola , Danny Bickson , Carlos E. Guestrin , Joseph Hellerstein

Large Language Models (LLMs) can translate natural language into SQL, but small models struggle with multi-table and complex queries in Zero-Shot Learning (ZSL) settings. While Supervised Fine-Tuning (SFT) helps, it falls short for harder…

Machine Learning · Computer Science 2026-05-05 Simone Papicchio , Simone Rossi , Luca Cagliero , Paolo Papotti