English
Related papers

Related papers: Agentic LLMs for Question Answering over Tabular D…

200 papers

We investigate how large language models (LLMs) fail when tabular data in an otherwise canonical representation is subjected to semantic and structural distortions. Our findings reveal that LLMs lack an inherent ability to detect and…

Artificial Intelligence · Computer Science 2026-01-09 Avik Dutta , Harshit Nigam , Hosein Hasanbeig , Arjun Radhakrishna , Sumit Gulwani

Large language models (LLMs) are increasingly powering Text-to-SQL (Text2SQL) systems, enabling non-expert users to query industrial databases using natural language. While test-time scaling strategies have shown promise in LLM-based…

Computation and Language · Computer Science 2025-10-14 Jiajing Guo , Kenil Patel , Jorge Piazentin Ono , Wenbin He , Liu Ren

Lab results are often confusing and hard to understand. Large language models (LLMs) such as ChatGPT have opened a promising avenue for patients to get their questions answered. We aim to assess the feasibility of using LLMs to generate…

Computation and Language · Computer Science 2024-04-23 Zhe He , Balu Bhasuran , Qiao Jin , Shubo Tian , Karim Hanna , Cindy Shavor , Lisbeth Garcia Arguello , Patrick Murray , Zhiyong Lu

Database queries traditionally operate under the closed-world assumption, providing no answers to questions that require information beyond the data stored in the database. Hybrid querying using SQL offers an alternative by integrating…

Databases · Computer Science 2024-11-19 Fuheng Zhao , Divyakant Agrawal , Amr El Abbadi

The complexities of table structures and question logic make table-based question answering (TQA) tasks challenging for Large Language Models (LLMs), often requiring task simplification before solving. This paper reveals that the reasoning…

Computation and Language · Computer Science 2025-04-22 Ruya Jiang , Chun Wang , Weihong Deng

Large Language Model (LLM)-based agents have shown effectiveness across many applications. However, their use in data science scenarios requiring solving long-term interconnected tasks, dynamic data adjustments and domain expertise remains…

Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA…

Computation and Language · Computer Science 2025-09-23 Chuangtao Ma , Yongrui Chen , Tianxing Wu , Arijit Khan , Haofen Wang

Tables stored in databases and tables which are present in web pages and articles account for a large part of semi-structured data that is available on the internet. It then becomes pertinent to develop a modeling approach with large…

Computation and Language · Computer Science 2023-10-03 Soumajyoti Sarkar , Leonard Lausen

Large Language Models (LLMs) have shown promise in enabling natural language interfaces for structured data querying through text-to-SQL generation. However, their application in real-world Business Intelligence (BI) contexts remains…

Computation and Language · Computer Science 2025-05-02 Jeho Choi

Large Language Models (LLMs) have been achieving competent performance on a wide range of downstream tasks, yet existing work shows that inference on structured data is challenging for LLMs. This is because LLMs need to either understand…

Computation and Language · Computer Science 2024-07-04 Younghun Lee , Sungchul Kim , Ryan A. Rossi , Tong Yu , Xiang Chen

Natural-language-to-SQL (NL-to-SQL) systems hold promise for democratizing access to structured data, allowing users to query databases without learning SQL. Yet existing systems struggle with realistic spatio-temporal queries, where…

Artificial Intelligence · Computer Science 2025-10-31 Manu Redd , Tao Zhe , Dongjie Wang

Tables are fundamental in domains such as finance, healthcare, and public administration, yet real-world table tasks often involve noise, structural heterogeneity, and semantic complexity--issues underexplored in existing research that…

Artificial Intelligence · Computer Science 2025-07-15 Jiaming Tian , Liyao Li , Wentao Ye , Haobo Wang , Lingxin Wang , Lihua Yu , Zujie Ren , Gang Chen , Junbo Zhao

Artificial intelligence (AI) is widely deployed to solve problems related to marketing attribution and budget optimization. However, AI models can be quite complex, and it can be difficult to understand model workings and insights without…

Computation and Language · Computer Science 2024-04-23 Yilin Gao , Sai Kumar Arava , Yancheng Li , James W. Snyder

Large Language Models (LLMs) with agentic web search capabilities show strong potential for tasks requiring real-time information access and complex fact retrieval, yet evaluating such systems remains challenging. We introduce \bench, a…

Information Retrieval · Computer Science 2026-02-17 Yunfan Zhang , Kathleen McKeown , Smaranda Muresan

Humans continuously make new discoveries, and understanding temporal sequence of events leading to these breakthroughs is essential for advancing science and society. This ability to reason over time allows us to identify future steps and…

Computation and Language · Computer Science 2025-04-03 Abhilash Shankarampeta , Harsh Mahajan , Tushar Kataria , Dan Roth , Vivek Gupta

Knowledge Base Question Answering (KBQA) aims to answer natural language questions based on facts in knowledge bases. A typical approach to KBQA is semantic parsing, which translates a question into an executable logical form in a formal…

Computation and Language · Computer Science 2024-06-17 Jinxin Liu , Shulin Cao , Jiaxin Shi , Tingjian Zhang , Lunyiu Nie , Linmei Hu , Lei Hou , Juanzi Li

With the future striving toward data-centric decision-making, seamless access to databases is of utmost importance. There is extensive research on creating an efficient text-to-sql (TEXT2SQL) model to access data from the database. Using a…

Computation and Language · Computer Science 2022-08-10 Ayush Kumar , Parth Nagarkar , Prabhav Nalhe , Sanjeev Vijayakumar

Query optimization, which finds the optimized execution plan for a given query, is a complex planning and decision-making problem within the exponentially growing plan space in database management systems (DBMS). Traditional optimizers…

Databases · Computer Science 2025-02-11 Jie Tan , Kangfei Zhao , Rui Li , Jeffrey Xu Yu , Chengzhi Piao , Hong Cheng , Helen Meng , Deli Zhao , Yu Rong

Text-to-SQL, which translates a natural language question into an SQL query, has advanced with in-context learning of Large Language Models (LLMs). However, existing methods show little improvement in performance compared to randomly chosen…

Artificial Intelligence · Computer Science 2025-07-23 Jihyung Lee , Jin-Seop Lee , Jaehoon Lee , YunSeok Choi , Jee-Hyong Lee

Machine learning for tabular data remains constrained by poor schema generalization, a challenge rooted in the lack of semantic understanding of structured variables. This challenge is particularly acute in domains like clinical medicine,…

Machine Learning · Computer Science 2026-05-05 Hongxi Mao , Wei Zhou , Mengting Jia , Tao Fang , Huan Gao , Bin Zhang , Shangyang Li