English
Related papers

Related papers: Taming SQL Complexity: LLM-Based Equivalence Evalu…

200 papers

Text-to-SQL enables users to interact with databases through natural language, simplifying the retrieval and synthesis of information. Despite the success of large language models (LLMs) in converting natural language questions into SQL…

Machine Learning · Computer Science 2025-04-23 Oleg Somov , Elena Tutubalina

Large Language Models (LLMs) are increasingly deployed in both academic and industry settings to automate the evaluation of information seeking systems, particularly by generating graded relevance judgments. Previous work on LLM-based…

Information Retrieval · Computer Science 2025-04-18 Negar Arabzadeh , Charles L. A. Clarke

Though large language models (LLMs) have demonstrated exceptional performance across numerous problems, their application to predictive tasks in relational databases remains largely unexplored. In this work, we address the notion that LLMs…

Machine Learning · Computer Science 2024-11-19 Marek Wydmuch , Łukasz Borchmann , Filip Graliński

Large Language Models (LLMs) have demonstrated impressive capabilities across a range of natural language processing tasks. In particular, improvements in reasoning abilities and the expansion of context windows have opened new avenues for…

Databases · Computer Science 2025-06-12 Yeounoh Chung , Gaurav T. Kakkar , Yu Gan , Brenton Milne , Fatma Ozcan

Retrieving operational data from nuclear power plants requires exceptional accuracy and transparency due to the criticality of the decisions it supports. Traditionally, natural language to SQL (NL-to-SQL) approaches have been explored for…

Computation and Language · Computer Science 2025-06-11 Mishca de Costa , Muhammad Anwar , Dave Mercier , Mark Randall , Issam Hammad

Large Language Models (LLMs) have shown promise in enabling natural language interfaces for structured data querying through text-to-SQL generation. However, their application in real-world Business Intelligence (BI) contexts remains…

Computation and Language · Computer Science 2025-05-02 Jeho Choi

Large Language Models (LLMs) can automate or substitute different types of tasks in the software engineering process. This study evaluates the resource utilization and accuracy of LLM in interpreting and executing natural language queries…

Databases · Computer Science 2024-04-16 Xiang Zhang , Khatoon Khedri , Reza Rawassizadeh

Large Language Models (LLMs) have fundamentally transformed approaches to Natural Language Processing (NLP) tasks across diverse domains. In healthcare, accurate and cost-efficient text classification is crucial, whether for clinical notes…

Computation and Language · Computer Science 2026-02-16 Hajar Sakai , Sarah S. Lam

Relational databases excel at structured data analysis, but real-world queries increasingly require capabilities beyond standard SQL, such as semantically matching entities across inconsistent names, extracting information not explicitly…

Databases · Computer Science 2026-05-15 Yin Lin , Tianjing Zeng , Zhongjun Ding , Rong Zhu , Bolin Ding , H. V. Jagadish , Jingren Zhou

Large Language Models (LLMs) have emerged as powerful tools for Text-to-SQL tasks, exhibiting remarkable reasoning capabilities. Different from tasks such as math word problems and commonsense reasoning, SQL solutions have a relatively…

Computation and Language · Computer Science 2024-09-24 Ruilin Luo , Liyuan Wang , Binghuai Lin , Zicheng Lin , Yujiu Yang

The process mining community has recently recognized the potential of large language models (LLMs) for tackling various process mining tasks. Initial studies report the capability of LLMs to support process analysis and even, to some…

Computation and Language · Computer Science 2024-07-03 Adrian Rebmann , Fabian David Schmidt , Goran Glavaš , Han van der Aa

The widespread adoption of large language models (LLMs) necessitates reliable methods to detect LLM-generated text. We introduce SimMark, a robust sentence-level watermarking algorithm that makes LLMs' outputs traceable without requiring…

Computation and Language · Computer Science 2025-09-12 Amirhossein Dabiriaghdam , Lele Wang

Large language models (LLMs) are gaining increasing popularity in both academia and industry, owing to their unprecedented performance in various applications. As LLMs continue to play a vital role in both research and daily use, their…

Computation and Language · Computer Science 2024-01-01 Yupeng Chang , Xu Wang , Jindong Wang , Yuan Wu , Linyi Yang , Kaijie Zhu , Hao Chen , Xiaoyuan Yi , Cunxiang Wang , Yidong Wang , Wei Ye , Yue Zhang , Yi Chang , Philip S. Yu , Qiang Yang , Xing Xie

Generating accurate SQL queries for user questions (text-to-SQL) has been a long-standing challenge since it requires a deep understanding of both the user's question and the corresponding database schema in order to retrieve the desired…

Computation and Language · Computer Science 2024-06-07 Zijin Hong , Zheng Yuan , Hao Chen , Qinggang Zhang , Feiran Huang , Xiao Huang

Translating natural language questions into SQL queries, known as text-to-SQL, is a long-standing research problem. Effective text-to-SQL synthesis can become very challenging due to (i) the extensive size of database catalogs (descriptions…

Machine Learning · Computer Science 2024-11-27 Shayan Talaei , Mohammadreza Pourreza , Yu-Chen Chang , Azalia Mirhoseini , Amin Saberi

The application of Large Language Models (LLMs) to text-to-SQL tasks promises to democratize data access, particularly in critical industries like aviation Maintenance, Repair, and Operation (MRO). However, progress is hindered by two key…

Databases · Computer Science 2025-06-18 Patrick Sutanto , Jonathan Kenrick , Max Lorenz , Joan Santoso

This study presents a comparative analysis of the a complex SQL benchmark, TPC-DS, with two existing text-to-SQL benchmarks, BIRD and Spider. Our findings reveal that TPC-DS queries exhibit a significantly higher level of structural…

Databases · Computer Science 2024-07-30 Limin Ma , Ken Pu , Ying Zhu

Understanding the similarity of the numerous released large language models (LLMs) has many uses, e.g., simplifying model selection, detecting illegal model reuse, and advancing our understanding of what makes LLMs perform well. In this…

Machine Learning · Computer Science 2023-12-06 Max Klabunde , Mehdi Ben Amor , Michael Granitzer , Florian Lemmerich

Text-to-SQL is a fundamental yet challenging task in the NLP area, aiming at translating natural language questions into SQL queries. While recent advances in large language models have greatly improved performance, most existing approaches…

Databases · Computer Science 2025-12-01 Shuozhi Yuan , Limin Chen , Miaomiao Yuan , Zhao Jin