English
Related papers

Related papers: PromptMind Team at EHRSQL-2024: Improving Reliabil…

200 papers

The rise of Large Language Models (LLMs) has significantly advanced Text-to-SQL (NL2SQL) systems, yet evaluating the semantic equivalence of generated SQL remains a challenge, especially given ambiguous user queries and multiple valid SQL…

Computation and Language · Computer Science 2025-06-12 Qingyun Zeng , Simin Ma , Arash Niknafs , Ashish Basran , Carol Szabo

Fine-tuning large language models (LLMs) for specific domain tasks has achieved great success in Text-to-SQL tasks. However, these fine-tuned models often face challenges with multi-turn Text-to-SQL tasks caused by ambiguous or unanswerable…

Artificial Intelligence · Computer Science 2024-11-12 Yinggang Sun , Ziming Guo , Haining Yu , Chuanyi Liu , Xiang Li , Bingxuan Wang , Xiangzhan Yu , Tiancheng Zhao

With Large Language Models' (LLMs) emergent abilities on code generation tasks, Text-to-SQL has become one of the most popular downstream applications. Despite the strong results of multiple recent LLM-based Text-to-SQL frameworks, the…

Machine Learning · Computer Science 2025-09-09 Dazhi Peng

Abstract. Automatically generating scientific literature surveys is a valuable task that can significantly enhance research efficiency. However, the diverse and complex nature of information within a literature survey poses substantial…

Computation and Language · Computer Science 2024-08-16 Yuxuan Lai , Yupeng Wu , Yidan Wang , Wenpeng Hu , Chen Zheng

Text-to-SQL translates natural language questions into SQL statements grounded in a target database schema. Ensuring the reliability and executability of such systems requires validating generated SQL, but most existing approaches focus…

Machine Learning · Computer Science 2025-12-30 Rihong Qiu , Zhibang Yang , Xinke Jiang , Weibin Liao , Xin Gao , Xu Chu , Junfeng Zhao , Yasha Wang

The rapid adoption of Electronic Health Records (EHRs) has been instrumental in streamlining administrative tasks, increasing transparency, and enabling continuity of care across providers. An unintended consequence of the increased…

Computation and Language · Computer Science 2024-04-02 Griffin Adams

Existing LLM-based medical question-answering systems lack citation generation and evaluation capabilities, raising concerns about their adoption in practice. In this work, we introduce \name, the first end-to-end framework that facilitates…

Computation and Language · Computer Science 2025-06-10 Xiao Wang , Mengjue Tan , Qiao Jin , Guangzhi Xiong , Yu Hu , Aidong Zhang , Zhiyong Lu , Minjia Zhang

Large Language Models (LLMs) encode meanings of words in the form of distributed semantics. Distributed semantics capture common statistical patterns among language tokens (words, phrases, and sentences) from large amounts of data. LLMs…

Computation and Language · Computer Science 2023-06-27 Yuxin Zi , Kaushik Roy , Vignesh Narayanan , Manas Gaur , Amit Sheth

Querying the knowledge base (KB) has long been a challenge in the end-to-end task-oriented dialogue system. Previous sequence-to-sequence (Seq2Seq) dialogue generation work treats the KB query as an attention over the entire KB, without the…

Computation and Language · Computer Science 2019-09-19 Libo Qin , Yijia Liu , Wanxiang Che , Haoyang Wen , Yangming Li , Ting Liu

Natural Language to SQL (NL2SQL) has seen significant advancements with large language models (LLMs). However, these models often depend on closed-source systems and high computational resources, posing challenges in data privacy and…

Computation and Language · Computer Science 2025-08-19 Wenqi Pei , Hailing Xu , Hengyuan Zhao , Shizheng Hou , Han Chen , Zining Zhang , Pingyi Luo , Bingsheng He

Text-to-SQL is a fundamental yet challenging task in the NLP area, aiming at translating natural language questions into SQL queries. While recent advances in large language models have greatly improved performance, most existing approaches…

Databases · Computer Science 2025-12-01 Shuozhi Yuan , Limin Chen , Miaomiao Yuan , Zhao Jin

Large language models (LLMs) have demonstrated remarkable in-context learning capabilities across diverse applications. In this work, we explore the effectiveness of LLMs for generating realistic synthetic tabular data, identifying key…

Machine Learning · Computer Science 2025-01-15 Jinhee Kim , Taesung Kim , Jaegul Choo

Text-to-SQL converts natural language questions into executable SQL queries, enabling non-technical users to access relational databases for analytics and intelligent data services. In real-world scenarios, performance is often constrained…

Computation and Language · Computer Science 2026-05-25 Tianhao Qiu , Xiaojun Chen

Recent advances in large language models (LLMs) have propelled research in natural language interfaces to databases. However, most state-of-the-art text-to-SQL systems still depend on complex, multi-stage pipelines. This work proposes a…

Artificial Intelligence · Computer Science 2025-06-03 Fernando Granado , Roberto Lotufo , Jayr Pereira

Generating step-by-step "chain-of-thought" rationales has proven effective for improving the performance of large language models on complex reasoning tasks. However, applying such techniques to structured tasks, such as text-to-SQL,…

Computation and Language · Computer Science 2025-02-20 Mingqian He , Yongliang Shen , Wenqi Zhang , Qiuying Peng , Jun Wang , Weiming Lu

We describe our system for SemEval-2026 Task 5, which requires rating the plausibility of given word senses of homonyms in short stories on a 5-point Likert scale. Systems are evaluated by the unweighted average of accuracy (within one…

Computation and Language · Computer Science 2026-03-18 Azwad Anjum Islam , Tisa Islam Erana

In-context learning with large language models (LLMs) has recently caught increasing attention due to its superior few-shot performance on various tasks. However, its performance on text-to-SQL parsing still has much room for improvement.…

Computation and Language · Computer Science 2023-10-30 Chang-You Tai , Ziru Chen , Tianshu Zhang , Xiang Deng , Huan Sun

Text2SQL, the task of generating SQL queries from natural language text, is a critical challenge in data engineering. Recently, Large Language Models (LLMs) have demonstrated superior performance for this task due to their advanced…

Ensembling Large Language Models (LLMs) has gained attention as a promising approach to surpass the performance of individual models by leveraging their complementary strengths. In particular, aggregating models' next-token probability…

Computation and Language · Computer Science 2026-03-16 Heecheol Yun , Kwangmin Ki , Junghyun Lee , Eunho Yang

In this paper, we present our approach for the CLEF 2025 SimpleText Task 1, which addresses both sentence-level and document-level scientific text simplification. For sentence-level simplification, our methodology employs large language…

Computation and Language · Computer Science 2025-08-19 Krishna Chaitanya Marturi , Heba H. Elwazzan