English
Related papers

Related papers: An Efficient and Effective Evaluator for Text2SQL …

200 papers

Community-driven Text-to-SQL evaluation platforms play a pivotal role in tracking the state of the art of Text-to-SQL performance. The reliability of the evaluation process is critical for driving progress in the field. Current evaluation…

Databases · Computer Science 2026-03-05 Rocky Klopfenstein , Yang He , Andrew Tremante , Yuepeng Wang , Nina Narodytska , Haoze Wu

Text-to-SQL systems translate natural language (NL) questions into SQL queries, enabling non-technical users to interact with structured data. While large language models (LLMs) have shown promising results on the text-to-SQL task, they…

Computation and Language · Computer Science 2025-06-06 Yue Gong , Chuan Lei , Xiao Qin , Kapil Vaidya , Balakrishnan Narayanaswamy , Tim Kraska

Open-set active learning (OSAL) aims to identify informative samples for annotation when unlabeled data may contain previously unseen classes-a common challenge in safety-critical and open-world scenarios. Existing approaches typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Chen-Chen Zong , Yu-Qi Chi , Xie-Yang Wang , Yan Cui , Sheng-Jun Huang

Verification of model outputs is rapidly emerging as a key primitive for both training and real-world deployment of large language models (LLMs). In practice, this often involves using imperfect LLM judges and reward models since ground…

Machine Learning · Statistics 2026-04-21 Joonhyuk Lee , Virginia Ma , Sarah Zhao , Yash Nair , Asher Spector , Regev Cohen , Emmanuel J. Candès

Automating the decision of whether a code change requires manual review is vital for maintaining software quality in modern development workflows. However, the emergence of new programming languages and frameworks creates a critical…

Software Engineering · Computer Science 2025-09-08 Yogev Cohen , Dudi Ohayon , Romy Somkin , Yehudit Aperstein , Alexander Apartsin

Text-to-SQL systems facilitate smooth interaction with databases by translating natural language queries into Structured Query Language (SQL), bridging the gap between non-technical users and complex database management systems. This survey…

Artificial Intelligence · Computer Science 2025-01-24 Aditi Singh , Akash Shetty , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei

People without a database background usually rely on file systems or tools such as Excel for data management, which often lead to redundancy and data inconsistency. Relational databases possess strong data management capabilities, but…

Causal inference, a critical tool for informing business decisions, traditionally relies heavily on structured data. However, in many real-world scenarios, such data can be incomplete or unavailable. This paper presents a framework that…

Machine Learning · Computer Science 2026-02-17 Boning Zhou , Ziyu Wang , Han Hong , Haoqi Hu

Federated Learning (FL) is a distributed machine learning framework that trains accurate global models while preserving clients' privacy-sensitive data. However, most FL approaches assume that clients possess labeled data, which is often…

Machine Learning · Computer Science 2024-11-01 Seungjoo Lee , Thanh-Long V. Le , Jaemin Shin , Sung-Ju Lee

Text-to-SQL systems empower users to interact with databases using natural language, automatically translating queries into executable SQL code. However, their reliance on database schema information for SQL generation exposes them to…

Computation and Language · Computer Science 2025-06-04 Đorđe Klisura , Anthony Rios

Mechanistic interpretability research faces a gap between analyzing simple circuits in toy tasks and discovering features in large models. To bridge this gap, we propose text-to-SQL generation as an ideal task to study, as it combines the…

Machine Learning · Computer Science 2025-10-23 Abir Harrasse , Philip Quirke , Clement Neo , Dhruv Nathawani , Luke Marks , Amir Abdullah

In real-world applications, as data availability increases, obtaining labeled data for machine learning (ML) projects remains challenging due to the high costs and intensive efforts required for data annotation. Many ML projects,…

Machine Learning · Computer Science 2024-12-24 Ismail Hakki Karaman , Gulser Koksal , Levent Eriskin , Salih Salihoglu

Recent instruction-finetuned large language models (LMs) have achieved notable performances in various tasks, such as question-answering (QA). However, despite their ability to memorize a vast amount of general knowledge across diverse…

Computation and Language · Computer Science 2023-10-23 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Text-to-SQL enables users to interact with databases through natural language, simplifying the retrieval and synthesis of information. Despite the success of large language models (LLMs) in converting natural language questions into SQL…

Machine Learning · Computer Science 2025-04-23 Oleg Somov , Elena Tutubalina

Text-to-SQL systems (also known as NL-to-SQL systems) have become an increasingly popular solution for bridging the gap between user capabilities and SQL-based data access. These systems translate user requests in natural language to valid…

Databases · Computer Science 2024-12-02 Jonathan Fürst , Catherine Kosten , Farhad Nooralahzadeh , Yi Zhang , Kurt Stockinger

Despite remarkable progress in text-to-SQL semantic parsing in recent years, the performance of existing parsers is still far from perfect. Specifically, modern text-to-SQL parsers based on deep learning are often over-confident, thus…

Computation and Language · Computer Science 2023-12-07 Shijie Chen , Ziru Chen , Huan Sun , Yu Su

Text-to-SQL generation enables non-experts to interact with databases via natural language. Recent advances rely on large closed-source models like GPT-4 that present challenges in accessibility, privacy, and latency. To address these…

Computation and Language · Computer Science 2025-02-18 Satya Krishna Gorti , Ilan Gofman , Zhaoyan Liu , Jiapeng Wu , Noël Vouitsis , Guangwei Yu , Jesse C. Cresswell , Rasa Hosseinzadeh

The amount of labeled data to train models for speech tasks is limited for most languages, however, the data scarcity is exacerbated for speech translation which requires labeled data covering two different languages. To address this issue,…

Computation and Language · Computer Science 2022-10-20 Changhan Wang , Hirofumi Inaguma , Peng-Jen Chen , Ilia Kulikov , Yun Tang , Wei-Ning Hsu , Michael Auli , Juan Pino

Combining multiple predictors obtained from distributed data sources to an accurate meta-learner is promising to achieve enhanced performance in lots of prediction problems. As the accuracy of each predictor is usually unknown, integrating…

Machine Learning · Statistics 2024-08-16 Shiva Afshar , Yinghan Chen , Shizhong Han , Ying Lin

Semi-supervised learning holds great promise for many real-world applications, due to its ability to leverage both unlabeled and expensive labeled data. However, most semi-supervised learning algorithms still heavily rely on the limited…

Machine Learning · Computer Science 2023-12-29 Huiling Qin , Xianyuan Zhan , Yuanxun Li , Yu Zheng