English
Related papers

Related papers: Semantic Evaluation for Text-to-SQL with Distilled…

200 papers

Text-to-SQL, the process of translating natural language into Structured Query Language (SQL), represents a transformative application of large language models (LLMs), potentially revolutionizing how humans interact with data. This paper…

Most available semantic parsing datasets, comprising of pairs of natural utterances and logical forms, were collected solely for the purpose of training and evaluation of natural language understanding systems. As a result, they do not…

Computation and Language · Computer Science 2021-06-10 Moshe Hazoom , Vibhor Malik , Ben Bogin

This paper explores targeted distillation methods for sentiment analysis, aiming to build compact and practical models that preserve strong and generalizable sentiment analysis capabilities. To this end, we conceptually decouple the…

Computation and Language · Computer Science 2025-11-04 Yice Zhang , Guangyu Xie , Jingjie Lin , Jianzhu Bao , Qianlong Wang , Xi Zeng , Ruifeng Xu

Research on parsing language to SQL has largely ignored the structure of the database (DB) schema, either because the DB was very simple, or because it was observed at both training and test time. In Spider, a recently-released text-to-SQL…

Computation and Language · Computer Science 2019-06-04 Ben Bogin , Matt Gardner , Jonathan Berant

To leverage the advantages of LLM in addressing challenges in the Text-to-SQL task, we present XiYan-SQL, an innovative framework effectively generating and utilizing multiple SQL candidates. It consists of three components: 1) a Schema…

Computation and Language · Computer Science 2026-04-07 Yifu Liu , Yin Zhu , Yingqi Gao , Zhiling Luo , Xiaoxia Li , Xiaorong Shi , Yuntao Hong , Jinyang Gao , Yu Li , Bolin Ding , Jingren Zhou

This paper aims to improve the performance of text-to-SQL parsing by exploring the intrinsic uncertainties in the neural network based approaches (called SUN). From the data uncertainty perspective, it is indisputable that a single SQL can…

Computation and Language · Computer Science 2022-10-31 Bowen Qin , Lihan Wang , Binyuan Hui , Bowen Li , Xiangpeng Wei , Binhua Li , Fei Huang , Luo Si , Min Yang , Yongbin Li

While Text-to-SQL remains the dominant approach for database interaction, real-world analytics increasingly require the flexibility of general-purpose programming languages such as Python or Pandas to manage file-based data and complex…

Artificial Intelligence · Computer Science 2026-01-26 Hangle Hu , Chenyu Hou , Bin Cao , Ruizhe Li

Recent state-of-the-art natural language understanding models, such as BERT and XLNet, score a pair of sentences (A and B) using multiple cross-attention operations - a process in which each word in sentence A attends to all words in…

Machine Learning · Computer Science 2019-11-22 Oren Barkan , Noam Razin , Itzik Malkiel , Ori Katz , Avi Caciularu , Noam Koenigstein

Instruction-tuned Large Language Models (LLMs) have recently showcased remarkable advancements in their ability to generate fitting responses to natural language instructions. However, many current works rely on manual evaluation to judge…

Computation and Language · Computer Science 2024-02-06 Ansar Aynetdinov , Alan Akbik

We introduce SQLSpace, a human-interpretable, generalizable, compact representation for text-to-SQL examples derived with minimal human intervention. We demonstrate the utility of these representations in evaluation with three use cases:…

Computation and Language · Computer Science 2025-11-03 Neha Srikanth , Victor Bursztyn , Puneet Mathur , Ani Nenkova

Translating natural language into SQL (Text-to-SQL) remains a core challenge at the intersection of language understanding and structured data access. Although large language models (LLMs) have improved fluency, generating correct and…

Artificial Intelligence · Computer Science 2025-07-09 Kushal Gajjar , Harshit Sikchi , Arpit Singh Gautam , Marc Hammons , Saurabh Jha

Text-to-SQL semantic parsing faces challenges in generalizing to cross-domain and complex queries. Recent research has employed a question decomposition strategy to enhance the parsing of complex SQL queries. However, this strategy…

Computation and Language · Computer Science 2023-10-23 Ben Eyal , Amir Bachar , Ophir Haroche , Moran Mahabi , Michael Elhadad

The rise of deep learning in natural language processing has fostered the creation of text to structured query language models composed of an encoder and a decoder. Researchers have experimented with various intermediate processing like…

Information Retrieval · Computer Science 2025-04-15 Jyothi , T. Satyanarayana Murthy

Recognizing the promise of natural language interfaces to databases, prior studies have emphasized the development of text-to-SQL systems. While substantial progress has been made in this field, existing research has concentrated on…

We consider the problem of neural semantic parsing, which translates natural language questions into executable SQL queries. We introduce a new mechanism, execution guidance, to leverage the semantics of SQL. It detects and excludes faulty…

Computation and Language · Computer Science 2018-09-17 Chenglong Wang , Kedar Tatwawadi , Marc Brockschmidt , Po-Sen Huang , Yi Mao , Oleksandr Polozov , Rishabh Singh

Semantic Textual Similarity (STS) is a crucial component of many Natural Language Processing (NLP) applications. However, existing approaches typically reduce semantic nuances to a single score, limiting interpretability. To address this,…

Computation and Language · Computer Science 2026-05-15 Diego Miguel Lozano , Daryna Dementieva , Alexander Fraser

In Natural Language Processing (NLP), one of the most important tasks is text-to-SQL semantic parsing, which focuses on enabling users to interact with the database in a more natural manner. In recent years, text-to-SQL has made significant…

Computation and Language · Computer Science 2024-02-26 Saleh Almohaimeed , Saad Almohaimeed , Mansour Al Ghanim , Liqiang Wang

Text-to-SQL parsers are crucial in enabling non-experts to effortlessly query relational data. Training such parsers, by contrast, generally requires expertise in annotating natural language (NL) utterances with corresponding SQL queries.…

Computation and Language · Computer Science 2024-08-05 Tomer Wolfson , Daniel Deutch , Jonathan Berant

Text-to-SQL is a task to generate SQL queries from human utterances. However, due to the variation of natural language, two semantically equivalent utterances may appear differently in the lexical level. Likewise, user preferences (e.g.,…

Computation and Language · Computer Science 2020-12-22 Pingchuan Ma , Shuai Wang

We propose the task of knowledge distillation detection, which aims to determine whether a student model has been distilled from a given teacher, under a practical setting where only the student's weights and the teacher's API are…

Machine Learning · Computer Science 2025-10-03 Qin Shi , Amber Yijia Zheng , Qifan Song , Raymond A. Yeh