English
Related papers

Related papers: Text-to-SQL in the Wild: A Naturally-Occurring Dat…

200 papers

In spoken question answering, QA systems are designed to answer questions from contiguous text spans within the related speech transcripts. However, the most natural way that human seek or test their knowledge is via human conversations.…

Computation and Language · Computer Science 2020-10-20 Chenyu You , Nuo Chen , Fenglin Liu , Dongchao Yang , Yuexian Zou

Dataset search is a well-established task in the Semantic Web and information retrieval research. Current approaches retrieve datasets either based on keyword queries or by identifying datasets similar to a given target dataset. These…

Information Retrieval · Computer Science 2025-12-11 Qing Shi , Jing He , Qiaosheng Chen , Gong Cheng

Event Extraction (EE) is one of the fundamental tasks in Information Extraction (IE) that aims to recognize event mentions and their arguments (i.e., participants) from text. Due to its importance, extensive methods and resources have been…

Computation and Language · Computer Science 2022-11-21 Amir Pouran Ben Veyseh , Javid Ebrahimi , Franck Dernoncourt , Thien Huu Nguyen

Reusing published datasets on the Web is of great interest to researchers and developers. Their data needs may be met by submitting queries to a dataset search engine to retrieve relevant datasets. In this ongoing work towards developing a…

Information Retrieval · Computer Science 2019-08-30 Jinchi Chen , Xiaxia Wang , Gong Cheng , Evgeny Kharlamov , Yuzhong Qu

The task of Text-to-SQL enables anyone to retrieve information from SQL databases using natural language. While this task has made substantial progress, the two primary evaluation metrics - Execution Accuracy (EXE) and Exact Set Matching…

Computation and Language · Computer Science 2025-06-18 Benjamin G. Ascoli , Yasoda Sai Ram Kandikonda , Jinho D. Choi

Real-world enterprise text-to-SQL workflows often involve complex cloud or local data across various database systems, multiple SQL queries in various dialects, and diverse operations from data transformation to analytics. We introduce…

Existing datasets for natural language inference (NLI) have propelled research on language understanding. We propose a new method for automatically deriving NLI datasets from the growing abundance of large-scale question answering datasets.…

Computation and Language · Computer Science 2018-09-12 Dorottya Demszky , Kelvin Guu , Percy Liang

Current state of the art systems in NLP heavily rely on manually annotated datasets, which are expensive to construct. Very little work adequately exploits unannotated data -- such as discourse markers between sentences -- mainly because of…

Computation and Language · Computer Science 2019-03-29 Damien Sileo , Tim Van-De-Cruys , Camille Pradel , Philippe Muller

Text-to-SQL systems powered by Large Language Models have excelled on academic benchmarks but struggle in complex enterprise environments. The primary limitation lies in their reliance on static schema representations, which fails to…

Databases · Computer Science 2026-02-20 Bowen Cao , Weibin Liao , Yushi Sun , Dong Fang , Haitao Li , Wai Lam

Neural text-to-SQL models have achieved remarkable performance in translating natural language questions into SQL queries. However, recent studies reveal that text-to-SQL models are vulnerable to task-specific perturbations. Previous…

We introduce SCDE, a dataset to evaluate the performance of computational models through sentence prediction. SCDE is a human-created sentence cloze dataset, collected from public school English examinations. Our task requires a model to…

Computation and Language · Computer Science 2020-04-28 Xiang Kong , Varun Gangal , Eduard Hovy

Recent state-of-the-art natural language understanding models, such as BERT and XLNet, score a pair of sentences (A and B) using multiple cross-attention operations - a process in which each word in sentence A attends to all words in…

Machine Learning · Computer Science 2019-11-22 Oren Barkan , Noam Razin , Itzik Malkiel , Ori Katz , Avi Caciularu , Noam Koenigstein

Addressing the mismatch between natural language descriptions and the corresponding SQL queries is a key challenge for text-to-SQL translation. To bridge this gap, we propose an SQL intermediate representation (IR) called Natural SQL…

Computation and Language · Computer Science 2021-09-14 Yujian Gan , Xinyun Chen , Jinxia Xie , Matthew Purver , John R. Woodward , John Drake , Qiaofu Zhang

Existing datasets for regular expression (regex) generation from natural language are limited in complexity; compared to regex tasks that users post on StackOverflow, the regexes in these datasets are simple, and the language used to…

Computation and Language · Computer Science 2020-05-05 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

Despite significant progress in Natural Language Generation for Indian languages (IndicNLP), there is a lack of datasets around complex structured tasks such as semantic parsing. One reason for this imminent gap is the complexity of the…

Computation and Language · Computer Science 2023-06-06 Divyanshu Aggarwal , Vivek Gupta , Anoop Kunchukuttan

Slot-filling and intent detection are the backbone of conversational agents such as voice assistants, and are active areas of research. Even though state-of-the-art techniques on publicly available benchmarks show impressive performance,…

Computation and Language · Computer Science 2022-01-31 David Alfonso-Hermelo , Ahmad Rashid , Abbas Ghaddar , Philippe Langlais , Mehdi Rezagholizadeh

The goal of database question answering is to enable natural language querying of real-life relational databases in diverse application domains. Recently, large-scale datasets such as Spider and WikiSQL facilitated novel modeling techniques…

Computation and Language · Computer Science 2021-06-23 Chia-Hsuan Lee , Oleksandr Polozov , Matthew Richardson

The Web today has millions of datasets, and the number of datasets continues to grow at a rapid pace. These datasets are not standalone entities; rather, they are intricately connected through complex relationships. Semantic relationships…

Information Retrieval · Computer Science 2024-08-28 Kate Lin , Tarfah Alrashed , Natasha Noy

Querying databases for the right information is a time consuming and error-prone task and often requires experienced professionals for the job. Furthermore, the user needs to have some prior knowledge about the database. There have been…

Databases · Computer Science 2022-10-18 Manu Joseph , Harsh Raj , Anubhav Yadav , Aaryamann Sharma

Chatbots and AI assistants have claimed their importance in today life. The main reason behind adopting this technology is to connect with the user, understand their requirements, and fulfill them. This has been achieved but at the cost of…

Computation and Language · Computer Science 2021-02-23 Muhammad Hamzah Mushtaq