English
Related papers

Related papers: Data Ambiguity Strikes Back: How Documentation Imp…

200 papers

Large Language Models (LLMs) have recently demonstrated strong capabilities in translating natural language into database queries, especially when dealing with complex graph-structured data. However, real-world queries often contain…

Databases · Computer Science 2025-08-14 Yuchen Tian , Kaixin Li , Hao Chen , Ziyang Luo , Hongzhan Lin , Sebastian Schelter , Lun Du , Jing Ma

Most large language models are fine-tuned using either expensive human-annotated data or GPT-4 generated data which cannot guarantee performance in certain domains. We argue that although the web-crawled data often has formatting errors…

Computation and Language · Computer Science 2024-08-16 Jing Zhou , Chenglin Jiang , Wei Shen , Xiao Zhou , Xiaonan He

Interpreting the meaning of legal open-textured terms is a key task of legal professionals. An important source for this interpretation is how the term was applied in previous court cases. In this paper, we evaluate the performance of GPT-4…

Computation and Language · Computer Science 2023-06-23 Jaromir Savelka , Kevin D. Ashley , Morgan A. Gray , Hannes Westermann , Huihui Xu

Text-to-SQL semantic parsing has made significant progress in recent years, with various models demonstrating impressive performance on the challenging Spider benchmark. However, it has also been shown that these models often struggle to…

Computation and Language · Computer Science 2024-02-14 Irina Saparina , Mirella Lapata

Progress in neural grammatical error correction (GEC) is hindered by the lack of annotated training data. Sufficient amounts of high-quality manually annotated data are not available, so recent research has relied on generating synthetic…

Computation and Language · Computer Science 2023-11-21 Andrey Bout , Alexander Podolskiy , Sergey Nikolenko , Irina Piontkovskaya

We study the pre-train + fine-tune strategy for data-to-text tasks. Our experiments indicate that text-to-text pre-training in the form of T5, enables simple, end-to-end transformer based models to outperform pipelined neural architectures…

Computation and Language · Computer Science 2021-07-12 Mihir Kale , Abhinav Rastogi

Efficient querying and analysis of large tabular datasets remain significant challenges, especially for users without expertise in programming languages like SQL. Text-to-SQL approaches have shown promising performance on benchmark data;…

Databases · Computer Science 2025-08-27 Yipeng Zhang , Chen Wang , Yuzhe Zhang , Jacky Jiang

NL2SQL systems deployed in industry settings often encounter ambiguous or unanswerable queries, particularly in interactive scenarios with incomplete user clarification. Existing benchmarks typically assume a single source of ambiguity and…

LLMs when used with Retrieval Augmented Generation (RAG), are greatly improving the SOTA of translating natural language queries to structured and correct SQL. Unlike previous reviews, this survey provides a comprehensive study of the…

Computation and Language · Computer Science 2025-02-05 Ali Mohammadjafari , Anthony S. Maida , Raju Gottumukkala

Recently, several data-sets associating data to text have been created to train data-to-text surface realisers. It is unclear however to what extent the surface realisation task exercised by these data-sets is linguistically challenging. Do…

Computation and Language · Computer Science 2017-05-11 Laura Perez-Beltrachini , Claire Gardent

The quality of artificially generated texts has considerably improved with the advent of transformers. The question of using these models to generate learning data for supervised learning tasks naturally arises. In this article, this…

Computation and Language · Computer Science 2021-10-26 Vincent Claveau , Antoine Chaffin , Ewa Kijak

Datasets labelled by human annotators are widely used in the training and testing of machine learning models. In recent years, researchers are increasingly paying attention to label quality. However, it is not always possible to objectively…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Luisa Schwirten , Jannes Scholz , Daniel Kondermann , Janis Keuper

Community-driven Text-to-SQL evaluation platforms play a pivotal role in tracking the state of the art of Text-to-SQL performance. The reliability of the evaluation process is critical for driving progress in the field. Current evaluation…

Databases · Computer Science 2026-03-05 Rocky Klopfenstein , Yang He , Andrew Tremante , Yuepeng Wang , Nina Narodytska , Haoze Wu

Large Language Models (LLMs) are intended to reflect human linguistic competencies. But humans have access to a broad and embodied context, which is key in detecting and resolving linguistic ambiguities, even in isolated text spans. A…

Computation and Language · Computer Science 2025-10-22 Amber Shore , Russell Scheinberg , Ameeta Agrawal , So Young Lee

Text-to-SQL is a crucial task toward developing methods for understanding natural language by computers. Recent neural approaches deliver excellent performance; however, models that are difficult to interpret inhibit future developments.…

Computation and Language · Computer Science 2021-02-04 Yasufumi Taniguchi , Hiroki Nakayama , Kubo Takahiro , Jun Suzuki

We present an empirical study of how both experienced tutors and non-tutors judge the correctness of tutor praise responses under different Artificial Intelligence (AI)-assisted interfaces, types of explanation (textual explanations vs.…

Human-Computer Interaction · Computer Science 2026-01-06 Eason Chen , Jeffrey Li , Scarlett Huang , Xinyi Tang , Jionghao Lin , Paulo Carvalho , Kenneth Koedinger

Large Language Models (LLMs) have made significant progress in assisting users to query databases in natural language. While LLM-based techniques provide state-of-the-art results on many standard benchmarks, their performance significantly…

Artificial Intelligence · Computer Science 2024-07-09 Nina Narodytska , Shay Vargaftik

With the future striving toward data-centric decision-making, seamless access to databases is of utmost importance. There is extensive research on creating an efficient text-to-sql (TEXT2SQL) model to access data from the database. Using a…

Computation and Language · Computer Science 2022-08-10 Ayush Kumar , Parth Nagarkar , Prabhav Nalhe , Sanjeev Vijayakumar

Text-to-SQL is an important task that helps people obtain information from databases by automatically generating SQL queries. Considering the brilliant performance, approaches based on Large Language Models (LLMs) become the mainstream for…

Computation and Language · Computer Science 2024-08-28 Dingzirui Wang , Longxu Dou , Xuanliang Zhang , Qingfu Zhu , Wanxiang Che

Text-to-SQL systems facilitate smooth interaction with databases by translating natural language queries into Structured Query Language (SQL), bridging the gap between non-technical users and complex database management systems. This survey…

Artificial Intelligence · Computer Science 2025-01-24 Aditi Singh , Akash Shetty , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei