English
Related papers

Related papers: Data Ambiguity Strikes Back: How Documentation Imp…

200 papers

In addressing the pivotal role of translating natural language queries into SQL commands, we propose a suite of compact, fine-tuned models and self-refine mechanisms to democratize data access and analysis for non-expert users, mitigating…

Artificial Intelligence · Computer Science 2024-09-25 Lixia Wu , Peng Li , Junhong Lou , Lei Fu

Text-to-SQL tasks have gained attractive improvements since the release of ChatGPT. Among them, agent-based frameworks have been widely used in this field. However, the impact of data-centric strategies on text-to-SQL tasks has rarely been…

Computation and Language · Computer Science 2025-10-28 Yuanzhen Xie , Liu Ye , Jiqun Chu , Mochi Gao , Hehuan Liu , Yunzhi Tan , Bo Hu , Zang Li

Handling ambiguity and underspecification is an important challenge in natural language interfaces, particularly for tasks like text-to-SQL semantic parsing. We propose a modular approach that resolves ambiguity using natural language…

Computation and Language · Computer Science 2025-07-15 Irina Saparina , Mirella Lapata

Text data is often seen as "take-away" materials with little noise and easy to process information. Main questions are how to get data and transform them into a good document format. But data can be sensitive to noise oftenly called…

Computation and Language · Computer Science 2023-06-22 Nicolas Turenne

Text-to-SQL enables users to interact with databases using natural language, simplifying the retrieval and synthesis of information. Despite the remarkable success of large language models (LLMs) in translating natural language questions…

Artificial Intelligence · Computer Science 2024-07-03 Gyubok Lee , Woosog Chay , Seonhee Cho , Edward Choi

Natural language often contains ambiguities that can lead to misinterpretation and miscommunication. While humans can handle ambiguities effectively by asking clarifying questions and/or relying on contextual cues and common-sense…

Computation and Language · Computer Science 2022-11-24 Ninareh Mehrabi , Palash Goyal , Apurv Verma , Jwala Dhamala , Varun Kumar , Qian Hu , Kai-Wei Chang , Richard Zemel , Aram Galstyan , Rahul Gupta

Large language models have been useful in expanding mental health care delivery. ChatGPT, in particular, has gained popularity for its ability to generate human-like dialogue. However, data-sensitive domains -- including but not limited to…

Computation and Language · Computer Science 2023-06-12 Anaelia Ovalle , Mehrab Beikzadeh , Parshan Teimouri , Kai-Wei Chang , Majid Sarrafzadeh

The task of text-to-SQL parsing, which aims at converting natural language questions into executable SQL queries, has garnered increasing attention in recent years, as it can assist end users in efficiently extracting vital information from…

Computation and Language · Computer Science 2023-01-19 Jinyang Li , Binyuan Hui , Reynold Cheng , Bowen Qin , Chenhao Ma , Nan Huo , Fei Huang , Wenyu Du , Luo Si , Yongbin Li

Research in Text-to-SQL conversion has been largely benchmarked against datasets where each text query corresponds to one correct SQL. However, natural language queries over real-life databases frequently involve significant ambiguity about…

Computation and Language · Computer Science 2023-10-23 Adithya Bhaskar , Tushar Tomar , Ashutosh Sathe , Sunita Sarawagi

Lexical ambiguity is a challenging and pervasive problem in machine translation (\mt). We introduce a simple and scalable approach to resolve translation ambiguity by incorporating a small amount of extra-sentential context in neural \mt.…

Computation and Language · Computer Science 2023-11-28 Elijah Rippeth , Marine Carpuat , Kevin Duh , Matt Post

Data-to-text systems are powerful in generating reports from data automatically and thus they simplify the presentation of complex data. Rather than presenting data using visualisation techniques, data-to-text systems use natural (human)…

Computation and Language · Computer Science 2016-10-27 Dimitra Gkatzia

Deploying large language models for clinical Text-to-SQL requires distinguishing two qualitatively different causes of output diversity: (i) input ambiguity that should trigger clarification, and (ii) model instability that should trigger…

Computation and Language · Computer Science 2026-05-19 Angelo Ziletti , Leonardo D'Ambrosi

We perform a missing, reproducible evaluation of all publicly available GPT-4 family models concerning the Document Understanding field, where it is frequently required to comprehend text spacial arrangement and visual clues in addition to…

Computation and Language · Computer Science 2024-05-29 Łukasz Borchmann

Benchmarking modern large language models (LLMs) on complex and realistic tasks is critical to advancing their development. In this work, we evaluate the factual accuracy and citation performance of state-of-the-art LLMs on the task of…

Computation and Language · Computer Science 2024-12-25 Maya Patel , Aditi Anand

In real world translation scenarios, terminology is rarely one-to-one. Instead, multiple valid translations may appear in a terminology dictionary, but correctness of a translation depends on corporate style guides and context. This can be…

Computation and Language · Computer Science 2025-07-18 Nathaniel Berger , Johannes Eschbach-Dymanus , Miriam Exel , Matthias Huck , Stefan Riezler

Text-to-SQL conversion is a critical innovation, simplifying the transition from complex SQL to intuitive natural language queries, especially significant given SQL's prevalence in the job market across various roles. The rise of Large…

Computation and Language · Computer Science 2024-07-23 Tingkai Zhang , Chaoyu Chen , Cong Liao , Jun Wang , Xudong Zhao , Hang Yu , Jianchao Wang , Jianguo Li , Wenhui Shi

We examine whether a leading AI system GPT4 understands text as well as humans do, first using a well-established standardized test of discourse comprehension. On this test, GPT4 performs slightly, but not statistically significantly,…

Computation and Language · Computer Science 2025-01-22 Thomas R. Shultz , Jamie M. Wise , Ardavan Salehi Nobandegani

Text-to-SQL enables users to interact with databases through natural language, simplifying the retrieval and synthesis of information. Despite the success of large language models (LLMs) in converting natural language questions into SQL…

Machine Learning · Computer Science 2025-04-23 Oleg Somov , Elena Tutubalina

Text-to-SQL parsing has achieved remarkable progress under the Full Schema Assumption. However, this premise fails in real-world enterprise environments where databases contain hundreds of tables with massive noisy metadata. Rather than…

Artificial Intelligence · Computer Science 2026-03-19 Ai Jian , Xiaoyun Zhang , Wanrou Du , Jingqing Ruan , Jiangbo Pei , Weipeng Zhang , Ke Zeng , Xunliang Cai

The existing text-to-SQL systems have made significant progress in SQL query generation, but they still face numerous challenges. Existing systems often lack retrieval capabilities for open-domain databases, requiring users to manually…

Computation and Language · Computer Science 2025-04-15 Keyan Xu , Dingzirui Wang , Xuanliang Zhang , Qingfu Zhu , Wanxiang Che