English
Related papers

Related papers: Byte-Pair Encoding for Text-to-SQL Generation

200 papers

Generating accurate SQL from users' natural language questions (text-to-SQL) remains a long-standing challenge due to the complexities involved in user question understanding, database schema comprehension, and SQL generation. Traditional…

Computation and Language · Computer Science 2025-11-25 Zijin Hong , Zheng Yuan , Qinggang Zhang , Hao Chen , Junnan Dong , Feiran Huang , Xiao Huang

We computed both Word and Sub-word Embeddings using FastText. For Sub-word embeddings we selected Byte Pair Encoding (BPE) algorithm to represent the sub-words. We evaluated the Biomedical Word Embeddings obtaining better results than…

It is relatively easy to mine a large parallel corpus for any machine learning task, such as speech-to-text or speech-to-speech translation. Although these mined corpora are large in volume, their quality is questionable. This work shows…

Computation and Language · Computer Science 2024-02-06 Md Mahfuz Ibn Alam , Antonios Anastasopoulos

The Text-to-SQL task translates natural language questions into SQL queries, enabling intuitive database interaction for non-experts. While recent methods leveraging Large Language Models (LLMs) achieve strong performance, their reliance on…

Computation and Language · Computer Science 2026-01-21 Shengmin Piao , Jieun Lee , Sanghyun Park

Research in Text-to-SQL conversion has been largely benchmarked against datasets where each text query corresponds to one correct SQL. However, natural language queries over real-life databases frequently involve significant ambiguity about…

Computation and Language · Computer Science 2023-10-23 Adithya Bhaskar , Tushar Tomar , Ashutosh Sathe , Sunita Sarawagi

To access data stored in relational databases, users need to understand the database schema and write a query using a query language such as SQL. To simplify this task, text-to-SQL models attempt to translate a user's natural language…

Computation and Language · Computer Science 2020-11-05 Amol Kelkar , Rohan Relan , Vaishali Bhardwaj , Saurabh Vaichal , Chandra Khatri , Peter Relan

In sophisticated existing Text-to-SQL methods exhibit errors in various proportions, including schema-linking errors (incorrect columns, tables, or extra columns), join errors, nested errors, and group-by errors. Consequently, there is a…

Databases · Computer Science 2024-05-17 Sun Yang , Qiong Su , Zhishuai Li , Ziyue Li , Hangyu Mao , Chenxi Liu , Rui Zhao

Text-to-SQL parsers are crucial in enabling non-experts to effortlessly query relational data. Training such parsers, by contrast, generally requires expertise in annotating natural language (NL) utterances with corresponding SQL queries.…

Computation and Language · Computer Science 2024-08-05 Tomer Wolfson , Daniel Deutch , Jonathan Berant

The challenges facing speech recognition systems, such as variations in pronunciations, adverse audio conditions, and the scarcity of labeled data, emphasize the necessity for a post-processing step that corrects recurring errors. Previous…

Computation and Language · Computer Science 2023-10-18 Tomer Wullach , Shlomo E. Chazan

Text-to-SQL aims to convert natural language questions into executable SQL queries. While previous approaches, such as skeleton-masked selection, have demonstrated strong performance by retrieving similar training examples to guide large…

Computation and Language · Computer Science 2025-10-01 Jimin Lee , Ingeol Baek , Byeongjeong Kim , Hyunkyung Bae , Hwanhee Lee

Text-to-SQL datasets are essential for training and evaluating text-to-SQL models, but existing datasets often suffer from limited coverage and fail to capture the diversity of real-world applications. To address this, we propose a novel…

Computation and Language · Computer Science 2025-11-25 Hao Wang , Yuanfeng Song , Xiaoming Yin , Xing Chen

Neural Machine Translation (NMT) in low-resource settings and of morphologically rich languages is made difficult in part by data sparsity of vocabulary words. Several methods have been used to help reduce this sparsity, notably Byte-Pair…

Computation and Language · Computer Science 2018-09-11 Pamela Shapiro , Kevin Duh

Phones and their context-dependent variants have been the standard modeling units for conventional speech recognition systems, while characters and subwords have demonstrated their effectiveness for end-to-end recognition systems. We…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Weiran Wang , Guangsen Wang , Aadyot Bhatnagar , Yingbo Zhou , Caiming Xiong , Richard Socher

Table-to-text generation aims to generate a description for a factual table which can be viewed as a set of field-value records. To encode both the content and the structure of a table, we propose a novel structure-aware seq2seq…

Computation and Language · Computer Science 2017-11-28 Tianyu Liu , Kexiang Wang , Lei Sha , Baobao Chang , Zhifang Sui

We present BPEmb, a collection of pre-trained subword unit embeddings in 275 languages, based on Byte-Pair Encoding (BPE). In an evaluation using fine-grained entity typing as testbed, BPEmb performs competitively, and for some languages…

Computation and Language · Computer Science 2017-10-09 Benjamin Heinzerling , Michael Strube

Speech-based inputs have been gaining significant momentum with the popularity of smartphones and tablets in our daily lives, since voice is the most easiest and efficient way for human-computer interaction. This paper works towards…

Databases · Computer Science 2022-01-05 Yuanfeng Song , Raymond Chi-Wing Wong , Xuefang Zhao , Di Jiang

Text-to-SQL translation enables non-expert users to query relational databases using natural language, with applications in education and business intelligence. This study evaluates three lightweight transformer models - T5-Small,…

Computation and Language · Computer Science 2025-08-07 Chirag Seth , Utkarsh Singh

Recent text-to-SQL models have achieved strong performance, but their effectiveness remains largely confined to SQLite due to dataset limitations. However, real-world applications require SQL generation across multiple dialects with varying…

Computation and Language · Computer Science 2025-05-26 Jipeng Zhang , Haolin Yang , Kehao Miao , Ruiyuan Zhang , Renjie Pi , Jiahui Gao , Xiaofang Zhou

Large Language Models (LLMs) have demonstrated exceptional versatility across domains, including applications to electrocardiograms (ECGs). A growing body of work focuses on generating text from multi-channeled ECG signals and corresponding…

Computation and Language · Computer Science 2025-07-31 William Han , Chaojing Duan , Michael A. Rosenberg , Emerson Liu , Ding Zhao

Inflectional variation is a common feature of World Englishes such as Colloquial Singapore English and African American Vernacular English. Although comprehension by human readers is usually unimpaired by non-standard inflections, current…

Computation and Language · Computer Science 2021-05-10 Samson Tan , Shafiq Joty , Lav R. Varshney , Min-Yen Kan