中文
相关论文

相关论文: Lightweight Transformers for Zero-Shot and Fine-Tu…

200 篇论文

Translating natural language questions into SQL has become a core challenge in enabling non-technical users to query databases. While recent work has explored large-scale synthetic data generation to improve model performance through…

人工智能 · 计算机科学 2025-10-01 Hasan Alp Caferoğlu , Mehmet Serhat Çelik , Özgür Ulusoy

State-of-the-art semantic parsers rely on auto-regressive decoding, emitting one symbol at a time. When tested against complex databases that are unobserved at training time (zero-shot), the parser often struggles to select the correct set…

计算与语言 · 计算机科学 2019-08-30 Ben Bogin , Matt Gardner , Jonathan Berant

Transforming natural-language requests into reliable, production-ready data transformations remains challenging: correctness depends on precise schema linking and warehouse-specific SQL dialects, while the strongest supervision available…

人工智能 · 计算机科学 2025-10-06 Anni Li , Aria Attar , Paul Dong

Recent text-to-SQL systems powered by large language models (LLMs) have demonstrated remarkable performance in translating natural language queries into SQL. However, these systems often struggle with complex database structures and…

计算与语言 · 计算机科学 2025-05-22 Haoyuan Ma , Yongliang Shen , Hengwei Liu , Wenqi Zhang , Haolei Xu , Qiuying Peng , Jun Wang , Weiming Lu

When translating natural language questions into SQL queries to answer questions from a database, we would like our methods to generalize to domains and database schemas outside of the training set. To handle complex questions and database…

机器学习 · 计算机科学 2019-06-28 Richard Shin

Transfer learning with a unified Transformer framework (T5) that converts all language problems into a text-to-text format was recently proposed as a simple and effective transfer learning approach. Although a multilingual version of the T5…

计算与语言 · 计算机科学 2022-03-16 El Moatez Billah Nagoudi , AbdelRahim Elmadany , Muhammad Abdul-Mageed

Text-to-SQL systems have become crucial for translating natural language into SQL queries in various industries, enabling non-technical users to perform complex data operations. The need for accurate evaluation methods has increased as…

计算与语言 · 计算机科学 2024-10-29 Heegyu Kim , Taeyang Jeon , Seunghwan Choi , Seungtaek Choi , Hyunsouk Cho

The current state-of-the-art (SOTA) for automated text-to-SQL still falls well short of expert human performance as measured by execution accuracy (EX) on the BIRD-SQL benchmark. The most accurate methods are also slow and expensive. To…

计算与语言 · 计算机科学 2024-04-22 Dayton G. Thorpe , Andrew J. Duberstein , Ian A. Kinsey

Large language models revolutionize Text2SQL through supervised fine-tuning, yet a crucial limitation is overlooked: the complexity of databases leads to an increased context length, consequently resulting in higher GPU memory demands for…

数据库 · 计算机科学 2024-10-16 Wen Wuzhenghong , Zhang Yongpan , Pan Su , Sun Yuwei , Lu Pengwei , Ding Cheng

Pre-trained text-to-text transformers such as BART have achieved impressive performance across a range of NLP tasks. Recent study further shows that they can learn to generalize to novel tasks, by including task descriptions as part of the…

计算与语言 · 计算机科学 2021-06-16 Qinyuan Ye , Xiang Ren

Few-shot text classification has important application value in low-resource environments. This paper proposes a strategy that combines adaptive fine-tuning, contrastive learning, and regularization optimization to improve the…

计算与语言 · 计算机科学 2025-05-12 Xu Han , Yumeng Sun , Weiqiang Huang , Hongye Zheng , Junliang Du

In recent years, the task of text-to-SQL translation, which converts natural language questions into executable SQL queries, has gained significant attention for its potential to democratize data access. Despite its promise, challenges such…

计算与语言 · 计算机科学 2024-05-28 Adrián Bazaga , Pietro Liò , Gos Micklem

Text-to-SQL systems provide a natural language interface that can enable even laymen to access information stored in databases. However, existing Large Language Models (LLM) struggle with SQL generation from natural instructions due to…

Deep learning (DL) techniques are gaining more and more attention in the software engineering community. They have been used to support several code-related tasks, such as automatic bug fixing and code comments generation. Recent studies in…

Natural Language Interfaces for Databases empower non-technical users to interact with data using natural language (NL). Advanced approaches, utilizing either neural sequence-to-sequence or more recent sophisticated large-scale language…

数据库 · 计算机科学 2026-01-09 Yuankai Fan , Tonghui Ren , Can Huang , Zhenying He , X. Sean Wang

When scaled to hundreds of billions of parameters, pretrained language models such as GPT-3 (Brown et al., 2020) achieve remarkable few-shot performance. However, enormous amounts of compute are required for training and applying such big…

计算与语言 · 计算机科学 2021-04-13 Timo Schick , Hinrich Schütze

Evaluating text-to-SQL systems remains largely fragile: correctness is typically judged by executing predicted and gold SQL queries on a single static database, even though the same queries may behave differently under alternative database…

数据库 · 计算机科学 2026-05-01 Mohammadamin Habibollah , Davood Rafiei

Neural sequence-to-sequence models provide a competitive approach to the task of mapping a question in natural language to an SQL query, also referred to as text-to-SQL generation. The Byte-Pair Encoding algorithm (BPE) has previously been…

计算与语言 · 计算机科学 2019-11-19 Samuel Müller , Andreas Vlachos

We present Spider4SSC dataset and S2CLite parsing tool. S2CLite is a lightweight, ontology-agnostic parser that translates SPARQL queries into Cypher queries, enabling both in-situ and large-scale SPARQL to Cypher translation. Unlike…

计算与语言 · 计算机科学 2025-11-13 Martin Vejvar , Yasutaka Fujimoto

Large pre-trained language models for textual data have an unconstrained output space; at each decoding step, they can produce any of 10,000s of sub-word tokens. When fine-tuned to target constrained formal languages like SQL, these models…

计算与语言 · 计算机科学 2021-09-14 Torsten Scholak , Nathan Schucher , Dzmitry Bahdanau