English
Related papers

Related papers: Fine-Tuning Language Models for Context-Specific S…

200 papers

Large language models (LLMs) have become essential for applications such as text summarization, sentiment analysis, and automated question-answering. Recently, LLMs have also been integrated into relational database management systems to…

Databases · Computer Science 2025-08-29 Kerem Akillioglu , Anurag Chakraborty , Sairaj Voruganti , M. Tamer Özsu

Recently, Large Language Models (LLMs) have been demonstrated to possess impressive capabilities in a variety of domains and tasks. We investigate the issue of prompt design in the multi-turn text-to-SQL task and attempt to enhance the…

Computation and Language · Computer Science 2024-05-07 Hanchong Zhang , Ruisheng Cao , Hongshen Xu , Lu Chen , Kai Yu

Text-to-SQL aims to convert natural language questions into executable SQL queries. While previous approaches, such as skeleton-masked selection, have demonstrated strong performance by retrieving similar training examples to guide large…

Computation and Language · Computer Science 2025-10-01 Jimin Lee , Ingeol Baek , Byeongjeong Kim , Hyunkyung Bae , Hwanhee Lee

Relational databases excel at structured data analysis, but real-world queries increasingly require capabilities beyond standard SQL, such as semantically matching entities across inconsistent names, extracting information not explicitly…

Databases · Computer Science 2026-05-15 Yin Lin , Tianjing Zeng , Zhongjun Ding , Rong Zhu , Bolin Ding , H. V. Jagadish , Jingren Zhou

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

Recent advancements in Text-to-SQL (Text2SQL) emphasize stimulating the large language models (LLM) on in-context learning, achieving significant results. Nevertheless, they face challenges when dealing with verbose database information and…

Computation and Language · Computer Science 2024-06-04 Zhishuai Li , Xiang Wang , Jingjing Zhao , Sun Yang , Guoqing Du , Xiaoru Hu , Bin Zhang , Yuxiao Ye , Ziyue Li , Rui Zhao , Hangyu Mao

Large Language Models (LLMs) are increasingly being integrated into various components of Ontology Matching pipelines. This paper investigates the capability of LLMs to perform ontology matching directly on ontology modules and generate the…

Computation and Language · Computer Science 2025-12-01 Guilherme Sousa , Rinaldo Lima , Cassia Trojahn

In recent years,Text-to-SQL, the problem of automatically converting questions posed in natural language to formal SQL queries, has emerged as an important problem at the intersection of natural language processing and data management…

Computation and Language · Computer Science 2024-09-17 Ke Shen , Mayank Kejriwal

LLMs when used with Retrieval Augmented Generation (RAG), are greatly improving the SOTA of translating natural language queries to structured and correct SQL. Unlike previous reviews, this survey provides a comprehensive study of the…

Computation and Language · Computer Science 2025-02-05 Ali Mohammadjafari , Anthony S. Maida , Raju Gottumukkala

Enterprise searches require users to have complex knowledge of queries, configurations, and metadata, rendering it difficult for them to access information as needed. Most go-to-market (GTM) platforms utilize advanced search, an interface…

Computation and Language · Computer Science 2024-11-11 Jesse Yao , Saurav Acharya , Priyaranjan Parida , Srinivas Attipalli , Ali Dasdan

Natural Language to SQL (NL2SQL) enables intuitive interactions with databases by transforming natural language queries into structured SQL statements. Despite recent advancements in enhancing human-computer interaction within database…

Databases · Computer Science 2025-10-10 Peixian Ma , Xialie Zhuang , Chengjin Xu , Xuhui Jiang , Ran Chen , Jian Guo

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

Computation and Language · Computer Science 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

Language models such as GPT and Llama have shown remarkable ability on diverse natural language tasks, yet their performance on complex table tasks (e.g., NL-to-Code and data cleaning) remains suboptimal. Improving performance typically…

Computation and Language · Computer Science 2026-03-25 Junjie Xing , Yeye He , Mengyu Zhou , Haoyu Dong , Shi Han , Dongmei Zhang , Surajit Chaudhuri

General-purpose Large Language Models (LLMs) are frequently fine-tuned through supervised fine-tuning (SFT) to enhance performance in specific domains. Better results can be achieved by distilling the chain-of-thought of a larger model at…

Machine Learning · Computer Science 2026-03-24 Andrey Goncharov , Daniil Vyazhev , Petr Sychev , Edvard Khalafyan , Alexey Zaytsev

Text-to-SQL, which maps natural language to SQL queries, has benefited greatly from recent advances in Large Language Models (LLMs). While LLMs offer various paradigms for this task, including prompting and supervised fine-tuning (SFT), SFT…

Computation and Language · Computer Science 2025-09-24 Jinwang Song , Hongying Zan , Kunli Zhang , Lingling Mu , Yingjie Han , Haobo Hua , Min Peng

Calibration is crucial as large language models (LLMs) are increasingly deployed to convert natural language queries into SQL for commercial databases. In this work, we investigate calibration techniques for assigning confidence to…

Databases · Computer Science 2024-11-28 Ashwin Ramachandran , Sunita Sarawagi

Recent advancements in training paradigms for Large Language Models (LLMs) have unlocked their remarkable capabilities in natural language processing and cross-domain generalization. While LLMs excel in tasks like programming and…

Machine Learning · Computer Science 2025-10-01 Yuan Huang

Large Language Models have become the de facto approach to sequence-to-sequence text generation tasks, but for specialized tasks/domains, a pretrained LLM lacks specific capabilities to produce accurate or well-formatted responses.…

Computation and Language · Computer Science 2024-03-20 Jiuhai Chen , Jonas Mueller

Large Language Models (LLMs) have made remarkable advancements in the field of natural language processing. However, their increasing size poses challenges in terms of computational cost. On the other hand, Small Language Models (SLMs) are…

Computation and Language · Computer Science 2023-08-03 Zhen Guo , Peiqi Wang , Yanwei Wang , Shangdi Yu

Ontologies are known to improve the accuracy of Large Language Models (LLMs) when translating natural language queries into a formal query language like SQL or SPARQL. There are two ways to leverage ontologies when working with LLMs. One is…

Databases · Computer Science 2024-10-15 C. Civili , E. Sherkhonov , R. E. K. Stirewalt