English
Related papers

Related papers: A Study of In-Context-Learning-Based Text-to-SQL E…

200 papers

This study explores text-to-SQL parsing by leveraging the powerful reasoning capabilities of large language models (LLMs). Despite recent advancements, existing LLM-based methods are still inefficient and struggle to handle cases with wide…

Computation and Language · Computer Science 2025-11-14 Guanming Xiong , Junwei Bao , Hongfei Jiang , Yang Song , Wen Zhao

The significant advancements in Large Language Models (LLMs) have resulted in their widespread adoption across various tasks within Software Engineering (SE), including vulnerability detection and repair. Numerous studies have investigated…

Software Engineering · Computer Science 2024-10-08 Xin Zhou , Sicong Cao , Xiaobing Sun , David Lo

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

Recent Text-to-SQL methods leverage large language models (LLMs) by incorporating feedback from the database management system. While these methods effectively address execution errors in SQL queries, they struggle with database mismatches…

Computation and Language · Computer Science 2024-09-02 Zhongyuan Wang , Richong Zhang , Zhijie Nie , Jaein Kim

Large Language Models (LLMs) excel at in-context learning (ICL), a supervised learning technique that relies on adding annotated examples to the model context. We investigate a contextual bandit version of in-context reinforcement learning…

Computation and Language · Computer Science 2025-09-30 Giovanni Monea , Antoine Bosselut , Kianté Brantley , Yoav Artzi

Recently, the development and progress of Large Language Models (LLMs) have amazed the entire Artificial Intelligence community. Benefiting from their emergent abilities, LLMs have attracted more and more researchers to study their…

Computation and Language · Computer Science 2024-10-28 Yinghui Li , Haojing Huang , Shirong Ma , Yong Jiang , Yangning Li , Feng Zhou , Hai-Tao Zheng , Qingyu Zhou

Large language models (LLMs) have demonstrated impressive capabilities in various natural language processing tasks. Despite this, their application to information retrieval (IR) tasks is still challenging due to the infrequent occurrence…

Computation and Language · Computer Science 2024-05-29 Yutao Zhu , Peitian Zhang , Chenghao Zhang , Yifei Chen , Binyu Xie , Zheng Liu , Ji-Rong Wen , Zhicheng Dou

Large Language Model (LLM) techniques play an increasingly important role in Natural Language to SQL (NL2SQL) translation. LLMs trained by extensive corpora have strong natural language understanding and basic SQL generation abilities…

Databases · Computer Science 2024-04-01 Tonghui Ren , Yuankai Fan , Zhenying He , Ren Huang , Jiaqi Dai , Can Huang , Yinan Jing , Kai Zhang , Yifan Yang , X. Sean Wang

Text-to-SQL (Text2SQL) aims to map natural language questions to executable SQL queries. Although large language models (LLMs) have driven significant progress, current approaches struggle with poor transferability to open-source LLMs,…

Databases · Computer Science 2025-05-23 Shuai Lyu , Haoran Luo , Ripeng Li , Zhonghong Ou , Jiangfeng Sun , Yang Qin , Xiaoran Shang , Meina Song , Yifan Zhu

In-Context Learning (ICL) empowers Large Language Models (LLMs) to tackle diverse tasks by incorporating multiple input-output examples, known as demonstrations, into the input of LLMs. More recently, advancements in the expanded context…

Artificial Intelligence · Computer Science 2025-05-27 Zihan Chen , Song Wang , Zhen Tan , Jundong Li , Cong Shen

From grading papers to summarizing medical documents, large language models (LLMs) are evermore used for evaluation of text generated by humans and AI alike. However, despite their extensive utility, LLMs exhibit distinct failure modes,…

Computation and Language · Computer Science 2023-09-28 Hosein Hasanbeig , Hiteshi Sharma , Leo Betthauser , Felipe Vieira Frujeri , Ida Momennejad

Large language models (LLMs) have shown impressive capabilities across various tasks, but their performance on domain-specific tasks remains limited. While methods like retrieval augmented generation and fine-tuning can help to address…

Computation and Language · Computer Science 2024-12-23 M. Mehdi Mojarradi , Lingyi Yang , Robert McCraith , Adam Mahdi

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

Tabular data is prevalent across various industries, necessitating significant time and effort for users to understand and manipulate for their information-seeking purposes. The advancements in large language models (LLMs) have shown…

Computation and Language · Computer Science 2023-11-01 Yilun Zhao , Haowei Zhang , Shengyun Si , Linyong Nan , Xiangru Tang , Arman Cohan

In-context learning (ICL) is an emerging capability of large autoregressive language models where a few input-label demonstrations are appended to the input to enhance the model's understanding of downstream NLP tasks, without directly…

Computation and Language · Computer Science 2023-10-31 Zhuocheng Gong , Jiahao Liu , Qifan Wang , Jingang Wang , Xunliang Cai , Dongyan Zhao , Rui Yan

In addressing the task of converting natural language to SQL queries, there are several semantic and syntactic challenges. It becomes increasingly important to understand and remedy the points of failure as the performance of semantic…

Computation and Language · Computer Science 2023-06-01 Parker Glenn , Parag Pravin Dakle , Preethi Raghavan

Large language models (LLMs) with in-context learning have demonstrated remarkable capability in the text-to-SQL task. Previous research has prompted LLMs with various demonstration-retrieval strategies and intermediate reasoning steps to…

Computation and Language · Computer Science 2023-11-28 Shuaichen Chang , Eric Fosler-Lussier

Despite advances in large language model (LLM)-based natural language interfaces for databases, scaling to enterprise-level data catalogs remains an under-explored challenge. Prior works addressing this challenge rely on domain-specific…

Computation and Language · Computer Science 2025-08-01 Jeffrey Eben , Aitzaz Ahmad , Stephen Lau

Large-scale neural language models exhibit a remarkable capacity for in-context learning (ICL): they can infer novel functions from datasets provided as input. Most of our current understanding of when and how ICL arises comes from LMs…

Computation and Language · Computer Science 2024-01-31 Ekin Akyürek , Bailin Wang , Yoon Kim , Jacob Andreas

Natural language to SQL translation (Text-to-SQL) is one of the long-standing problems that has recently benefited from advances in Large Language Models (LLMs). While most academic Text-to-SQL benchmarks request schema description as a…

Computation and Language · Computer Science 2026-01-13 Rajpreet Singh , Novak Boškov , Lawrence Drabeck , Aditya Gudal , Manzoor A. Khan