English
Related papers

Related papers: ACT-SQL: In-Context Learning for Text-to-SQL with …

200 papers

Despite their outstanding capabilities, large language models (LLMs) are prone to hallucination and producing factually incorrect information. This challenge has spurred efforts in attributed text generation, which prompts LLMs to generate…

Computation and Language · Computer Science 2025-06-23 Junyi Li , Hwee Tou Ng

Text-to-SQL models, which parse natural language (NL) questions to executable SQL queries, are increasingly adopted in real-world applications. However, deploying such models in the real world often requires adapting them to the highly…

Human-Computer Interaction · Computer Science 2025-11-17 Yuan Tian , Daniel Lee , Fei Wu , Tung Mai , Kun Qian , Siddhartha Sahai , Tianyi Zhang , Yunyao Li

Chain-of-thought (CoT) prompting for language models demonstrates impressive performance across reasoning tasks, but typically needs labeled exemplars of the reasoning process. In this work, we introduce a new prompting approach, analogical…

Machine Learning · Computer Science 2024-03-12 Michihiro Yasunaga , Xinyun Chen , Yujia Li , Panupong Pasupat , Jure Leskovec , Percy Liang , Ed H. Chi , Denny Zhou

In this paper, we take the initiative to investigate the performance of LLMs on complex planning tasks that require LLMs to understand a virtual spatial environment simulated via natural language and act correspondingly in text. We propose…

Computation and Language · Computer Science 2024-08-06 Hanxu Hu , Hongyuan Lu , Huajian Zhang , Yun-Ze Song , Wai Lam , Yue Zhang

Large Language Models (LLMs) have demonstrated remarkable performance in solving complex reasoning tasks through mechanisms like Chain-of-Thought (CoT) prompting, which emphasizes verbose, step-by-step reasoning. However, humans typically…

Computation and Language · Computer Science 2025-03-04 Silei Xu , Wenhao Xie , Lingxiao Zhao , Pengcheng He

Large language models (LLMs), such as GPT series and Llama series have demonstrated strong capabilities in natural language processing, contextual understanding, and text generation. In recent years, researchers are trying to enhance the…

Computation and Language · Computer Science 2024-10-08 Ziyang Chen , Stylios Moscholios

Large Language Models (LLMs) have made significant strides in both scientific research and practical applications. Existing studies have demonstrated the state-of-the-art (SOTA) performance of LLMs in various natural language processing…

Computation and Language · Computer Science 2024-01-09 Yajing Wang , Zongwei Luo

Large language models (LLMs) have demonstrated remarkable proficiency in in-context learning (ICL), where models adapt to new tasks through example-based prompts without requiring parameter updates. However, understanding how tasks are…

Computation and Language · Computer Science 2025-11-11 Baturay Saglam , Xinyang Hu , Zhuoran Yang , Dionysis Kalogerias , Amin Karbasi

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura

With Large Language Models' (LLMs) emergent abilities on code generation tasks, Text-to-SQL has become one of the most popular downstream applications. Despite the strong results of multiple recent LLM-based Text-to-SQL frameworks, the…

Machine Learning · Computer Science 2025-09-09 Dazhi Peng

Text-to-SQL enables users to interact with databases through natural language, simplifying access to structured data. Although highly capable large language models (LLMs) achieve strong accuracy for complex queries, they incur unnecessary…

Databases · Computer Science 2024-11-08 Mohammadhossein Malekpour , Nour Shaheen , Foutse Khomh , Amine Mhedhbi

As language models have become increasingly successful at a wide array of tasks, different prompt engineering methods have been developed alongside them in order to adapt these models to new tasks. One of them is Tree-of-Thoughts (ToT), a…

Human-Computer Interaction · Computer Science 2024-09-04 Alan Boyle , Isha Gupta , Sebastian Hönig , Lukas Mautner , Kenza Amara , Furui Cheng , Mennatallah El-Assady

Chain-of-thought (CoT) reasoning boosts large language models' (LLMs) performance on complex tasks but faces two key limitations: a lack of reliability when solely relying on LLM-generated reasoning chains and lower reasoning performance…

Computation and Language · Computer Science 2025-09-11 Feiyang Li , Peng Fang , Zhan Shi , Arijit Khan , Fang Wang , Weihao Wang , Xin Zhang , Yongjian Cui

Recent advances in large language models (LLMs) enable effective in-context learning (ICL) with many-shot examples, but at the cost of high computational demand due to longer input tokens. To address this, we propose cheat-sheet ICL, which…

Computation and Language · Computer Science 2025-09-26 Ukyo Honda , Soichiro Murakami , Peinan Zhang

Large language model (LLM) performance on reasoning problems typically does not generalize out of distribution. Previous work has claimed that this can be mitigated with chain of thought prompting-a method of demonstrating solution…

Artificial Intelligence · Computer Science 2025-03-13 Kaya Stechly , Karthik Valmeekam , Subbarao Kambhampati

Transforming unstructured text into structured and meaningful forms, organized by useful category labels, is a fundamental step in text mining for downstream analysis and application. However, most existing methods for producing label…

In-context learning using large language models has recently shown surprising results for semantic parsing tasks such as Text-to-SQL translation. Prompting GPT-3 or Codex using several examples of question-SQL pairs can produce excellent…

Computation and Language · Computer Science 2022-10-26 Peng Shi , Rui Zhang , He Bai , Jimmy Lin

Large Language Models (LLMs) have recently emerged as promising tools for knowledge tracing (KT) due to their strong reasoning and generalization abilities. While recent LLM-based KT methods have proposed new prompt formats, they struggle…

Computation and Language · Computer Science 2025-06-06 JongWoo Kim , SeongYeub Chu , Bryan Wong , Mun Yi

Large language models (LLMs) have recently garnered significant interest. With in-context learning, LLMs achieve impressive results in various natural language tasks. However, the application of LLMs to sentence embeddings remains an area…

Computation and Language · Computer Science 2023-08-01 Ting Jiang , Shaohan Huang , Zhongzhi Luan , Deqing Wang , Fuzhen Zhuang

Text-to-SQL systems translate natural language questions into executable SQL queries, and recent progress with large language models (LLMs) has driven substantial improvements in this task. Schema linking remains a critical component in…

Computation and Language · Computer Science 2025-05-27 AmirHossein Safdarian , Milad Mohammadi , Ehsan Jahanbakhsh , Mona Shahamat Naderi , Heshaam Faili