English
Related papers

Related papers: Prompting Large Language Models With the Socratic …

200 papers

The limits of open-ended generative models are unclear, yet increasingly important. What causes them to succeed and what causes them to fail? In this paper, we take a prompt-centric approach to analyzing and bounding the abilities of…

Computation and Language · Computer Science 2023-02-21 Albert Lu , Hongxin Zhang , Yanzhe Zhang , Xuezhi Wang , Diyi Yang

Large LMs such as GPT-3 are powerful, but can commit mistakes that are obvious to humans. For example, GPT-3 would mistakenly interpret "What word is similar to good?" to mean a homophone, while the user intended a synonym. Our goal is to…

Computation and Language · Computer Science 2023-02-21 Aman Madaan , Niket Tandon , Peter Clark , Yiming Yang

Large natural language models (such as GPT-3 or T5) demonstrate impressive abilities across a range of general NLP tasks. Here, we show that the knowledge embedded in such models provides a useful inductive bias, not just on traditional NLP…

Computation and Language · Computer Science 2021-10-07 Christopher Michael Rytting , David Wingate

Large language Models (LLMs) are usually used to answer questions, but many high-stakes applications (e.g., tutoring, clinical support) require the complementary skill of asking questions: detecting missing information, requesting…

Artificial Intelligence · Computer Science 2026-01-07 Rajeev Bhatt Ambati , Tianyi Niu , Aashu Singh , Shlok Mishra , Snigdha Chaturvedi , Shashank Srivastava

Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to…

Computation and Language · Computer Science 2023-09-07 Mengjuan Liu , Chenyang Liu , Yunfan Yang , Jiang Liu , Mohan Jing

Large Language Models (LLMs), such as \texttt{ChatGPT}, greatly empower dialogue systems with strong language understanding and generation capabilities. However, most of the previous works prompt the LLMs to directly generate a response…

Computation and Language · Computer Science 2023-10-17 Hongru Wang , Rui Wang , Fei Mi , Yang Deng , Zezhong Wang , Bin Liang , Ruifeng Xu , Kam-Fai Wong

Probabilistic models of language understanding are valuable tools for investigating human language use. However, they need to be hand-designed for a particular domain. In contrast, large language models (LLMs) are trained on text that spans…

Computation and Language · Computer Science 2023-05-23 Ben Prystawski , Paul Thibodeau , Christopher Potts , Noah D. Goodman

Large language models (LLMs) have demonstrated impressive performance on many tasks. However, to achieve optimal performance, specially designed prompting methods are still needed. These methods either rely on task-specific few-shot…

Computation and Language · Computer Science 2024-02-29 Haoxiang Guan , Jiyan He , Shuxin Zheng , En-Hong Chen , Weiming Zhang , Nenghai Yu

Large Language Models (LLMs) have limited performance when solving arithmetic reasoning tasks and often provide incorrect answers. Unlike natural language understanding, math problems typically have a single correct answer, making the task…

Computation and Language · Computer Science 2023-03-10 Shima Imani , Liang Du , Harsh Shrivastava

With the development of Large Language Models (LLM), numerous prompts have been proposed, each with a rich set of features and their own merits. This paper summarizes the prompt words for large language models (LLMs), categorizing them into…

Computation and Language · Computer Science 2024-04-17 Chenggian Ma , Xiangyu Zhao , Chunhui Zhang , Yanzhao Qin , Wentao Zhang

Prior work has combined chain-of-thought prompting in large language models (LLMs) with programmatic representations to perform effective and transparent reasoning. While such an approach works well for tasks that only require forward…

Computation and Language · Computer Science 2023-10-13 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

Since the launch of ChatGPT, a powerful AI Chatbot developed by OpenAI, large language models (LLMs) have made significant advancements in both academia and industry, bringing about a fundamental engineering paradigm shift in many areas.…

Software Engineering · Computer Science 2023-11-22 Xiaoxia Liu , Jingyi Wang , Jun Sun , Xiaohan Yuan , Guoliang Dong , Peng Di , Wenhai Wang , Dongxia Wang

The performance of Large Language Models (LLMs) relies heavily on the quality of prompts, which are often manually engineered and task-specific, making them costly and non-scalable. We propose a novel approach, Supervisory Prompt Training…

Computation and Language · Computer Science 2024-03-28 Jean Ghislain Billa , Min Oh , Liang Du

Large Language Models (LLMs) (e.g., ChatGPT) have shown impressive performance in code generation. LLMs take prompts as inputs, and Chain-of-Thought (CoT) prompting is the state-of-the-art prompting technique. CoT prompting asks LLMs first…

Software Engineering · Computer Science 2023-09-08 Jia Li , Ge Li , Yongmin Li , Zhi Jin

Pre-trained language models (LLMs) such as GPT-3 can carry fluent, multi-turn conversations out-of-the-box, making them attractive materials for chatbot design. Further, designers can improve LLM chatbot utterances by prepending textual…

Human-Computer Interaction · Computer Science 2023-02-08 J. D. Zamfirescu-Pereira , Bjoern Hartmann , Qian Yang

Language models can be prompted to perform a wide variety of zero- and few-shot learning problems. However, performance varies significantly with the choice of prompt, and we do not yet understand why this happens or how to pick the best…

Computation and Language · Computer Science 2024-09-16 Hila Gonen , Srini Iyer , Terra Blevins , Noah A. Smith , Luke Zettlemoyer

Prompting techniques such as chain-of-thought have established themselves as a popular vehicle for improving the outputs of large language models (LLMs). For code generation, however, their exact mechanics and efficacy are under-explored.…

Computation and Language · Computer Science 2025-04-09 Kunhao Zheng , Juliette Decugis , Jonas Gehring , Taco Cohen , Benjamin Negrevergne , Gabriel Synnaeve

Topic modeling is a widely used technique for revealing underlying thematic structures within textual data. However, existing models have certain limitations, particularly when dealing with short text datasets that lack co-occurring words.…

Artificial Intelligence · Computer Science 2023-12-18 Han Wang , Nirmalendu Prakash , Nguyen Khoi Hoang , Ming Shan Hee , Usman Naseem , Roy Ka-Wei Lee

In this paper, we investigate the use of large language models (LLMs) like ChatGPT for document-grounded response generation in the context of information-seeking dialogues. For evaluation, we use the MultiDoc2Dial corpus of task-oriented…

Computation and Language · Computer Science 2023-09-22 Norbert Braunschweiler , Rama Doddipatla , Simon Keizer , Svetlana Stoyanchev

The growing integration of AI tools in software development, particularly Large Language Models (LLMs) such as ChatGPT, has revolutionized how developers approach coding tasks. However, achieving high-quality code often requires iterative…

Software Engineering · Computer Science 2025-06-03 Sophia DiCuffa , Amanda Zambrana , Priyanshi Yadav , Sashidhar Madiraju , Khushi Suman , Eman Abdullah AlOmar