English
Related papers

Related papers: Prompting as Probing: Using Language Models for Kn…

200 papers

Large Language Models (LLMs) have limited performance when solving arithmetic reasoning tasks and often provide incorrect answers. Unlike natural language understanding, math problems typically have a single correct answer, making the task…

Computation and Language · Computer Science 2023-03-10 Shima Imani , Liang Du , Harsh Shrivastava

Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix, an automatic prompt optimization framework that transforms…

Computation and Language · Computer Science 2025-07-28 Rithesh Murthy , Ming Zhu , Liangwei Yang , Jielin Qiu , Juntao Tan , Shelby Heinecke , Caiming Xiong , Silvio Savarese , Huan Wang

Recently, Chain-of-Thought (CoT) prompting has delivered success on complex reasoning tasks, which aims at designing a simple prompt like ``Let's think step by step'' or multiple in-context exemplars with well-designed rationales to elicit…

Computation and Language · Computer Science 2024-06-04 Jianing Wang , Qiushi Sun , Xiang Li , Ming Gao

Optimization is ubiquitous. While derivative-based algorithms have been powerful tools for various problems, the absence of gradient imposes challenges on many real-world applications. In this work, we propose Optimization by PROmpting…

Machine Learning · Computer Science 2024-04-16 Chengrun Yang , Xuezhi Wang , Yifeng Lu , Hanxiao Liu , Quoc V. Le , Denny Zhou , Xinyun Chen

Language models (LLMs) offer potential as a source of knowledge for agents that need to acquire new task competencies within a performance environment. We describe efforts toward a novel agent capability that can construct cues (or…

Machine Learning · Computer Science 2022-11-22 James R. Kirk , Robert E. Wray , Peter Lindes , John E. Laird

Text entry is an essential task in our day-to-day digital interactions. Numerous intelligent features have been developed to streamline this process, making text entry more effective, efficient, and fluid. These improvements include…

Computation and Language · Computer Science 2023-10-17 Junxiao Shen , John J. Dudley , Jingyao Zheng , Bill Byrne , Per Ola Kristensson

GPT-3 and several other language models (LMs) can effectively address various natural language processing (NLP) tasks, including machine translation and text summarization. Recently, they have also been successfully employed in the business…

Artificial Intelligence · Computer Science 2023-04-17 Kiran Busch , Alexander Rochlitzer , Diana Sola , Henrik Leopold

To enhance the quality of generated stories, recent story generation models have been investigating the utilization of higher-level attributes like plots or commonsense knowledge. The application of prompt-based learning with large language…

Computation and Language · Computer Science 2023-07-25 Zhuohan Xie , Trevor Cohn , Jey Han Lau

Large Language Models (LLMs) are known to lack cultural representation and overall diversity in their generations, from expressing opinions to answering factual questions. To mitigate this problem, we propose multilingual prompting: a…

Computation and Language · Computer Science 2025-09-30 Qihan Wang , Shidong Pan , Tal Linzen , Emily Black

Large language models (LLMs) are increasingly expected to function as collaborative partners, engaging in back-and-forth dialogue to solve complex, ambiguous problems. However, current LLMs often falter in real-world settings, defaulting to…

Artificial Intelligence · Computer Science 2025-07-30 Tenghao Huang , Sihao Chen , Muhao Chen , Jonathan May , Longqi Yang , Mengting Wan , Pei Zhou

Despite the successes of large language models (LLMs), they exhibit significant drawbacks, particularly when processing long contexts. Their inference cost scales quadratically with respect to sequence length, making it expensive for…

Computation and Language · Computer Science 2024-07-22 Thomas Merth , Qichen Fu , Mohammad Rastegari , Mahyar Najibi

Large language models (LLMs), such as GPT-3 and GPT-4, have demonstrated exceptional performance in various natural language processing tasks and have shown the ability to solve certain reasoning problems. However, their reasoning…

Artificial Intelligence · Computer Science 2023-07-18 Adam Ishay , Zhun Yang , Joohyung Lee

Large language models (LLMs) have displayed an impressive ability to harness natural language to perform complex tasks. In this work, we explore whether we can leverage this learned ability to find and explain patterns in data.…

Machine Learning · Computer Science 2023-01-30 Chandan Singh , John X. Morris , Jyoti Aneja , Alexander M. Rush , Jianfeng Gao

Current soft prompt methods yield limited performance when applied to small-sized models (fewer than a billion parameters). Deep prompt-tuning, which entails prepending parameters in each layer for enhanced efficacy, presents a solution for…

Computation and Language · Computer Science 2024-04-02 Mingqi Li , Feng Luo

Prompting language models (LMs) is the main interface for applying them to new tasks. However, for smaller LMs, prompting provides low accuracy compared to gradient-based finetuning. Tree Prompting is an approach to prompting which builds a…

Computation and Language · Computer Science 2023-10-24 John X. Morris , Chandan Singh , Alexander M. Rush , Jianfeng Gao , Yuntian Deng

Large language models (LLMs) show impressive abilities via few-shot prompting. Commercialized APIs such as OpenAI GPT-3 further increase their use in real-world language applications. However, the crucial problem of how to improve the…

Computation and Language · Computer Science 2023-02-16 Chenglei Si , Zhe Gan , Zhengyuan Yang , Shuohang Wang , Jianfeng Wang , Jordan Boyd-Graber , Lijuan Wang

Soft prompts have been recently proposed as a tool for adapting large frozen language models (LMs) to new tasks. In this work, we repurpose soft prompts to the task of injecting world knowledge into LMs. We introduce a method to train soft…

Computation and Language · Computer Science 2022-10-11 Cicero Nogueira dos Santos , Zhe Dong , Daniel Cer , John Nham , Siamak Shakeri , Jianmo Ni , Yun-hsuan Sung

Generative large language models (LLMs), e.g., ChatGPT, have demonstrated remarkable proficiency across several NLP tasks, such as machine translation, text summarization. Recent research (Kocmi and Federmann, 2023) has shown that utilizing…

Computation and Language · Computer Science 2024-06-06 Qingyu Lu , Baopu Qiu , Liang Ding , Kanjian Zhang , Tom Kocmi , Dacheng Tao

Relevance modeling is a critical component for enhancing user experience in search engines, with the primary objective of identifying items that align with users' queries. Traditional models only rely on the semantic congruence between…

Information Retrieval · Computer Science 2024-12-09 Zeyuan Chen , Haiyan Wu , Kaixin Wu , Wei Chen , Mingjie Zhong , Jia Xu , Zhongyi Liu , Wei Zhang

Large language models (LLMs) have achieved remarkable success in a wide range of natural language processing tasks and can be adapted through prompting. However, they remain suboptimal in multi-turn interactions, often relying on incorrect…