English
Related papers

Related papers: Training language models to follow instructions wi…

200 papers

Interaction with Large Language Models (LLMs) is primarily carried out via prompting. A prompt is a natural language instruction designed to elicit certain behaviour or output from a model. In theory, natural language prompts enable…

Human-Computer Interaction · Computer Science 2024-03-15 Michael Desmond , Michelle Brachman

Reinforcement learning has seen wide success in finetuning large language models to better align with instructions via human feedback. The so-called algorithm, Reinforcement Learning with Human Feedback (RLHF) demonstrates impressive…

Computation and Language · Computer Science 2023-02-13 Tianjun Zhang , Fangchen Liu , Justin Wong , Pieter Abbeel , Joseph E. Gonzalez

Random Number Generation Tasks (RNGTs) are used in psychology for examining how humans generate sequences devoid of predictable patterns. By adapting an existing human RNGT for an LLM-compatible environment, this preliminary study tests…

Artificial Intelligence · Computer Science 2024-08-21 Rachel M. Harrison

Instruction-tuned large language models have revolutionized natural language processing and have shown great potential in applications such as conversational agents. These models, such as GPT-4, can not only master language but also solve…

Computation and Language · Computer Science 2023-06-16 Yew Ken Chia , Pengfei Hong , Lidong Bing , Soujanya Poria

The emergence of powerful LLMs has led to a paradigm shift in Natural Language Understanding and Natural Language Generation. The properties that make LLMs so valuable for these tasks -- creativity, ability to produce fluent speech, and…

Computation and Language · Computer Science 2025-03-10 Kelsey Kraus , Margaret Kroll

Large Language Models, such as Generative Pre-trained Transformer 3 (aka. GPT-3), have been developed to understand language through the analysis of extensive text data, allowing them to identify patterns and connections between words.…

Computation and Language · Computer Science 2023-10-03 Baphumelele Masikisiki , Vukosi Marivate , Yvette Hlope

Automated coaching messages for weight control can save time and costs, but their repetitive, generic nature may limit their effectiveness compared to human coaching. Large language model (LLM) based artificial intelligence (AI) chatbots,…

Computation and Language · Computer Science 2025-02-25 Zhuoran Huang , Michael P. Berry , Christina Chwyl , Gary Hsieh , Jing Wei , Evan M. Forman

Aligning Large Language Models (LLMs) with human intentions and values is crucial yet challenging. Current methods primarily rely on human preferences, which are costly and insufficient in capturing nuanced feedback expressed in natural…

Computation and Language · Computer Science 2024-06-12 Chi Hu , Yimin Hu , Hang Cao , Tong Xiao , Jingbo Zhu

Large language models (LLMs) show impressive abilities via few-shot prompting. Commercialized APIs such as OpenAI GPT-3 further increase their use in real-world language applications. However, the crucial problem of how to improve the…

Computation and Language · Computer Science 2023-02-16 Chenglei Si , Zhe Gan , Zhengyuan Yang , Shuohang Wang , Jianfeng Wang , Jordan Boyd-Graber , Lijuan Wang

The increased presence of large language models (LLMs) in educational settings has ignited debates concerning negative repercussions, including overreliance and inadequate task reflection. Our work advocates moderated usage of such models,…

Large language models (LLMs) have shown impressive success in various applications. However, these models are often not well aligned with human intents, which calls for additional treatments on them; that is, the alignment problem. To make…

Computation and Language · Computer Science 2024-06-24 Jiale Cheng , Xiao Liu , Kehan Zheng , Pei Ke , Hongning Wang , Yuxiao Dong , Jie Tang , Minlie Huang

Large Language Models (LLMs) are so powerful that they sometimes learn correlations between labels and features that are irrelevant to the task, leading to poor generalization on out-of-distribution data. We propose explanation-based…

Computation and Language · Computer Science 2023-06-07 Josh Magnus Ludan , Yixuan Meng , Tai Nguyen , Saurabh Shah , Qing Lyu , Marianna Apidianaki , Chris Callison-Burch

As AI becomes more integral in our lives, the need for transparency and responsibility grows. While natural language explanations (NLEs) are vital for clarifying the reasoning behind AI decisions, evaluating them through human judgments is…

Computation and Language · Computer Science 2024-03-27 Fan Huang , Haewoon Kwak , Kunwoo Park , Jisun An

Language models (LMs) often exhibit undesirable text generation behaviors, including generating false, toxic, or irrelevant outputs. Reinforcement learning from human feedback (RLHF) - where human preference judgments on LM outputs are…

Computation and Language · Computer Science 2023-10-31 Zeqiu Wu , Yushi Hu , Weijia Shi , Nouha Dziri , Alane Suhr , Prithviraj Ammanabrolu , Noah A. Smith , Mari Ostendorf , Hannaneh Hajishirzi

Large Language Models have been demonstrating broadly satisfactory generative abilities for users, which seems to be due to the intensive use of human feedback that refines responses. Nevertheless, suggestibility inherited via human…

Computation and Language · Computer Science 2025-06-26 Leonardo Ranaldi , Giulia Pucci

Large Language Models (LLMs), particularly those similar to ChatGPT, have significantly influenced the field of Natural Language Processing (NLP). While these models excel in general language tasks, their performance in domain-specific…

Computation and Language · Computer Science 2024-01-02 Omid Rohanian , Mohammadmahdi Nouriborji , David A. Clifton

We introduce Language Feedback Models (LFMs) that identify desirable behaviour - actions that help achieve tasks specified in the instruction - for imitation learning in instruction following. To train LFMs, we obtain feedback from Large…

Machine Learning · Computer Science 2024-10-11 Victor Zhong , Dipendra Misra , Xingdi Yuan , Marc-Alexandre Côté

Large language models (LLMs) often struggle to learn from corrective feedback within a conversational context. They are rarely proactive in soliciting this feedback, even when faced with ambiguity, which can make their dialogues feel…

Computation and Language · Computer Science 2026-02-19 Jonathan Cook , Diego Antognini , Martin Klissarov , Claudiu Musat , Edward Grefenstette

The rapid advancement of Large Language Models (LLMs) has revolutionized various sectors by automating routine tasks, marking a step toward the realization of Artificial General Intelligence (AGI). However, they still struggle to…

Machine Learning · Computer Science 2024-02-21 Zihao Tang , Zheqi Lv , Shengyu Zhang , Fei Wu , Kun Kuang

Relevance labels, which indicate whether a search result is valuable to a searcher, are key to evaluating and optimising search systems. The best way to capture the true preferences of users is to ask them for their careful feedback on…

Information Retrieval · Computer Science 2024-05-20 Paul Thomas , Seth Spielman , Nick Craswell , Bhaskar Mitra