English
Related papers

Related papers: Language Models are Few-Shot Butlers

200 papers

Large Language Model (LLM) agents show great promise for complex, multi-turn tool-use tasks, but their development is often hampered by the extreme scarcity of high-quality training data. Supervised fine-tuning (SFT) on synthetic data leads…

Artificial Intelligence · Computer Science 2026-02-02 Siyuan Lu , Zechuan Wang , Hongxuan Zhang , Qintong Wu , Leilei Gan , Chenyi Zhuang , Jinjie Gu , Tao Lin

Language models (LLMs) offer potential as a source of knowledge for agents that need to acquire new task competencies within a performance environment. We describe efforts toward a novel agent capability that can construct cues (or…

Machine Learning · Computer Science 2022-11-22 James R. Kirk , Robert E. Wray , Peter Lindes , John E. Laird

Recent work has shown that augmenting environments with language descriptions improves policy learning. However, for environments with complex language abstractions, learning how to ground language to observations is difficult due to…

Machine Learning · Computer Science 2022-10-04 Victor Zhong , Jesse Mu , Luke Zettlemoyer , Edward Grefenstette , Tim Rocktäschel

Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than…

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

We present an efficient method of utilizing pretrained language models, where we learn selective binary masks for pretrained weights in lieu of modifying them through finetuning. Extensive evaluations of masking BERT and RoBERTa on a series…

Computation and Language · Computer Science 2020-10-13 Mengjie Zhao , Tao Lin , Fei Mi , Martin Jaggi , Hinrich Schütze

Language models pretrained on text from a wide variety of sources form the foundation of today's NLP. In light of the success of these broad-coverage models, we investigate whether it is still helpful to tailor a pretrained model to the…

Computation and Language · Computer Science 2020-05-07 Suchin Gururangan , Ana Marasović , Swabha Swayamdipta , Kyle Lo , Iz Beltagy , Doug Downey , Noah A. Smith

In recent years, pretrained language models have revolutionized the NLP world, while achieving state of the art performance in various downstream tasks. However, in many cases, these models do not perform well when labeled data is scarce…

Computation and Language · Computer Science 2022-04-06 Liat Ein-Dor , Ilya Shnayderman , Artem Spector , Lena Dankin , Ranit Aharonov , Noam Slonim

Large Language Models (LLMs) serve not only as chatbots but as key components in agent systems, where their common-sense knowledge significantly impacts performance as language-based planners for situated or embodied action. We assess LLMs'…

Computation and Language · Computer Science 2025-06-30 Jonathan Jordan , Sherzod Hakimov , David Schlangen

Transformer language models have received widespread public attention, yet their generated text is often surprising even to NLP researchers. In this survey, we discuss over 250 recent studies of English language model behavior before…

Computation and Language · Computer Science 2023-08-29 Tyler A. Chang , Benjamin K. Bergen

Large Language Models (LLMs), with their remarkable ability to tackle challenging and unseen reasoning problems, hold immense potential for tabular learning, that is vital for many real-world applications. In this paper, we propose a novel…

Machine Learning · Computer Science 2024-05-07 Sungwon Han , Jinsung Yoon , Sercan O Arik , Tomas Pfister

Large Language Model (LLM) Agents have recently garnered increasing interest yet they are limited in their ability to learn from trial and error, a key element of intelligent behavior. In this work, we argue that the capacity to learn new…

Artificial Intelligence · Computer Science 2024-08-09 Haiteng Zhao , Chang Ma , Guoyin Wang , Jing Su , Lingpeng Kong , Jingjing Xu , Zhi-Hong Deng , Hongxia Yang

Pretrained transformer-based language models have achieved state of the art across countless tasks in natural language processing. These models are highly expressive, comprising at least a hundred million parameters and a dozen layers.…

Computation and Language · Computer Science 2019-11-11 Jaejun Lee , Raphael Tang , Jimmy Lin

Large language models (LLMs) have demonstrated high performance on tasks expressed in natural language, particularly in zero- or few-shot settings. These are typically framed as supervised (e.g., classification) or unsupervised (e.g.,…

Computation and Language · Computer Science 2026-02-27 Yarik Menchaca Resendiz , Roman Klinger

Current literature demonstrates that Large Language Models (LLMs) are great few-shot learners, and prompting significantly increases their performance on a range of downstream tasks in a few-shot learning setting. An attempt to automate…

Computation and Language · Computer Science 2023-06-26 Yulin Zhou , Yiren Zhao , Ilia Shumailov , Robert Mullins , Yarin Gal

Pre-trained large language models have shown successful progress in many language understanding benchmarks. This work explores the capability of these models to predict actionable plans in real-world environments. Given a text instruction,…

Computation and Language · Computer Science 2022-05-31 Lajanugen Logeswaran , Yao Fu , Moontae Lee , Honglak Lee

In recent years, pre-trained large language models (LLMs) have demonstrated remarkable efficiency in achieving an inference-time few-shot learning capability known as in-context learning. However, existing literature has highlighted the…

Computation and Language · Computer Science 2024-02-14 Xinyi Wang , Wanrong Zhu , Michael Saxon , Mark Steyvers , William Yang Wang

Large language model (LLM) agents deployed for multi-step tasks frequently fail in predictable ways: attempting actions with unmet preconditions, issuing redundant commands, or mishandling environment constraints. While retrieval-augmented…

Artificial Intelligence · Computer Science 2025-10-03 Humaid Ibrahim , Nikolai Rozanov , Marek Rei

While large language models (LMs) have shown remarkable capabilities across numerous tasks, they often struggle with simple reasoning and planning in physical environments, such as understanding object permanence or planning household…

Computation and Language · Computer Science 2023-10-31 Jiannan Xiang , Tianhua Tao , Yi Gu , Tianmin Shu , Zirui Wang , Zichao Yang , Zhiting Hu

Large language models (LLMs) enable system builders today to create competent NLP systems through prompting, where they only need to describe the task in natural language and provide a few examples. However, in other ways, LLMs are a step…

Computation and Language · Computer Science 2023-08-24 Vijay Viswanathan , Chenyang Zhao , Amanda Bertsch , Tongshuang Wu , Graham Neubig