English
Related papers

Related papers: ICLEF: In-Context Learning with Expert Feedback fo…

200 papers

We introduce CLEAR (Contrasting Textual Feedback with Experts and Amateurs for Reasoning), a novel approach to language model reasoning that leverages the strengths of a larger (expert) model and smaller (amateur) model. The expert and…

Computation and Language · Computer Science 2025-04-11 Andrew Rufail , Daniel Kim , Sean O'Brien , Kevin Zhu

Reinforcement learning with verifiable rewards has been used to elicit impressive performance from language models in many domains. But, broadly beneficial deployments of AI may require us to train models with strong capabilities in…

Machine Learning · Computer Science 2026-05-07 Christine Ye , Joe Benton

In-context learning (ICL) performs tasks by prompting a large language model (LLM) using an instruction and a small set of annotated examples called demonstrations. Recent work has shown that precise details of the inputs used in the ICL…

Computation and Language · Computer Science 2023-07-18 Anirudh Ajith , Chris Pan , Mengzhou Xia , Ameet Deshpande , Karthik Narasimhan

Large language models (LLMs) have increased the demand for personalized and stylish content generation. However, closed-source models like GPT-4 present limitations in optimization opportunities, while the substantial training costs and…

Computation and Language · Computer Science 2024-10-07 Chenning Xu , Fangxun Shu , Dian Jin , Jinghao Wei , Hao Jiang

Large language models (LLMs) struggle to consistently generate UI code that compiles and produces visually relevant designs. Existing approaches to improve generation rely on expensive human feedback or distilling a proprietary model. In…

Computation and Language · Computer Science 2024-06-13 Jason Wu , Eldon Schoop , Alan Leung , Titus Barik , Jeffrey P. Bigham , Jeffrey Nichols

High-quality instruction-tuning data is crucial for developing Large Language Models (LLMs) that can effectively navigate real-world tasks and follow human instructions. While synthetic data generation offers a scalable approach for…

Computation and Language · Computer Science 2025-10-14 Shuhaib Mehri , Xiusi Chen , Heng Ji , Dilek Hakkani-Tür

Large language models (LLMs) have shown the emergent capability of in-context learning (ICL). One line of research has claimed that ICL is functionally equivalent to gradient descent, a type of error-driven learning mechanism. In this…

Computation and Language · Computer Science 2025-05-08 Zhenghao Zhou , Robert Frank , R. Thomas McCoy

In-Context Learning (ICL) enables transformer-based language models to adapt to new tasks by conditioning on demonstration examples. However, traditional example-driven in-context learning lacks explicit modules for knowledge retrieval and…

Computation and Language · Computer Science 2026-03-31 Pan Chen , Shaohong Chen , Mark Wang , Shi Xuan Leong , Priscilla Fung , Varinia Bernales , Alan Aspuru-Guzik

Interpretability and human oversight are fundamental pillars of deploying complex NLP models into real-world applications. However, applying explainability and human-in-the-loop methods requires technical proficiency. Despite existing…

Computation and Language · Computer Science 2023-10-03 Edoardo Mosca , Daryna Dementieva , Tohid Ebrahim Ajdari , Maximilian Kummeth , Kirill Gringauz , Yutong Zhou , Georg Groh

There is an unmet need to evaluate the language difficulty of short, conversational passages of text, particularly for training and filtering Large Language Models (LLMs). We introduce Ace-CEFR, a dataset of English conversational text…

Computation and Language · Computer Science 2025-06-18 David Kogan , Max Schumacher , Sam Nguyen , Masanori Suzuki , Melissa Smith , Chloe Sophia Bellows , Jared Bernstein

Fine-tuning and in-context learning (ICL) are two prevalent methods in imbuing large language models with task-specific knowledge. It is commonly believed that fine-tuning can surpass ICL given sufficient training samples as it allows the…

Machine Learning · Computer Science 2024-10-08 Qingyu Yin , Xuzheng He , Luoao Deng , Chak Tou Leong , Fan Wang , Yanzhao Yan , Xiaoyu Shen , Qiang Zhang

There is increasing interest in distilling task-specific knowledge from large language models (LLM) to smaller student models. Nonetheless, LLM distillation presents a dual challenge: 1) there is a high cost associated with querying the…

Computation and Language · Computer Science 2024-06-11 Yuhang Zhou , Wei Ai

We study the phenomenon of \textit{in-context learning} (ICL) exhibited by large language models, where they can adapt to a new learning task, given a handful of labeled examples, without any explicit parameter optimization. Our goal is to…

Machine Learning · Computer Science 2023-05-29 Jacob Abernethy , Alekh Agarwal , Teodor V. Marinov , Manfred K. Warmuth

Recent research has explored using Large Language Models for recommendation tasks by transforming user interaction histories and item metadata into text prompts, then having the LLM produce rankings or recommendations. A promising approach…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , LuYao Liu , Simon Lau , Chandler Yuan , and XueY Cui , Rosie Zhang

Large Language Models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities from few-shot demonstration exemplars. While recent learning-based demonstration selection methods have proven beneficial to ICL by choosing…

Machine Learning · Computer Science 2024-10-16 Hui Liu , Wenya Wang , Hao Sun , Chris Xing Tian , Chenqi Kong , Xin Dong , Haoliang Li

In-context learning (ICL) refers to the process of adding a small number of localized examples from a training set of labelled data to an LLM's prompt with an objective to effectively control the generative process seeking to improve the…

Computation and Language · Computer Science 2025-01-22 Manish Chandra , Debasis Ganguly , Iadh Ounis

In-Context Learning (ICL) enables large language models (LLMs) to achieve rapid task adaptation by learning from demonstrations. With the increase in available context length of LLMs, recent experiments have shown that the performance of…

Computation and Language · Computer Science 2024-08-27 Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Heda Wang , Yao Hu , Kan Li

The rapid growth of Large Language Models (LLMs) usage has highlighted the importance of gradient-free in-context learning (ICL). However, interpreting their inner workings remains challenging. This paper introduces a novel multimodal…

Computation and Language · Computer Science 2024-08-26 Yosuke Miyanishi , Minh Le Nguyen

Education that suits the individual learning level is necessary to improve students' understanding. The first step in achieving this purpose by using large language models (LLMs) is to adjust the textual difficulty of the response to…

Computation and Language · Computer Science 2024-02-23 Seiji Gobara , Hidetaka Kamigaito , Taro Watanabe

Explainable recommendation has demonstrated significant advantages in informing users about the logic behind recommendations, thereby increasing system transparency, effectiveness, and trustworthiness. To provide personalized and…

Information Retrieval · Computer Science 2025-02-19 Yuhan Li , Xinni Zhang , Linhao Luo , Heng Chang , Yuxiang Ren , Irwin King , Jia Li