English
Related papers

Related papers: Assessing Generalization for Subpopulation Represe…

200 papers

Model-Based Reinforcement Learning (RL) is widely believed to have the potential to improve sample efficiency by allowing an agent to synthesize large amounts of imagined experience. Experience Replay (ER) can be considered a simple kind of…

Machine Learning · Computer Science 2023-07-11 Kenny Young , Aditya Ramesh , Louis Kirsch , Jürgen Schmidhuber

The success of AI assistants based on language models (LLMs) hinges crucially on Reinforcement Learning from Human Feedback (RLHF), which enables the generation of responses more aligned with human preferences. As universal AI assistants,…

Machine Learning · Computer Science 2023-12-27 Rui Zheng , Wei Shen , Yuan Hua , Wenbin Lai , Shihan Dou , Yuhao Zhou , Zhiheng Xi , Xiao Wang , Haoran Huang , Tao Gui , Qi Zhang , Xuanjing Huang

Large language models (LLMs) are increasingly used to simulate human opinions and survey responses, but their ability to reproduce population responses across cultures remains limited. Existing persona-based prompting methods typically rely…

Computation and Language · Computer Science 2026-05-18 Axel Abels , Elias Fernandez Domingos , Apurva Shah , Tom Lenaerts

Large language models (LLMs) have achieved promising results in sentiment analysis through the in-context learning (ICL) paradigm. However, their ability to distinguish subtle sentiments still remains a challenge. Inspired by the human…

Computation and Language · Computer Science 2024-06-06 Hongling Xu , Qianlong Wang , Yice Zhang , Min Yang , Xi Zeng , Bing Qin , Ruifeng Xu

Machine learning can predict human behavior well when substantial structured data and well-defined outcomes are available, but these models are typically limited to specific outcomes and cannot readily be applied to new domains. We test…

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

Machine Learning · Computer Science 2025-05-26 Yun-Da Tsai

With approximately 7,000 languages spoken worldwide, current large language models (LLMs) support only a small subset. Prior research indicates LLMs can learn new languages for certain tasks without supervised data. We extend this…

Computation and Language · Computer Science 2026-01-29 Zhaolin Li , Jan Niehues

The ability of generative large language models (LLMs) to perform in-context learning has given rise to a large body of research into how best to prompt models for various natural language processing tasks. In this paper, we focus on…

Computation and Language · Computer Science 2024-08-02 Armel Zebaze , Benoît Sagot , Rachel Bawden

Despite empirical risk minimization (ERM) is widely applied in the machine learning community, its performance is limited on data with spurious correlation or subpopulation that is introduced by hidden attributes. Existing literature…

Machine Learning · Computer Science 2024-12-18 Hongyu Shen , Zhizhen Zhao

We investigate how well large language models (LLMs) generalize across different task difficulties, a key question for effective data curation and evaluation. Existing research is mixed regarding whether training on easier or harder data…

Computation and Language · Computer Science 2025-11-27 Yeganeh Kordi , Nihal V. Nayak , Max Zuo , Ilana Nguyen , Stephen H. Bach

Large Language Models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities from few-shot demonstration exemplars. While recent learning-based demonstration selection methods have proven beneficial to ICL by choosing…

Machine Learning · Computer Science 2024-10-16 Hui Liu , Wenya Wang , Hao Sun , Chris Xing Tian , Chenqi Kong , Xin Dong , Haoliang Li

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

Large language models (LLMs) have demonstrated their ability to learn in-context, allowing them to perform various tasks based on a few input-output examples. However, the effectiveness of in-context learning is heavily reliant on the…

Computation and Language · Computer Science 2024-01-29 Liang Wang , Nan Yang , Furu Wei

Summarization is a core task in Natural Language Processing (NLP). Recent advances in Large Language Models (LLMs) and the introduction of large context windows reaching millions of tokens make it possible to process entire books in a…

Computation and Language · Computer Science 2026-03-12 Tairan Fu , Javier Conde , Pedro Reviriego , Javier Coronado-Blázquez , Nina Melero , Elena Merino-Gómez

Generating unbiased summaries in real-world settings such as political perspective summarization remains a crucial application of Large Language Models (LLMs). Yet, existing evaluation frameworks rely on traditional metrics for measuring…

Computation and Language · Computer Science 2025-06-23 Narutatsu Ri , Nicholas Deas , Kathleen McKeown

Large language models (LLMs) are increasingly being deployed in high-stakes applications like hiring, yet their potential for unfair decision-making remains understudied in generative and retrieval settings. In this work, we examine the…

Computation and Language · Computer Science 2025-09-05 Preethi Seshadri , Hongyu Chen , Sameer Singh , Seraphina Goldfarb-Tarrant

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

Artificial Intelligence · Computer Science 2026-01-13 Pranav Kallem

Large language models (LMs) are able to in-context learn -- perform a new task via inference alone by conditioning on a few input-label pairs (demonstrations) and making predictions for new inputs. However, there has been little…

Computation and Language · Computer Science 2022-10-21 Sewon Min , Xinxi Lyu , Ari Holtzman , Mikel Artetxe , Mike Lewis , Hannaneh Hajishirzi , Luke Zettlemoyer

What makes large language models (LLMs) impressive is also what makes them hard to evaluate: their diversity of uses. To evaluate these models, we must understand the purposes they will be used for. We consider a setting where these…

Computation and Language · Computer Science 2024-06-04 Keyon Vafa , Ashesh Rambachan , Sendhil Mullainathan

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

Computation and Language · Computer Science 2025-06-03 Zeping Min , Jinbo Wang