English
Related papers

Related papers: WeChat-YATT: A Scalable, Simple, Efficient, and Pr…

200 papers

Reinforcement Learning from Human Feedback (RLHF) has enabled significant advancements within language modeling for powerful, instruction-following models. However, the alignment of these models remains a pressing challenge as the policy…

Machine Learning · Computer Science 2024-06-21 Ahmed M. Ahmed , Rafael Rafailov , Stepan Sharkov , Xuechen Li , Sanmi Koyejo

The scaling up of deep neural networks has been demonstrated to be effective in improving model quality, but also encompasses several training challenges in terms of training efficiency, programmability, and resource adaptability. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-07 Xianyan Jia , Le Jiang , Ang Wang , Wencong Xiao , Ziji Shi , Jie Zhang , Xinyuan Li , Langshi Chen , Yong Li , Zhen Zheng , Xiaoyong Liu , Wei Lin

Existing approaches to language model alignment often treat safety as a tradeoff against helpfulness, which can lead to unacceptable responses in sensitive domains. To ensure reliable performance in such settings, we propose High-Confidence…

Machine Learning · Computer Science 2025-06-11 Yaswanth Chittepu , Blossom Metevier , Will Schwarzer , Austin Hoag , Scott Niekum , Philip S. Thomas

Reinforcement Learning from Human Feedback (RLHF) has shown potential in qualitative tasks where easily defined performance measures are lacking. However, there are drawbacks when RLHF is commonly used to optimize for average human…

Artificial Intelligence · Computer Science 2024-06-05 Li Ding , Jenny Zhang , Jeff Clune , Lee Spector , Joel Lehman

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential for structured data,…

Machine Learning · Computer Science 2026-03-02 Tao Zhe , Huazhen Fang , Kunpeng Liu , Qian Lou , Tamzidul Hoque , Dongjie Wang

Modern RL-based post-training for large language models (LLMs) co-locate trajectory sampling and policy optimisation on the same GPU cluster, forcing the system to switch between inference and training workloads. This serial context…

Machine Learning · Computer Science 2025-08-13 Jie Xiao , Changyuan Fan , Qingnan Ren , Alfred Long , Yuchen Zhang , Rymon Yu , Eric Yang , Lynn Ai , Shaoduo Gan

Reinforcement Learning from Human Feedback (RLHF) is widely used for aligning large language models, yet practitioners face a persistent puzzle: improving safety often reduces fairness, scaling to diverse populations becomes computationally…

Machine Learning · Computer Science 2025-11-26 Subramanyam Sahoo , Aman Chadha , Vinija Jain , Divya Chaudhary

In recent developments within the research community, the integration of Large Language Models (LLMs) in creating fully autonomous agents has garnered significant interest. Despite this, LLM-based agents frequently demonstrate notable…

Computation and Language · Computer Science 2024-02-21 Xueyang Feng , Zhi-Yuan Chen , Yujia Qin , Yankai Lin , Xu Chen , Zhiyuan Liu , Ji-Rong Wen

Reinforcement learning from human feedback (RLHF) has emerged as a key technique for aligning the output of large language models (LLMs) with human preferences. To learn the reward function, most existing RLHF algorithms use the…

Machine Learning · Statistics 2026-02-11 Kai Ye , Hongyi Zhou , Jin Zhu , Francesco Quinzan , Chengchun Shi

Reinforcement Learning with Human Feedback (RLHF) is the most prominent method for Language Model (LM) alignment. However, RLHF is an unstable and data-hungry process that continually requires new high-quality LM-generated data for…

Computation and Language · Computer Science 2024-04-23 Ashutosh Baheti , Ximing Lu , Faeze Brahman , Ronan Le Bras , Maarten Sap , Mark Riedl

In this paper we present our open-source neural machine translation (NMT) toolkit called "Yet Another Neural Machine Translation Toolkit" abbreviated as YANMTT which is built on top of the Transformers library. Despite the growing…

Computation and Language · Computer Science 2021-08-26 Raj Dabre , Eiichiro Sumita

Recent advances in vision-language-action (VLA) models have motivated the extension of their capabilities to embodied settings, where reinforcement learning (RL) offers a principled way to optimize task success through interaction. However,…

Traditional reinforcement learning from human feedback (RLHF) for large language models (LLMs) relies on expensive human-annotated datasets, while Reinforcement Learning from AI Feedback (RLAIF) also incurs significant costs, requiring the…

Computation and Language · Computer Science 2025-10-09 Shangjian Yin , Zhepei Wei , Xinyu Zhu , Wei-Lin Chen , Yu Meng

Aligning human preference and value is an important requirement for contemporary foundation models. State-of-the-art techniques such as Reinforcement Learning from Human Feedback (RLHF) often consist of two stages: 1) supervised fine-tuning…

Artificial Intelligence · Computer Science 2024-10-29 Jiaxiang Li , Siliang Zeng , Hoi-To Wai , Chenliang Li , Alfredo Garcia , Mingyi Hong

Reinforcement learning from human feedback (RLHF) has evolved to be one of the main methods for fine-tuning large language models (LLMs). However, existing RLHF methods are non-robust, and their performance deteriorates if the downstream…

Machine Learning · Computer Science 2025-03-04 Debmalya Mandal , Paulius Sasnauskas , Goran Radanovic

Large language models (LLMs) trained via pretraining and supervised fine-tuning (SFT) can still produce harmful and misaligned outputs, or struggle in domains like math and coding. Reinforcement learning (RL)-based post-training methods,…

Computation and Language · Computer Science 2026-05-19 Zhichao Wang , Kiran Ramnath , Bin Bi , Shiva Kumar Pentyala , Sougata Chaudhuri , Shubham Mehrotra , Zixu , Zhu , Xiang-Bo Mao , Sitaram Asur , Na , Cheng

Great success has been reported using Reinforcement Learning from Human Feedback (RLHF) to align large language models, with open preference datasets enabling wider experimentation, particularly for "helpfulness" in tasks like dialogue and…

Computation and Language · Computer Science 2024-07-12 Prasann Singhal , Tanya Goyal , Jiacheng Xu , Greg Durrett

The inherent uncertainty in the environmental transition model of Reinforcement Learning (RL) necessitates a delicate balance between exploration and exploitation. This balance is crucial for optimizing computational resources to accurately…

Machine Learning · Computer Science 2025-05-21 Yongxin Deng , Xihe Qiu , Jue Chen , Xiaoyu Tan

Reinforcement Learning from Human Feedback (RLHF) is widely used to align Language Models (LMs) with human preferences. However, existing approaches often neglect individual user preferences, leading to suboptimal personalization. We…

Machine Learning · Computer Science 2024-10-21 Allison Lau , Younwoo Choi , Vahid Balazadeh , Keertana Chidambaram , Vasilis Syrgkanis , Rahul G. Krishnan

One core capability of large language models (LLMs) is to follow natural language instructions. However, the issue of automatically constructing high-quality training data to enhance the complex instruction-following abilities of LLMs…

Computation and Language · Computer Science 2024-07-19 Guanting Dong , Keming Lu , Chengpeng Li , Tingyu Xia , Bowen Yu , Chang Zhou , Jingren Zhou