English
Related papers

Related papers: Adaptive alert prioritisation in security operatio…

200 papers

Reinforcement learning from human feedback (RLHF) has become a cornerstone of the training and alignment pipeline for large language models (LLMs). Recent advances, such as direct preference optimization (DPO), have simplified the…

Artificial Intelligence · Computer Science 2025-03-31 Syrine Belakaria , Joshua Kazdan , Charles Marx , Chris Cundy , Willie Neiswanger , Sanmi Koyejo , Barbara E. Engelhardt , Stefano Ermon

Distributed trajectory optimization via ADMM-DDP is a powerful approach for coordinating multi-agent systems, but it requires extensive tuning of tightly coupled hyperparameters that jointly govern local task performance and global…

Machine Learning · Computer Science 2025-09-08 Bingheng Wang , Yichao Gao , Tianchen Sun , Lin Zhao

Preference-based alignment like Reinforcement Learning from Human Feedback (RLHF) learns from pairwise preferences, yet the labels are often noisy and inconsistent. Existing uncertainty-aware approaches weight preferences, but ignore a more…

Machine Learning · Computer Science 2026-01-27 Tiejin Chen , Xiaoou Liu , Vishnu Nandam , Kuan-Ru Liou , Hua Wei

Reinforcement Learning from Human Feedback (RLHF) is a crucial technique for aligning language models with human preferences, playing a pivotal role in the success of conversational models like GPT-4, ChatGPT, and Llama 2. A core challenge…

Computation and Language · Computer Science 2025-06-04 Chenghua Huang , Zhizhen Fan , Lu Wang , Fangkai Yang , Pu Zhao , Zeqi Lin , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

Reinforcement Learning from Human Feedback (RLHF) remains vulnerable to reward hacking, where models exploit spurious correlations in learned reward models to achieve high scores while violating human intent. Existing mitigations rely on…

Artificial Intelligence · Computer Science 2026-02-03 Mohammad Beigi , Ming Jin , Junshan Zhang , Qifan Wang , Lifu Huang

Predicting high-fidelity future human poses, from a historically observed sequence, is decisive for intelligent robots to interact with humans. Deep end-to-end learning approaches, which typically train a generic pre-trained model on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Qiongjie Cui , Huaijiang Sun , Jianfeng Lu , Bin Li , Weiqing Li

RLHF has emerged as a predominant approach for aligning artificial intelligence systems with human preferences, demonstrating exceptional and measurable efficacy in instruction following tasks; however, it exhibits insufficient compliance…

Artificial Intelligence · Computer Science 2025-05-20 Ruopei Sun , Jianfeng Cai , Jinhua Zhu , Kangwen Zhao , Dongyun Xue , Wengang Zhou , Li Li , Houqiang Li

Reinforcement Learning from Human Feedback (RLHF) is a powerful paradigm for aligning foundation models to human values and preferences. However, current RLHF techniques cannot account for the naturally occurring differences in individual…

Machine Learning · Computer Science 2024-08-20 Sriyash Poddar , Yanming Wan , Hamish Ivison , Abhishek Gupta , Natasha Jaques

Reinforcement Learning from Human Feedback (RLHF) has emerged as a powerful technique for aligning large language models (LLMs) with human preferences. However, effectively aligning LLMs with diverse human preferences remains a significant…

Computation and Language · Computer Science 2025-07-03 Chengao Li , Hanyu Zhang , Yunkun Xu , Hongyan Xue , Xiang Ao , Qing He

Adaptive traffic signal control (ATSC) is essential for mitigating urban congestion in modern smart cities, where traffic infrastructure is evolving into interconnected Web-of-Things (WoT) environments with thousands of sensing-and-control…

Machine Learning · Computer Science 2026-03-23 Yaqiao Zhu , Hongkai Wen , Geyong Min , Man Luo

With the rise of large language models (LLMs), ensuring they embody the principles of being helpful, honest, and harmless (3H), known as Human Alignment, becomes crucial. While existing alignment methods like RLHF, DPO, etc., effectively…

Computation and Language · Computer Science 2024-04-02 Shu Yang , Jiayuan Su , Han Jiang , Mengdi Li , Keyuan Cheng , Muhammad Asif Ali , Lijie Hu , Di Wang

Current audio captioning relies on supervised learning with paired audio-caption data, which is costly to curate and may not reflect human preferences in real-world scenarios. To address this, we propose a preference-aligned audio…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-26 Kartik Hegde , Rehana Mahfuz , Yinyi Guo , Erik Visser

Reliable transmission of 3D point clouds over wireless channels is challenging due to time-varying signal-to-noise ratio (SNR) and limited bandwidth. This paper introduces sensitivity-aware filtering and transmission (SAFT), a learned…

Information Theory · Computer Science 2026-03-30 Huda Adam Sirag Mekki , Hui Yuan , Mohanad M. G. Hassan , Zejia Chen , Guanghui Zhang

Aligning AI agents to human intentions and values is a key bottleneck in building safe and deployable AI applications. But whose values should AI agents be aligned with? Reinforcement learning with human feedback (RLHF) has emerged as the…

Artificial Intelligence · Computer Science 2023-10-25 Abhilash Mishra

State-of-the-art large language models (LLMs) have become indispensable tools for various tasks. However, training LLMs to serve as effective assistants for humans requires careful consideration. A promising approach is reinforcement…

Human-AI collaboration requires agents that can adapt to diverse partner behaviors and skill levels while remaining robust to unseen partners. Existing methods often collapse to a single dominant behavior or learn poorly aligned skills,…

Artificial Intelligence · Computer Science 2026-05-26 Adnan Ahmad , Bahareh Nakisa , Mohammad Naim Rastgoo

Reinforcement Learning from Human Feedback (RLHF) has become a crucial technology for aligning language models with human values and intentions, enabling models to produce more helpful and harmless responses. Reward models are trained as…

As artificial intelligence (AI) becomes deeply integrated into critical infrastructures and everyday life, ensuring its safe deployment is one of humanity's most urgent challenges. Current AI models prioritize task optimization over safety,…

Artificial Intelligence · Computer Science 2024-11-08 Joshua T. S. Hewson

Due to real-world dynamics and hardware uncertainty, robots inevitably fail in task executions, resulting in undesired or even dangerous executions. In order to avoid failures and improve robot performance, it is critical to identify and…

Robotics · Computer Science 2021-06-30 Boyi Song , Yuntao Peng , Ruijiao Luo , Rui Liu

With the widespread application of Large Language Models (LLMs), it has become a significant concern to ensure their safety and prevent harmful responses. While current safe-alignment methods based on instruction fine-tuning and…

Computation and Language · Computer Science 2025-12-16 Xiaoyun Zhang , Zhengyue Zhao , Wenxuan Shi , Kaidi Xu , Di Huang , Xing Hu