English
Related papers

Related papers: We Think, Therefore We Align LLMs to Helpful, Harm…

200 papers

Convex analysis is a modern branch of mathematics with many applications. As Large Language Models (LLMs) start to automate research-level math and sciences, it is important for LLMs to demonstrate the ability to understand and reason with…

Artificial Intelligence · Computer Science 2026-02-05 Yepeng Liu , Yu Huang , Yu-Xiang Wang , Yingbin Liang , Yuheng Bu

Large language models (LLMs) and large multimodal models (LMMs) have achieved unprecedented breakthrough, showcasing remarkable capabilities in natural language understanding, generation, and complex reasoning. This transformative potential…

Machine Learning · Computer Science 2025-10-24 Hyun Jong Yang , Hyunsoo Kim , Hyeonho Noh , Seungnyun Kim , Byonghyo Shim

Large language model alignment is widely used and studied to avoid LLM producing unhelpful and harmful responses. However, the lengthy training process and predefined preference bias hinder adaptation to online diverse human preferences. To…

Computation and Language · Computer Science 2024-05-02 Guanying Jiang , Lingyong Yan , Haibo Shi , Dawei Yin

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

Computation and Language · Computer Science 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

Recent research has increasingly focused on reconciling the reasoning capabilities of System 2 with the efficiency of System 1. While existing training-based and prompt-based approaches face significant challenges in terms of efficiency and…

Computation and Language · Computer Science 2025-11-17 Yuxuan Yao , Shuqi Liu , Zehua Liu , Qintong Li , Mingyang Liu , Xiongwei Han , Zhijiang Guo , Han Wu , Linqi Song

The acquisition of agentic capabilities has transformed LLMs from "knowledge providers" to "action executors", a trend that while expanding LLMs' capability boundaries, significantly increases their susceptibility to malicious use. Previous…

Cryptography and Security · Computer Science 2025-05-30 Jinchuan Zhang , Lu Yin , Yan Zhou , Songlin Hu

Despite being pretrained on multilingual corpora, large language models (LLMs) exhibit suboptimal performance on low-resource languages. Recent approaches have leveraged multilingual encoders alongside LLMs by introducing trainable…

Computation and Language · Computer Science 2025-02-18 Zhiwen Ruan , Yixia Li , He Zhu , Longyue Wang , Weihua Luo , Kaifu Zhang , Yun Chen , Guanhua Chen

Multi-objective alignment from human feedback (MOAHF) in large language models (LLMs) is a challenging problem as human preferences are complex, multifaceted, and often conflicting. Recent works on MOAHF considered a-priori multi-objective…

Machine Learning · Computer Science 2024-12-10 Subhojyoti Mukherjee , Anusha Lalitha , Sailik Sengupta , Aniket Deshmukh , Branislav Kveton

Aligning large language models (LLMs) with human values is crucial for safe deployment. Inference-time techniques offer granular control over generation; however, they rely on model uncertainty, meaning an internal estimate of how likely…

Computation and Language · Computer Science 2026-03-04 Mohammad Atif Quamar , Mohammad Areeb , Mikhail Kuznetsov , Muslum Ozgur Ozmen , Z. Berkay Celik

Harness engineering has emerged as an important inference-time technique for large language model (LLM) agents, aiming to improve long-term performance through task decomposition and guided execution. However, more elaborate harnesses are…

Machine Learning · Computer Science 2026-05-22 Boyuan Wang , Bochao Li , Minghan Wang , Yuxin Tao , Fang Kong

Large Language Models (LLMs) are prone to generating content that exhibits gender biases, raising significant ethical concerns. Alignment, the process of fine-tuning LLMs to better align with desired behaviors, is recognized as an effective…

Computation and Language · Computer Science 2024-12-17 Tao Zhang , Ziqian Zeng , Yuxiang Xiao , Huiping Zhuang , Cen Chen , James Foulds , Shimei Pan

Foundation models, e.g., large language models (LLMs), trained on internet-scale data possess zero-shot generalization capabilities that make them a promising technology towards detecting and mitigating out-of-distribution failure modes of…

Robotics · Computer Science 2024-07-12 Rohan Sinha , Amine Elhafsi , Christopher Agia , Matthew Foutter , Edward Schmerling , Marco Pavone

Large language models (LLMs) are increasingly deployed in real-world applications that require careful balancing of multiple, often conflicting, objectives, such as informativeness versus conciseness, or helpfulness versus creativity.…

Machine Learning · Computer Science 2025-08-12 Qiang He , Setareh Maghsudi

In early developmental contexts, particularly in parent-child interaction analysis, alignment involves families and professionals such as speech-language pathologists (SLPs) who interpret children's everyday interactions from different…

Human-Computer Interaction · Computer Science 2026-03-10 Weiyan Shi , Kenny Tsu Wei Choo

The importance of Reinforcement Learning from Human Feedback (RLHF) in aligning large language models (LLMs) with human values cannot be overstated. RLHF is a three-stage process that includes supervised fine-tuning (SFT), reward learning,…

Machine Learning · Computer Science 2025-05-27 Mudit Gaur , Amrit Singh Bedi , Raghu Pasupathy , Vaneet Aggarwal

Though large language models (LLMs) have enabled great success across a wide variety of tasks, they still appear to fall short of one of the loftier goals of artificial intelligence research: creating an artificial system that can adapt its…

Computation and Language · Computer Science 2026-05-04 Michael A. Lepori , Tal Linzen , Ann Yuan , Katja Filippova

Autonomous Driving Systems (ADSs) are revolutionizing transportation by reducing human intervention, improving operational efficiency, and enhancing safety. Large Language Models (LLMs) have been integrated into ADSs to support high-level…

Multiagent Systems · Computer Science 2025-10-15 Yaozu Wu , Dongyuan Li , Yankai Chen , Renhe Jiang , Henry Peng Zou , Wei-Chieh Huang , Yangning Li , Liancheng Fang , Zhen Wang , Philip S. Yu

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Autonomous vehicle navigation in complex environments such as dense and fast-moving highways and merging scenarios remains an active area of research. A key limitation of RL is its reliance on well-specified reward functions, which often…

Machine Learning · Computer Science 2025-11-18 Timur Anvar , Jeffrey Chen , Yuyan Wang , Rohan Chandra

Recent advancements in tool learning have enabled large language models (LLMs) to integrate external tools, enhancing their task performance by expanding their knowledge boundaries. However, relying on tools often introduces tradeoffs…

Computation and Language · Computer Science 2025-03-11 Hongshen Xu , Zihan Wang , Zichen Zhu , Lei Pan , Xingyu Chen , Lu Chen , Kai Yu