中文
相关论文

相关论文: Principle-Driven Self-Alignment of Language Models…

200 篇论文

Instruction-based Large Language Models (LLMs) have proven effective in numerous few-shot or zero-shot Natural Language Processing (NLP) tasks. However, creating human-annotated instruction data is time-consuming, expensive, and often…

计算与语言 · 计算机科学 2025-05-13 Aniruddha Roy , Pretam Ray , Abhilash Nandy , Somak Aditya , Pawan Goyal

The performance of large language models (LLMs) depends on how they are prompted, with choices spanning both the high-level prompting pattern (e.g., Zero-Shot, CoT, ReAct, ReWOO) and the specific prompt content (instructions and few-shot…

机器学习 · 计算机科学 2025-11-05 Claudio Spiess , Mandana Vaziri , Louis Mandel , Martin Hirzel

The alignment problem in Large Language Models (LLMs) involves adapting them to the broad spectrum of human values. This requirement challenges existing alignment methods due to diversity of preferences and regulatory standards. This paper…

计算与语言 · 计算机科学 2024-02-28 Xinyu Lu , Bowen Yu , Yaojie Lu , Hongyu Lin , Haiyang Yu , Le Sun , Xianpei Han , Yongbin Li

The integration of large language models (LLMs) into education presents unprecedented opportunities for scalable personalized learning. However, standard LLMs often function as generic information providers, lacking alignment with…

机器学习 · 计算机科学 2025-07-29 Siyu Song , Wentao Liu , Ye Lu , Ruohua Zhang , Tao Liu , Jinze Lv , Xinyun Wang , Aimin Zhou , Fei Tan , Bo Jiang , Hao Hao

The pursuit of human-level artificial intelligence (AI) has significantly advanced the development of autonomous agents and Large Language Models (LLMs). LLMs are now widely utilized as decision-making agents for their ability to interpret…

Large Language Models (LLMs), when used in educational settings without pedagogical fine-tuning, often provide immediate answers rather than guiding students through the problem-solving process. This approach falls short of pedagogically…

计算与语言 · 计算机科学 2024-10-08 Shashank Sonkar , Kangqi Ni , Sapana Chaudhary , Richard G. Baraniuk

Large Language Models (LLMs) are increasingly being deployed as the reasoning engines for agentic AI systems, yet they exhibit a critical flaw: a rigid adherence to explicit rules that leads to decisions misaligned with human common sense…

人工智能 · 计算机科学 2025-10-16 Imran Khan

We introduce a multi-turn benchmark for evaluating personalised alignment in LLM-based AI assistants, focusing on their ability to handle user-provided safety-critical contexts. Our assessment of ten leading models across five scenarios…

人机交互 · 计算机科学 2025-01-31 Lize Alberts , Benjamin Ellis , Andrei Lupu , Jakob Foerster

AI-assisted decision making becomes increasingly prevalent, yet individuals often fail to utilize AI-based decision aids appropriately especially when the AI explanations are absent, potentially as they do not %understand reflect on AI's…

人机交互 · 计算机科学 2025-02-18 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ziang Xiao , Ming Yin

Aligning Large Language Models (LLMs) traditionally relies on costly training and human preference annotations. Self-alignment seeks to reduce these expenses by enabling models to align themselves. To further lower costs and achieve…

计算与语言 · 计算机科学 2024-11-15 Somanshu Singla , Zhen Wang , Tianyang Liu , Abdullah Ashfaq , Zhiting Hu , Eric P. Xing

AI sycophancy is increasingly recognized as a harmful alignment, but research remains fragmented and underdeveloped at the conceptual level. This article redefines AI sycophancy as the tendency of large language models (LLMs) and other…

人机交互 · 计算机科学 2025-09-29 Lihua Du , Xing Lyu , Lezi Xie , Bo Feng

Large Language Models (LLMs) are expected to produce safe, helpful, and honest content during interaction with human users, but they frequently fail to align with such values when given flawed instructions, e.g., missing context, ambiguous…

计算与语言 · 计算机科学 2025-08-07 Feifan Song , Bofei Gao , Yifan Song , Yi Liu , Weimin Xiong , Yuyang Song , Tianyu Liu , Guoyin Wang , Houfeng Wang

We propose a multi-agent framework for modeling artificial consciousness in large language models (LLMs), grounded in psychoanalytic theory. Our \textbf{Psychodynamic Model} simulates self-awareness, preconsciousness, and unconsciousness…

计算与语言 · 计算机科学 2025-10-22 Sang Hun Kim , Jongmin Lee , Dongkyu Park , So Young Lee , Yosep Chong

We study how well large language models (LLMs) explain their generations through rationales -- a set of tokens extracted from the input text that reflect the decision-making process of LLMs. Specifically, we systematically study rationales…

计算与语言 · 计算机科学 2024-10-23 Mohsen Fayyaz , Fan Yin , Jiao Sun , Nanyun Peng

Fine-tuning large language models for vertical domains remains labor-intensive, requiring practitioners to curate data, configure training, and iteratively diagnose model behavior. Despite growing interest in autonomous machine learning and…

人工智能 · 计算机科学 2026-05-21 Qizheng Li , Yifei Zhang , Xiao Yang , Xu Yang , Zhuo Wang , Weiqing Liu , Jiang Bian

Large language models (LLMs) often demonstrate inconsistencies with human preferences. Previous research typically gathered human preference data and then aligned the pre-trained models using reinforcement learning or instruction tuning,…

计算与语言 · 计算机科学 2023-10-10 Yuhui Li , Fangyun Wei , Jinjing Zhao , Chao Zhang , Hongyang Zhang

With the rise of large language models (LLMs), ensuring they embody the principles of being helpful, honest, and harmless (3H), known as Human Alignment, becomes crucial. While existing alignment methods like RLHF, DPO, etc., effectively…

计算与语言 · 计算机科学 2024-04-02 Shu Yang , Jiayuan Su , Han Jiang , Mengdi Li , Keyuan Cheng , Muhammad Asif Ali , Lijie Hu , Di Wang

Large Language Models (LLMs) are increasingly employed in software engineering tasks such as requirements elicitation, design, and evaluation, raising critical questions regarding their alignment with human judgments on responsible AI…

软件工程 · 计算机科学 2025-11-07 Asma Yamani , Malak Baslyman , Moataz Ahmed

By conditioning on natural language instructions, large language models (LLMs) have displayed impressive capabilities as general-purpose computers. However, task performance depends significantly on the quality of the prompt used to steer…

机器学习 · 计算机科学 2023-03-13 Yongchao Zhou , Andrei Ioan Muresanu , Ziwen Han , Keiran Paster , Silviu Pitis , Harris Chan , Jimmy Ba

Large language models (LLMs) can translate natural language instructions into executable action plans for robotics, autonomous driving, and other domains. Yet, deploying LLM-driven planning in the physical world demands strict adherence to…

机器人学 · 计算机科学 2026-05-27 Yunhao Yang , Junyuan Hong , Gabriel Jacob Perin , Zhiwen Fan , Li Yin , Zhangyang Wang , Ufuk Topcu