中文
相关论文

相关论文: Entropy-Based Measurement of Value Drift and Align…

200 篇论文

The translation of written language has been known since the 3rd century BC; however, its necessity has become increasingly common in the information age. Today, many translators exist, based on encoder-decoder deep architectures,…

计算与语言 · 计算机科学 2025-11-18 Ronit D. Gross , Yanir Harel , Ido Kanter

Larger language models (LLMs) have taken the world by storm with their massive multi-tasking capabilities simply by optimizing over a next-word prediction objective. With the emergence of their properties and encoded knowledge, the risk of…

计算与语言 · 计算机科学 2023-08-31 Rishabh Bhardwaj , Soujanya Poria

As AI systems become embedded in real-world applications, ensuring they meet ethical standards is crucial. While existing AI ethics frameworks emphasize fairness, transparency, and accountability, they often lack actionable evaluation…

人工智能 · 计算机科学 2025-05-02 Sumit Verma , Pritam Prasun , Arpit Jaiswal , Pritish Kumar

Large language models (LLMs) rely on safety alignment to avoid responding to malicious user inputs. Unfortunately, jailbreak can circumvent safety guardrails, resulting in LLMs generating harmful content and raising concerns about LLM…

计算与语言 · 计算机科学 2024-06-14 Zhenhong Zhou , Haiyang Yu , Xinghua Zhang , Rongwu Xu , Fei Huang , Yongbin Li

This paper explores the integration of human-like emotions and ethical considerations into Large Language Models (LLMs). We first model eight fundamental human emotions, presented as opposing pairs, and employ collaborative LLMs to…

计算与语言 · 计算机科学 2024-06-26 Edward Y. Chang

Large Language Models (LLMs) are increasingly deployed to automatically label and analyze educational dialogue at scale, yet current pipelines lack reliable ways to detect when models are wrong. We investigate whether reasoning generated by…

计算与语言 · 计算机科学 2026-02-11 Bakhtawar Ahtisham , Kirk Vanacore , Zhuqian Zhou , Jinsook Lee , Rene F. Kizilcec

As Large Language Models (LLMs) become increasingly integrated into real-world decision-making systems, understanding their behavioural vulnerabilities remains a critical challenge for AI safety and alignment. While existing evaluation…

人工智能 · 计算机科学 2025-05-20 Lili Zhang , Haomiaomiao Wang , Long Cheng , Libao Deng , Tomas Ward

Text watermarking algorithms for large language models (LLMs) can effectively identify machine-generated texts by embedding and detecting hidden features in the text. Although the current text watermarking algorithms perform well in most…

计算与语言 · 计算机科学 2024-06-11 Yijian Lu , Aiwei Liu , Dianzhi Yu , Jingjing Li , Irwin King

To guarantee safe and robust deployment of large language models (LLMs) at scale, it is critical to accurately assess their adversarial robustness. Existing adversarial attacks typically target harmful responses in single-point greedy…

机器学习 · 计算机科学 2026-02-24 Tim Beyer , Yan Scholten , Leo Schwinn , Stephan Günnemann

Large language models (LLMs) increasingly participate in morally sensitive decision-making, yet how they organize ethical frameworks across reasoning steps remains underexplored. We introduce \textit{moral reasoning trajectories}, sequences…

计算与语言 · 计算机科学 2026-03-18 Fan Huang , Haewoon Kwak , Jisun An

Large language models (LLMs) are rapidly being integrated into psychological research as research tools, evaluation targets, human simulators, and cognitive models. However, recent evidence reveals severe measurement unreliability:…

人机交互 · 计算机科学 2025-07-08 Zhicheng Lin

Generalizable alignment is a core challenge for deploying Large Language Models (LLMs) safely in real-world NLP applications. Current alignment methods, including Reinforcement Learning from Human Feedback (RLHF), often fail to guarantee…

计算与语言 · 计算机科学 2025-04-07 Jaymari Chua , Chen Wang , Lina Yao

Mental health disorders impose a substantial global socioeconomic burden. While large language models (LLMs) offer 24/7, non-judgmental interactions to address this gap, pretrained models lack contextual coherence and emotional alignment…

计算与语言 · 计算机科学 2026-02-17 Eric Hua Qing Zhang , Julia Ive

The rapid growth of the large language model (LLM) ecosystem raises a critical question: are seemingly diverse models truly independent? Shared pretraining data, distillation, and alignment pipelines can induce hidden behavioral…

人工智能 · 计算机科学 2026-04-10 Chenchen Kuai , Jiwan Jiang , Zihao Zhu , Hao Wang , Keshu Wu , Zihao Li , Yunlong Zhang , Chenxi Liu , Zhengzhong Tu , Zhiwen Fan , Yang Zhou

Large language models (LLMs) are shown to be vulnerable to jailbreaking attacks where adversarial prompts are designed to elicit harmful responses. While existing defenses effectively mitigate single-turn attacks by detecting and filtering…

计算与语言 · 计算机科学 2026-02-17 Hanjiang Hu , Alexander Robey , Changliu Liu

Large language models (LLMs) are widely used for tasks ranging from summarisation to decision support. In practice, identical prompts do not always produce identical outputs, even when temperature and other decoding parameters are fixed. In…

计算与语言 · 计算机科学 2026-01-29 Claire Nicholson

The rise of artificial intelligence (AI) as super-capable assistants has transformed productivity and decision-making across domains. Yet, this integration raises critical concerns about value alignment - ensuring AI behaviors remain…

人工智能 · 计算机科学 2025-10-07 Santhosh Kumar Ravindran

Human cognition, driven by complex neurochemical processes, oscillates between imagination and reality and learns to self-correct whenever such subtle drifts lead to hallucinations or unsafe associations. In recent years, LLMs have…

计算与语言 · 计算机科学 2026-01-09 Sharanya Dasgupta , Arkaprabha Basu , Sujoy Nath , Swagatam Das

Large Language Models (LLMs) typically rely on Supervised Fine-Tuning (SFT) to specialize in downstream tasks, with the Cross Entropy (CE) loss being the de facto choice. However, CE maximizes the likelihood of observed data without…

机器学习 · 计算机科学 2025-04-08 Ziniu Li , Congliang Chen , Tian Xu , Zeyu Qin , Jiancong Xiao , Zhi-Quan Luo , Ruoyu Sun

Large language models (LLMs) often generate plausible yet incorrect answers, posing risks in safety-critical settings such as medicine. Human evaluation is expensive, and LLM-as-judge approaches risk introducing hidden errors. Recent…