中文
相关论文

相关论文: BeaverTails: Towards Improved Safety Alignment of …

200 篇论文

Although humans inherently have diverse values, current large language model (LLM) alignment methods often assume that aligning LLMs with the general public's preferences is optimal. A major challenge in adopting a more individualized…

计算与语言 · 计算机科学 2024-11-06 Seongyun Lee , Sue Hyun Park , Seungone Kim , Minjoon Seo

Large Language Models (LLMs) are increasingly integrated into critical systems in industries like healthcare and finance. Users can often submit queries to LLM-enabled chatbots, some of which can enrich responses with information retrieved…

密码学与安全 · 计算机科学 2025-05-21 Sayon Palit , Daniel Woods

Large Language Models (LLMs) are increasingly used to generate narrative content, including children's stories, which play an important role in social and cultural learning. Despite growing interest in AI safety and alignment, most existing…

计算与语言 · 计算机科学 2026-04-21 Yuxuan Ouyang , yingfeng luo , JingBo Zhu , Tong Xiao

Large language models (LLMs) are transforming education by answering questions, explaining complex concepts, and generating content across a wide range of subjects. Despite strong performance on academic benchmarks, they often fail to…

计算与语言 · 计算机科学 2025-10-21 Numaan Naeem , Abdellah El Mekki , Muhammad Abdul-Mageed

As digital emotional support needs grow, Large Language Model companions offer promising authentic, always-available empathy, though rigorous evaluation lags behind model advancement. We present Heart-to-Heart Talk (H2HTalk), a benchmark…

计算与语言 · 计算机科学 2025-07-08 Boyang Wang , Yalun Wu , Hongcheng Guo , Zhoujun Li

Ensuring alignment, which refers to making models behave in accordance with human intentions [1,2], has become a critical task before deploying large language models (LLMs) in real-world applications. For instance, OpenAI devoted six months…

Large language models (LLMs) have shown promise for mental health support, yet training such models is constrained by the scarcity and sensitivity of real counseling dialogues. In this article, we present MindChat, a privacy-preserving LLM…

人工智能 · 计算机科学 2026-01-27 Dong Xue , Jicheng Tu , Ming Wang , Xin Yan , Fangzhou Liu , Jie Hu

As the development of Large Models (LMs) progresses rapidly, their safety is also a priority. In current Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) safety workflow, evaluation, diagnosis, and alignment are…

The recent popularity of large language models (LLMs) has brought a significant impact to boundless fields, particularly through their open-ended ecosystem such as the APIs, open-sourced models, and plugins. However, with their widespread…

机器学习 · 计算机科学 2023-08-31 Wentao Ye , Mingfeng Ou , Tianyi Li , Yipeng chen , Xuetao Ma , Yifan Yanggong , Sai Wu , Jie Fu , Gang Chen , Haobo Wang , Junbo Zhao

Large Language Models (LLMs) are increasingly integrated into vehicle-based digital assistants, where unsafe, ambiguous, or legally incorrect responses can lead to serious safety, ethical, and regulatory consequences. Despite growing…

人工智能 · 计算机科学 2026-03-25 Abhishek Kumar , Riya Tapwal , Carsten Maple

Large Language Models (LLMs) are increasingly used by teenagers and young adults in everyday life, ranging from emotional support and creative expression to educational assistance. However, their unique vulnerabilities and risk profiles…

人机交互 · 计算机科学 2025-09-12 Yaman Yu , Yiren Liu , Jacky Zhang , Yun Huang , Yang Wang

Large language models (LLMs) are vulnerable when trained on datasets containing harmful content, which leads to potential jailbreaking attacks in two scenarios: the integration of harmful texts within crowdsourced data used for pre-training…

密码学与安全 · 计算机科学 2024-06-03 Xiaoqun Liu , Jiacheng Liang , Muchao Ye , Zhaohan Xi

Large language models are rapidly being deployed as AI tutors, yet current evaluation paradigms assess problem-solving accuracy and generic safety in isolation, failing to capture whether a model is simultaneously pedagogically effective…

Conversational AI systems have emerged as key enablers of human-like interactions across diverse sectors. Nevertheless, the balance between linguistic nuance and factual accuracy has proven elusive. In this paper, we first introduce…

To solve complex tasks, large language models (LLMs) often require multiple rounds of interactions with the user, sometimes assisted by external tools. However, current evaluation protocols often emphasize benchmark performance with…

计算与语言 · 计算机科学 2024-03-13 Xingyao Wang , Zihan Wang , Jiateng Liu , Yangyi Chen , Lifan Yuan , Hao Peng , Heng Ji

As large language models (LLMs) become ubiquitous, parameter-efficient fine-tuning methods and safety-first defenses have proliferated rapidly. However, the number of approaches and their recent increase have resulted in diverse…

机器学习 · 计算机科学 2025-06-03 Saad Hossain , Samanvay Vajpayee , Sirisha Rambhatla

Existing document-level machine translation resources are only available for a handful of languages, mostly high-resourced ones. To facilitate the training and evaluation of document-level translation and, more broadly, long-context…

计算与语言 · 计算机科学 2025-10-01 Dayyán O'Brien , Bhavitvya Malik , Ona de Gibert , Pinzhen Chen , Barry Haddow , Jörg Tiedemann

Machine psychology aims to reconstruct the mindset of Large Language Models (LLMs), i.e. how these artificial intelligences perceive and associate ideas. This work introduces PhDGPT, a prompting framework and synthetic dataset that…

人机交互 · 计算机科学 2024-11-19 Edoardo Sebastiano De Duro , Enrique Taietta , Riccardo Improta , Massimo Stella

The unbiased learning to rank (ULTR) problem has been greatly advanced by recent deep learning techniques and well-designed debias algorithms. However, promising results on the existing benchmark datasets may not be extended to the…

人工智能 · 计算机科学 2022-09-21 Lixin Zou , Haitao Mao , Xiaokai Chu , Jiliang Tang , Wenwen Ye , Shuaiqiang Wang , Dawei Yin

Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties…

计算与语言 · 计算机科学 2024-03-05 Rohan Kumar , Youngmin Kim , Sunitha Ravi , Haitian Sun , Christos Faloutsos , Ruslan Salakhutdinov , Minji Yoon