中文
相关论文

相关论文: Adversarial Alignment: Ensuring Value Consistency …

200 篇论文

As large language models (LLMs) increasingly shape content generation, interaction, and decision-making across the Web, aligning them with human values has become a central objective in trustworthy AI. This challenge becomes even more…

机器学习 · 计算机科学 2026-05-12 Hefei Xu , Le Wu , Yu Wang , Min Hou , Han Wu , Zhen Zhang , Meng Wang

Large language models (LLMs) have significantly transformed the educational landscape. As current plagiarism detection tools struggle to keep pace with LLMs' rapid advancements, the educational community faces the challenge of assessing…

计算与语言 · 计算机科学 2024-06-18 Roy Xie , Chengxuan Huang , Junlin Wang , Bhuwan Dhingra

Large Language Models (LLMs) have excelled at language understanding and generating human-level text. However, even with supervised training and human alignment, these LLMs are susceptible to adversarial attacks where malicious users can…

Large language models (LLMs) have shown tremendous success in following user instructions and generating helpful responses. Nevertheless, their robustness is still far from optimal, as they may generate significantly inconsistent responses…

计算与语言 · 计算机科学 2024-03-25 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Shuaiqiang Wang , Chong Meng , Zhicong Cheng , Zhaochun Ren , Dawei Yin

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

计算与语言 · 计算机科学 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

Research into AI alignment has grown considerably since the recent introduction of increasingly capable Large Language Models (LLMs). Unfortunately, modern methods of alignment still fail to fully prevent harmful responses when models are…

密码学与安全 · 计算机科学 2024-08-20 Matthew Pisano , Peter Ly , Abraham Sanders , Bingsheng Yao , Dakuo Wang , Tomek Strzalkowski , Mei Si

Large Language Models (LLMs) are central to a multitude of applications but struggle with significant risks, notably in generating harmful content and biases. Drawing an analogy to the human psyche's conflict between evolutionary survival…

计算与语言 · 计算机科学 2023-11-16 Zi Yin , Wei Ding , Jia Liu

As powerful Large Language Models (LLMs) are now widely used for numerous practical applications, their safety is of critical importance. While alignment techniques have significantly improved overall safety, LLMs remain vulnerable to…

机器学习 · 计算机科学 2024-10-28 Samuel Jacob Chacko , Sajib Biswas , Chashi Mahiul Islam , Fatema Tabassum Liza , Xiuwen Liu

Large language models (LLMs) appear to bias their survey answers toward certain values. Nonetheless, some argue that LLMs are too inconsistent to simulate particular values. Are they? To answer, we first define value consistency as the…

计算与语言 · 计算机科学 2024-10-03 Jared Moore , Tanvi Deshpande , Diyi Yang

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

The progress of AI systems such as large language models (LLMs) raises increasingly pressing concerns about their safe deployment. This paper examines the value alignment problem for LLMs, arguing that current alignment strategies are…

计算与语言 · 计算机科学 2025-06-06 Raphaël Millière

Large Language Models (LLMs) are valuable for text classification, but their vulnerabilities must not be disregarded. They lack robustness against adversarial examples, so it is pertinent to understand the impacts of different types of…

计算与语言 · 计算机科学 2024-06-13 João Vitorino , Eva Maia , Isabel Praça

The proliferation of large language models (LLMs) requires robust evaluation of their alignment with local values and ethical standards, especially as existing benchmarks often reflect the cultural, legal, and ideological values of their…

计算机与社会 · 计算机科学 2024-08-06 Gwenyth Isobel Meadows , Nicholas Wai Long Lau , Eva Adelina Susanto , Chi Lok Yu , Aditya Paul

Large language models (LLMs) remain unreliable for global enterprise applications due to substantial performance gaps between high-resource and mid/low-resource languages, driven by English-centric pretraining and internal reasoning biases.…

计算与语言 · 计算机科学 2025-10-28 Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Tao Sheng , Sujith Ravi , Dan Roth

Large Language Models (LLMs) represent a transformative leap in artificial intelligence, enabling the comprehension, generation, and nuanced interaction with human language on an unparalleled scale. However, LLMs are increasingly vulnerable…

密码学与安全 · 计算机科学 2025-02-06 Nan Wang , Kane Walter , Yansong Gao , Alsharif Abuadbba

Improving the alignment of Large Language Models (LLMs) with respect to the cultural values that they encode has become an increasingly important topic. In this work, we study whether we can exploit existing knowledge about cultural values…

计算与语言 · 计算机科学 2025-09-09 Rochelle Choenni , Ekaterina Shutova

As agentic AI becomes more widespread, agents with distinct and possibly conflicting goals will interact in complex ways. These multi-agent interactions pose a fundamental challenge, particularly in social dilemmas, where agents' individual…

机器学习 · 计算机科学 2025-12-02 Dereck Piche , Mohammed Muqeeth , Milad Aghajohari , Juan Duque , Michael Noukhovitch , Aaron Courville

Social alignment in AI systems aims to ensure that these models behave according to established societal values. However, unlike humans, who derive consensus on value judgments through social interaction, current language models (LMs) are…

计算与语言 · 计算机科学 2023-10-31 Ruibo Liu , Ruixin Yang , Chenyan Jia , Ge Zhang , Denny Zhou , Andrew M. Dai , Diyi Yang , Soroush Vosoughi

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

人工智能 · 计算机科学 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel

We address the problem of cross-language adaptation for question-question similarity reranking in community question answering, with the objective to port a system trained on one input language to another input language given labeled…

计算与语言 · 计算机科学 2017-06-22 Shafiq Joty , Preslav Nakov , Lluís Màrquez , Israa Jaradat