中文
相关论文

相关论文: Attention Shift: Steering AI Away from Unsafe Cont…

200 篇论文

As generative AI faces intensifying legal challenges, the machine learning community has increasingly relied on post-hoc mitigation -- especially machine unlearning and inference-time guardrails -- to argue for compliance. This paper argues…

密码学与安全 · 计算机科学 2026-04-22 Satoru Utsunomiya , Masaru Isonuma , Junichiro Mori , Ichiro Sakata

Large Language Models memorize vast amounts of training data, raising concerns regarding privacy, copyright infringement, and safety. Machine unlearning seeks to remove the influence of a targeted forget set while preserving model…

In the past few years, Language Models (LMs) have shown par-human capabilities in several domains. Despite their practical applications and exceeding user consumption, they are susceptible to jailbreaks when malicious input exploits the…

计算与语言 · 计算机科学 2025-04-18 Charlotte Siska , Anush Sankaran

Introspection is a foundational cognitive ability, but its mechanism is not well understood. Recent work has shown that AI models can introspect. We study the mechanism of this introspection. We first extensively replicate Lindsey (2025)'s…

人工智能 · 计算机科学 2026-04-08 Harvey Lederman , Kyle Mahowald

Ensuring that online discussions are civil and productive is a major challenge for social media platforms. Such platforms usually rely both on users and on automated detection tools to flag inappropriate arguments of other users, which…

计算与语言 · 计算机科学 2024-06-06 Timon Ziegenbein , Gabriella Skitalinskaya , Alireza Bayat Makou , Henning Wachsmuth

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

机器学习 · 计算机科学 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

Unneeded elements in the attention's context degrade performance. We introduce Selective Attention, a simple parameter-free change to the standard attention mechanism which reduces attention to unneeded elements. Selective attention…

计算与语言 · 计算机科学 2025-04-25 Yaniv Leviathan , Matan Kalman , Yossi Matias

By and large, the professional handling of huge data collections is regarded as a fundamental ingredient of the progress of machine learning and of its spectacular results in related disciplines, with a growing agreement on risks connected…

人工智能 · 计算机科学 2023-09-18 Marco Gori , Stefano Melacci

Generative AI systems may pose serious risks to individuals vulnerable to eating disorders. Existing safeguards tend to overlook subtle but clinically significant cues, leaving many risks unaddressed. To better understand the nature of…

人机交互 · 计算机科学 2025-12-05 Amy Winecoff , Kevin Klyman

Generative artificial intelligence revolutionized society. Current models are trained by minimizing the distance between the produced data and the training set. Consequently, development is plateauing as they are intrinsically data-hungry…

机器学习 · 计算机科学 2025-06-09 Mattia Miotto , Lorenzo Monacelli

When introducing Large Language Models (LLMs) into industrial applications, such as healthcare and education, the risk of generating harmful content becomes a significant challenge. While existing machine unlearning methods can erase…

计算与语言 · 计算机科学 2026-04-08 Mutsumi Sasaki , Kouta Nakayama , Yusuke Miyao , Yohei Oseki , Masaru Isonuma

The groundbreaking advancements around generative AI have recently caused a wave of concern culminating in a row of lawsuits, including high-profile actions against Stability AI and OpenAI. This situation of legal uncertainty has sparked a…

信息检索 · 计算机科学 2024-04-04 Michael Dinzinger , Florian Heß , Michael Granitzer

As artificial intelligence (AI) becomes deeply integrated into critical infrastructures and everyday life, ensuring its safe deployment is one of humanity's most urgent challenges. Current AI models prioritize task optimization over safety,…

人工智能 · 计算机科学 2024-11-08 Joshua T. S. Hewson

Safety alignment is a key requirement for building reliable Artificial General Intelligence. Despite significant advances in safety alignment, we observe that minor latent shifts can still trigger unsafe responses in aligned models. We…

机器学习 · 计算机科学 2025-06-23 Tianle Gu , Kexin Huang , Zongqi Wang , Yixu Wang , Jie Li , Yuanqi Yao , Yang Yao , Yujiu Yang , Yan Teng , Yingchun Wang

Recent AI systems compress the distance between capability growth and capability deployment. Earlier high-risk technologies were slowed by capital intensity, physical bottlenecks, organizational inertia, and specialized supply chains. By…

人工智能 · 计算机科学 2026-05-05 Wesley Shu , Peng Wei

As large language models (LLMs) are increasingly deployed, ensuring their safe use is paramount. Jailbreaking, adversarial prompts that bypass model alignment to trigger harmful outputs, present significant risks, with existing studies…

密码学与安全 · 计算机科学 2026-01-01 Yuan Xin , Dingfan Chen , Linyi Yang , Michael Backes , Xiao Zhang

We propose an attention-based networks for transferring motions between arbitrary objects. Given a source image(s) and a driving video, our networks animate the subject in the source images according to the motion in the driving video. In…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Subin Jeon , Seonghyeon Nam , Seoung Wug Oh , Seon Joo Kim

Despite the strong multimodal performance, large vision-language models (LVLMs) are vulnerable during fine-tuning to backdoor attacks, where adversaries insert trigger-embedded samples into the training data to implant behaviors that can be…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Zhifang Zhang , Bojun Yang , Shuo He , Weitong Chen , Wei Emma Zhang , Olaf Maennel , Lei Feng , Miao Xu

Natural Language Processing (NLP) models risk overfitting to specific terms in the training data, thereby reducing their performance, fairness, and generalizability. E.g., neural hate speech detection models are strongly influenced by…

计算与语言 · 计算机科学 2022-03-18 Giuseppe Attanasio , Debora Nozza , Dirk Hovy , Elena Baralis

In the age of powerful AI-generated text, automatic detectors have emerged to identify machine-written content. This poses a threat to author privacy and freedom, as text authored with AI assistance may be unfairly flagged. We propose…

密码学与安全 · 计算机科学 2025-03-13 Isaac David , Arthur Gervais