中文
相关论文

相关论文: Protecting Privacy in Multimodal Large Language Mo…

200 篇论文

Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased…

机器人学 · 计算机科学 2024-06-11 Xiangrui Kong , Thomas Braunl , Marco Fahmi , Yue Wang

Machine Unlearning (MU) is critical for removing private or hazardous information from deep learning models. While MU has advanced significantly in unimodal (text or vision) settings, multimodal unlearning (MMU) remains underexplored due to…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Alexey Dontsov , Dmitrii Korzh , Alexey Zhavoronkin , Boris Mikheev , Denis Bobkov , Aibek Alanov , Oleg Y. Rogov , Ivan Oseledets , Elena Tutubalina

Machine unlearning has emerged as an effective strategy for forgetting specific information in the training data. However, with the increasing integration of visual data, privacy concerns in Vision Language Models (VLMs) remain…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Yingzi Ma , Jiongxiao Wang , Fei Wang , Siyuan Ma , Jiazhao Li , Jinsheng Pan , Xiujun Li , Furong Huang , Lichao Sun , Bo Li , Yejin Choi , Muhao Chen , Chaowei Xiao

In recent years, unlearning techniques, which are methods for inducing a model to "forget" previously learned information, have attracted attention as a way to address privacy and copyright concerns in large language models (LLMs) and large…

机器学习 · 计算机科学 2025-10-29 Tatsuki Kawakami , Kazuki Egashira , Atsuyuki Miyai , Go Irie , Kiyoharu Aizawa

Pretrained Language Models (LMs) memorize a vast amount of knowledge during initial pretraining, including information that may violate the privacy of personal lives and identities. Previous work addressing privacy issues for language…

计算与语言 · 计算机科学 2022-12-20 Joel Jang , Dongkeun Yoon , Sohee Yang , Sungmin Cha , Moontae Lee , Lajanugen Logeswaran , Minjoon Seo

Multimodal Large Language Models (MLLMs) achieve remarkable capabilities but can inadvertently memorize privacy-sensitive information. Although existing unlearning methods can remove such knowledge, they fail to achieve benign forgetting…

人工智能 · 计算机科学 2025-11-26 Zhen Zeng , Leijiang Gu , Zhangling Duan , Feng Li , Zenglin Shi , Cees G. M. Snoek , Meng Wang

Large Vision-Language Models (LVLMs), trained on web-scale data, risk memorizing and regenerating copyrighted visual content such as characters and logos, creating significant challenges. Machine unlearning offers a path to mitigate these…

计算机视觉与模式识别 · 计算机科学 2026-05-06 JuneHyoung Kwon , JungMin Yun , YoungBin Kim

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

计算与语言 · 计算机科学 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Multimodal Large Language Models (MLLMs) have become increasingly important due to their state-of-the-art performance and ability to integrate multiple data modalities, such as text, images, and audio, to perform complex tasks with high…

With the rapid development of artificial intelligence, large language models (LLMs) have made remarkable advancements in natural language processing. These models are trained on vast datasets to exhibit powerful language understanding and…

密码学与安全 · 计算机科学 2025-09-22 Shang Wang , Tianqing Zhu , Bo Liu , Ming Ding , Dayong Ye , Wanlei Zhou , Philip S. Yu

Large Language Models (LLMs) have become integral to numerous domains, significantly advancing applications in data management, mining, and analysis. Their profound capabilities in processing and interpreting complex language data, however,…

Large language models trained on massive corpora of data from the web can memorize and reproduce sensitive or private data raising both legal and ethical concerns. Unlearning, or tuning models to forget information present in their training…

机器学习 · 计算机科学 2024-01-12 Pratyush Maini , Zhili Feng , Avi Schwarzschild , Zachary C. Lipton , J. Zico Kolter

Modern Vision-Language Models (VLMs) pose significant individual-level privacy risks by linking fragmented multimodal data to identifiable individuals through hierarchical chain-of-thought reasoning. However, existing privacy benchmarks…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Xiongtao Sun , Hui Li , Jiaming Zhang , Yujie Yang , Kaili Liu , Ruxin Feng , Wen Jun Tan , Wei Yang Bryan Lim

Multimodal large language models (MLLMs) have broadened the scope of AI applications. Existing automatic evaluation methodologies for MLLMs are mainly limited in evaluating queries without considering user experiences, inadequately…

Recently Multimodal Large Language Models (MLLMs) have achieved considerable advancements in vision-language tasks, yet produce potentially harmful or untrustworthy content. Despite substantial work investigating the trustworthiness of…

人工智能 · 计算机科学 2026-01-14 Yanxu Zhu , Shitong Duan , Xiangxu Zhang , Jitao Sang , Peng Zhang , Tun Lu , Xiao Zhou , Jing Yao , Xiaoyuan Yi , Xing Xie

Large language model unlearning has garnered increasing attention due to its potential to address security and privacy concerns, leading to extensive research in the field. However, much of this research has concentrated on instance-level…

计算与语言 · 计算机科学 2025-05-20 Weitao Ma , Xiaocheng Feng , Weihong Zhong , Lei Huang , Yangfan Ye , Xiachong Feng , Bing Qin

Large language models (LLMs) are sophisticated artificial intelligence systems that enable machines to generate human-like text with remarkable precision. While LLMs offer significant technological progress, their development using vast…

密码学与安全 · 计算机科学 2025-06-23 Yashothara Shanmugarasa , Ming Ding , M. A. P Chamikara , Thierry Rakotoarivelo

Multimodal Large Language models (MLLMs) have shown promise in web-related tasks, but evaluating their performance in the web domain remains a challenge due to the lack of comprehensive benchmarks. Existing benchmarks are either designed…

计算与语言 · 计算机科学 2024-04-10 Junpeng Liu , Yifan Song , Bill Yuchen Lin , Wai Lam , Graham Neubig , Yuanzhi Li , Xiang Yue

Large Language Models (LLMs) have shown greatly enhanced performance in recent years, attributed to increased size and extensive training data. This advancement has led to widespread interest and adoption across industries and the public.…

计算与语言 · 计算机科学 2024-06-19 Victoria Smith , Ali Shahin Shamsabadi , Carolyn Ashurst , Adrian Weller

In recent years, Large Language Models (LLMs) have achieved remarkable advancements, drawing significant attention from the research community. Their capabilities are largely attributed to large-scale architectures, which require extensive…