中文
相关论文

相关论文: Zero-Shot Class Unlearning in CLIP with Synthetic …

200 篇论文

We show that the influence of a subset of the training samples can be removed -- or "forgotten" -- from the weights of a network trained on large-scale image classification tasks, and we provide strong computable bounds on the amount of…

机器学习 · 计算机科学 2021-06-22 Aditya Golatkar , Alessandro Achille , Avinash Ravichandran , Marzia Polito , Stefano Soatto

Machine unlearning enables models to selectively forget training data, driven by privacy regulations such as GDPR and CCPA. However, its fairness implications remain underexplored: when a model forgets a demographic group, does it…

Machine unlearning is the task of updating machine learning (ML) models after a subset of the training data they were trained on is deleted. Methods for the task are desired to combine effectiveness and efficiency, i.e., they should…

机器学习 · 计算机科学 2021-08-17 Ananth Mahadevan , Michael Mathioudakis

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been proposed to solve this problem. Replay methods which replay data…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Kotaro Nagata , Hiromu Ono , Kazuhiro Hotta

``The right to be forgotten'' ensured by laws for user data privacy becomes increasingly important. Machine unlearning aims to efficiently remove the effect of certain data points on the trained model parameters so that it can be…

机器学习 · 计算机科学 2025-02-04 Eli Chien , Haoyu Wang , Ziang Chen , Pan Li

Recently, pre-trained vision-language models have been increasingly used to tackle the challenging zero-shot segmentation task. Typical solutions follow the paradigm of first generating mask proposals and then adopting CLIP to classify…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Siyu Jiao , Yunchao Wei , Yaowei Wang , Yao Zhao , Humphrey Shi

With the increasing importance of data privacy and security, federated unlearning has emerged as a novel research field dedicated to ensuring that federated learning models no longer retain or leak relevant information once specific data…

机器学习 · 计算机科学 2026-04-07 Houzhe Wang , Xiaojie Zhu , Chi Chen

Regulations introduced by General Data Protection Regulation (GDPR) in the EU or California Consumer Privacy Act (CCPA) in the US have included provisions on the \textit{right to be forgotten} that mandates industry applications to remove…

计算与语言 · 计算机科学 2022-12-20 Vinayshekhar Bannihatti Kumar , Rashmi Gangadharaiah , Dan Roth

In some of object recognition problems, labeled data may not be available for all categories. Zero-shot learning utilizes auxiliary information (also called signatures) describing each category in order to find a classifier that can…

计算机视觉与模式识别 · 计算机科学 2016-06-01 Seyed Mohsen Shojaee , Mahdieh Soleymani Baghshah

CLIP delivers strong zero-shot classification but remains highly vulnerable to adversarial attacks. Previous work of adversarial fine-tuning largely focuses on matching the predicted logits between clean and adversarial examples, which…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Wenjing lu , Zerui Tao , Dongping Zhang , Yuning Qiu , Yang Yang , Qibin Zhao

As generative models become increasingly powerful and pervasive, the ability to unlearn specific data, whether due to privacy concerns, legal requirements, or the correction of harmful content, has become increasingly important. Unlike in…

机器学习 · 计算机科学 2025-09-26 Pinak Mandal , Georg A. Gottwald

Lifelong learning algorithms enable models to incrementally acquire new knowledge without forgetting previously learned information. Contrarily, the field of machine unlearning focuses on explicitly forgetting certain previous knowledge…

机器学习 · 计算机科学 2025-05-19 Ozan Özdenizci , Elmar Rueckert , Robert Legenstein

Prompt learning has emerged as a valuable technique in enhancing vision-language models (VLMs) such as CLIP for downstream tasks in specific domains. Existing work mainly focuses on designing various learning forms of prompts, neglecting…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Zheng Li , Xiang Li , Xinyi Fu , Xin Zhang , Weiqiang Wang , Shuo Chen , Jian Yang

Recently, zero-shot multi-label classification has garnered considerable attention for its capacity to operate predictions on unseen labels without human annotations. Nevertheless, prevailing approaches often use seen classes as imperfect…

计算机视觉与模式识别 · 计算机科学 2024-04-05 Kaixin Zhang , Zhixiang Yuan , Tao Huang

Fine-tuning vision-language models (VLMs) like CLIP to downstream tasks is often necessary to optimize their performance. However, a major obstacle is the limited availability of labeled data. We study the use of pseudolabels, i.e.,…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Cristina Menghini , Andrew Delworth , Stephen H. Bach

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. To mitigate potentially incorrect pseudo labels, recent frameworks mostly set a fixed confidence threshold to discard uncertain…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Lihe Yang , Zhen Zhao , Lei Qi , Yu Qiao , Yinghuan Shi , Hengshuang Zhao

Contrastive learning (CL), a self-supervised learning approach, can effectively learn visual representations from unlabeled data. Given the CL training data, generative models can be trained to generate synthetic data to supplement the real…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Yawen Wu , Zhepeng Wang , Dewen Zeng , Yiyu Shi , Jingtong Hu

Catastrophic forgetting is a problem caused by neural networks' inability to learn data in sequence. After learning two tasks in sequence, performance on the first one drops significantly. This is a serious disadvantage that prevents many…

机器学习 · 计算机科学 2020-04-30 Wojciech Masarczyk , Ivona Tautkute

Pre-trained vision-language models such as contrastive language-image pre-training (CLIP) have demonstrated a remarkable generalizability, which has enabled a wide range of applications represented by zero-shot classification. However,…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Kazuki Adachi , Shin'ya Yamaguchi , Tomoki Hamagami

Pre-training image representations from the raw text about images enables zero-shot vision transfer to downstream tasks. Through pre-training on millions of samples collected from the internet, multimodal foundation models, such as CLIP,…

机器学习 · 计算机科学 2024-03-18 Chenguang Wang , Ruoxi Jia , Xin Liu , Dawn Song