中文
相关论文

相关论文: SoK: Data Reconstruction Attacks Against Machine L…

200 篇论文

Federated learning is a decentralized learning paradigm introduced to preserve privacy of client data. Despite this, prior work has shown that an attacker at the server can still reconstruct the private training data using only the client…

密码学与安全 · 计算机科学 2024-03-28 Joshua C. Zhao , Ahaan Dabholkar , Atul Sharma , Saurabh Bagchi

The rapid advancement of Large Language Models (LLMs) has created new opportunities for Automated Penetration Testing (AutoPT), spawning numerous frameworks aimed at achieving end-to-end autonomous attacks. However, despite the…

We study the problem of reconstructing tabular data from aggregate statistics, in which the attacker aims to identify interesting claims about the sensitive data that can be verified with 100% certainty given the aggregates. Successful…

机器学习 · 统计学 2025-06-12 Terrance Liu , Eileen Xiao , Adam Smith , Pratiksha Thaker , Zhiwei Steven Wu

In recent years, several companies and researchers have started to tackle the problem of damage recognition within the scope of automated inspection of built structures. While companies are neither willing to publish associated data nor…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Johannes Flotzinger , Philipp J. Rösch , Norbert Oswald , Thomas Braml

Machine unlearning focuses on efficiently removing specific data from trained models, addressing privacy and compliance concerns with reasonable costs. Although exact unlearning ensures complete data removal equivalent to retraining, it is…

密码学与安全 · 计算机科学 2025-06-17 Nima Naderloui , Shenao Yan , Binghui Wang , Jie Fu , Wendy Hui Wang , Weiran Liu , Yuan Hong

Reliability and generalization in deep learning are predominantly studied in the context of image classification. Yet, real-world applications in safety-critical domains involve a broader set of semantic tasks, such as semantic segmentation…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Shashank Agnihotri , David Schader , Jonas Jakubassa , Nico Sharei , Simon Kral , Mehmet Ege Kaçar , Ruben Weber , Margret Keuper

Federated learning (FL) enables a set of entities to collaboratively train a machine learning model without sharing their sensitive data, thus, mitigating some privacy concerns. However, an increasing number of works in the literature…

As the implementation of machine learning (ML) systems becomes more widespread, especially with the introduction of larger ML models, we perceive a spring demand for massive data. However, it inevitably causes infringement and misuse…

密码学与安全 · 计算机科学 2025-05-27 Linkang Du , Xuanru Zhou , Min Chen , Chusong Zhang , Zhou Su , Peng Cheng , Jiming Chen , Zhikun Zhang

Recent works have demonstrated that it is possible to reconstruct training images and their labels from gradients of an image-classification model when its architecture is known. Unfortunately, there is still an incomplete theoretical…

机器学习 · 计算机科学 2022-10-25 Cangxiong Chen , Neill D. F. Campbell

Personal digital data is a critical asset, and governments worldwide have enforced laws and regulations to protect data privacy. Data users have been endowed with the right to be forgotten of their data. In the course of machine learning…

机器学习 · 计算机科学 2024-03-14 Na Li , Chunyi Zhou , Yansong Gao , Hui Chen , Anmin Fu , Zhi Zhang , Yu Shui

In recent years, deep learning has achieved remarkable empirical success for image reconstruction. This has catalyzed an ongoing quest for precise characterization of correctness and reliability of data-driven methods in critical use-cases,…

计算机视觉与模式识别 · 计算机科学 2022-09-15 Subhadip Mukherjee , Andreas Hauptmann , Ozan Öktem , Marcelo Pereyra , Carola-Bibiane Schönlieb

Universal adversarial perturbation attacks are widely used to analyze image classifiers that employ convolutional neural networks. Nowadays, some attacks can deceive image- and video-quality metrics. So sustainability analysis of these…

计算机视觉与模式识别 · 计算机科学 2022-11-02 Ekaterina Shumitskaya , Anastasia Antsiferova , Dmitriy Vatolin

The unauthorized use of personal data for commercial purposes and the clandestine acquisition of private data for training machine learning models continue to raise concerns. In response to these issues, researchers have proposed…

密码学与安全 · 计算机科学 2023-05-19 Bin Fang , Bo Li , Shuang Wu , Ran Yi , Shouhong Ding , Lizhuang Ma

Recent unlearning methods for LLMs are vulnerable to relearning attacks: knowledge believed-to-be-unlearned re-emerges by fine-tuning on a small set of (even seemingly-unrelated) examples. We study this phenomenon in a controlled setting…

Machine unlearning seeks to remove the influence of particular data or class from trained models to meet privacy, legal, or ethical requirements. Existing unlearning methods tend to forget shallowly: phenomenon of an unlearned model pretend…

机器学习 · 计算机科学 2025-07-23 Jaeheun Jung , Bosung Jung , Suhyun Bae , Donghun Lee

Machine learning (ML) is about computational methods that enable machines to learn concepts from experience. In handling a wide variety of experience ranging from data instances, knowledge, constraints, to rewards, adversaries, and lifelong…

机器学习 · 计算机科学 2023-01-11 Zhiting Hu , Eric P. Xing

Large Language Models (LLMs) are rapidly becoming ubiquitous both as stand-alone tools and as components of current and future software systems. To enable usage of LLMs in the high-stake or safety-critical systems of 2030, they need to…

软件工程 · 计算机科学 2024-06-13 Sinclair Hudson , Sophia Jit , Boyue Caroline Hu , Marsha Chechik

Current adversarial attack research reveals the vulnerability of learning-based classifiers against carefully crafted perturbations. However, most existing attack methods have inherent limitations in cross-dataset generalization as they…

计算机视觉与模式识别 · 计算机科学 2022-03-25 Cheng Luo , Qinliang Lin , Weicheng Xie , Bizhu Wu , Jinheng Xie , Linlin Shen

This paper provides a systematic survey of jailbreak attacks and defenses on Large Language Models (LLMs) and Vision-Language Models (VLMs), emphasizing that jailbreak vulnerabilities stem from structural factors such as incomplete training…

密码学与安全 · 计算机科学 2026-01-08 Zejian Chen , Chaozhuo Li , Chao Li , Xi Zhang , Litian Zhang , Yiming He

Advances in dataset analysis techniques have enabled more sophisticated approaches to analyzing and characterizing training data instances, often categorizing data based on attributes such as ``difficulty''. In this work, we introduce…

计算与语言 · 计算机科学 2024-10-15 Mohammad Reza Modarres , Sina Abbasi , Mohammad Taher Pilehvar