English
Related papers

Related papers: Data Reconstruction: When You See It and When You …

200 papers

The memorization of training data by neural networks raises pressing concerns for privacy and security. Recent work has shown that, under certain conditions, portions of the training set can be reconstructed directly from model parameters.…

Machine Learning · Computer Science 2025-09-26 Yehonatan Refael , Guy Smorodinsky , Ofir Lindenbaum , Itay Safran

In the domain of practical software protection against man-at-the-end attacks such as software reverse engineering and tampering, much of the scientific literature is plagued by the use of subpar methods to evaluate the protections'…

Software Engineering · Computer Science 2025-02-21 Bjorn De Sutter

Although powerful graph neural networks (GNNs) have boosted numerous real-world applications, the potential privacy risk is still underexplored. To close this gap, we perform the first comprehensive study of graph reconstruction attack that…

Machine Learning · Computer Science 2023-06-16 Zhanke Zhou , Chenyu Zhou , Xuan Li , Jiangchao Yao , Quanming Yao , Bo Han

The concept of resilience embodies the quest towards the ability to sustain shocks, to suffer from these shocks as little as possible, for the shortest time possible, and to recover with the full functionalities that existed before the…

Physics and Society · Physics 2014-08-26 Tatyana Kovalenko , Didier Sornette

Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show…

Machine Learning · Computer Science 2024-05-31 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

In the design of software and cyber-physical systems, security is often perceived as a qualitative need, but can only be attained quantitatively. Especially when distributed components are involved, it is hard to predict and confront all…

Cryptography and Security · Computer Science 2018-03-30 Roberto Vigo , Flemming Nielson , Hanne Riis Nielson

We find that images contain intrinsic structure that enables the reversal of many adversarial attacks. Attack vectors cause not only image classifiers to fail, but also collaterally disrupt incidental structure in the image. We demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Chengzhi Mao , Mia Chiquier , Hao Wang , Junfeng Yang , Carl Vondrick

The security of control systems under sensor attacks is investigated. Redundant observability is introduced, explaining existing security notions including the security index, attack detectability, and observability under attacks.…

Systems and Control · Computer Science 2021-01-11 Chanhwa Lee , Hyungbo Shim , Yongsoon Eun

We introduce a formal notion of defendability against backdoors using a game between an attacker and a defender. In this game, the attacker modifies a function to behave differently on a particular input known as the "trigger", while…

Machine Learning · Computer Science 2025-02-12 Paul Christiano , Jacob Hilton , Victor Lecomte , Mark Xu

There has been an ongoing cycle where stronger defenses against adversarial attacks are subsequently broken by a more advanced defense-aware attack. We present a new approach towards ending this cycle where we "deflect'' adversarial attacks…

Machine Learning · Computer Science 2020-02-19 Yao Qin , Nicholas Frosst , Colin Raffel , Garrison Cottrell , Geoffrey Hinton

Research in cybersecurity may seem reactive, specific, ephemeral, and indeed ineffective. Despite decades of innovation in defense, even the most critical software systems turn out to be vulnerable to attacks. Time and again. Offense and…

Cryptography and Security · Computer Science 2024-09-04 Marcel Böhme

We address a fundamental problem that is systematically encountered when modeling complex systems: the limitedness of the information available. In the case of economic and financial networks, privacy issues severely limit the information…

Physics and Society · Physics 2015-12-07 Giulio Cimini , Tiziano Squartini , Diego Garlaschelli , Andrea Gabrielli

The present article introduces a reference framework for discussing resilience of computational systems. Rather than a property that may or may not be exhibited by a system, resilience is interpreted here as the emerging result of a dynamic…

Systems and Control · Computer Science 2015-04-13 Vincenzo De Florio

Debuggers are a popular reverse engineering and tampering tool. Self-debugging is an effective technique for applications to defend themselves against hostile debuggers. In penetration tests on state-of-the-art self-debugging, we observed…

Cryptography and Security · Computer Science 2020-11-02 Bert Abrath , Bart Coppens , Ilja Nevolin , Bjorn De Sutter

Insider threats are one of today's most challenging cybersecurity issues that are not well addressed by commonly employed security solutions. Despite several scientific works published in this domain, we argue that the field can benefit…

Cryptography and Security · Computer Science 2019-04-16 Ivan Homoliak , Flavio Toffalini , Juan Guarnizo , Yuval Elovici , Martín Ochoa

We consider the problem of signal reconstruction for a system under sparse signal corruption by a malicious agent. The reconstruction problem follows the standard error coding problem that has been studied extensively in the literature. We…

Optimization and Control · Mathematics 2023-04-28 Yu Zheng , Olugbenga Moses Anubi , Lalit Mestha , Hema Achanta

As large language models (LLMs) continue to evolve, it is critical to assess the security threats and vulnerabilities that may arise both during their training phase and after models have been deployed. This survey seeks to define and…

Cryptography and Security · Computer Science 2025-05-05 Francisco Aguilera-Martínez , Fernando Berzal

Pattern classification systems are commonly used in adversarial applications, like biometric authentication, network intrusion detection, and spam filtering, in which data can be purposely manipulated by humans to undermine their operation.…

Machine Learning · Computer Science 2017-09-05 Battista Biggio , Giorgio Fumera , Fabio Roli

We address the problem of distributed state estimation of a linear dynamical process in an attack-prone environment. Recent attempts to solve this problem impose stringent redundancy requirements on the measurement and communication…

Systems and Control · Electrical Eng. & Systems 2020-01-22 Aritra Mitra , Faiq Ghawash , Shreyas Sundaram , Waseem Abbas

Language-based information flow methods offer a principled way to enforce strong security properties, but enforcing noninterference is too inflexible for realistic applications. Security-typed languages have therefore introduced…

Programming Languages · Computer Science 2015-07-01 Aslan Askarov , Andrew Myers