中文
相关论文

相关论文: Michscan: Black-Box Neural Network Integrity Check…

200 篇论文

Learning-based methods provide a promising approach to solving highly non-linear control tasks that are often challenging for classical control methods. To ensure the satisfaction of a safety property, learning-based methods jointly learn a…

机器学习 · 计算机科学 2024-12-18 Emily Yu , Đorđe Žikelić , Thomas A. Henzinger

As API access becomes a primary interface to large language models (LLMs), users often interact with black-box systems that offer little transparency into the deployed model. To reduce costs or maliciously alter model behaviors, API…

密码学与安全 · 计算机科学 2026-04-10 Xiaoyuan Zhu , Yaowen Ye , Tianyi Qiu , Hanlin Zhu , Sijun Tan , Ajraf Mannan , Jonathan Michala , Raluca Ada Popa , Willie Neiswanger

In-Memory Computing (IMC) introduces a new paradigm of computation that offers high efficiency in terms of latency and power consumption for AI accelerators. However, the non-idealities and defects of emerging technologies used in advanced…

Malware, or software designed with harmful intent, is an ever-evolving threat that can have drastic effects on both individuals and institutions. Neural network malware classification systems are key tools for combating these threats but…

密码学与安全 · 计算机科学 2024-04-09 Preston K. Robinette , Diego Manzanas Lopez , Serena Serbinowska , Kevin Leach , Taylor T. Johnson

Adversarial attacks on state-of-the-art machine learning models pose a significant threat to the safety and security of mission-critical autonomous systems. This paper considers the additional vulnerability of machine learning models when…

机器学习 · 计算机科学 2022-07-07 Cory Merkel

We study the problem of black-box optimization of a noisy function in the presence of low-cost approximations or fidelities, which is motivated by problems like hyper-parameter tuning. In hyper-parameter tuning evaluating the black-box…

机器学习 · 统计学 2018-10-25 Rajat Sen , Kirthevasan Kandasamy , Sanjay Shakkottai

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainability in…

密码学与安全 · 计算机科学 2022-10-12 Mark Huasong Meng , Guangdong Bai , Sin Gee Teo , Zhe Hou , Yan Xiao , Yun Lin , Jin Song Dong

As machine learning models become integral to security-sensitive applications, concerns over data leakage from adversarial attacks continue to rise. Model Inversion (MI) attacks pose a significant privacy threat by enabling adversaries to…

机器学习 · 计算机科学 2026-01-09 Hamed Poursiami , Ayana Moshruba , Maryam Parsa

In deep learning applications, robustness measures the ability of neural models that handle slight changes in input data, which could lead to potential safety hazards, especially in safety-critical applications. Pre-deployment assessment of…

软件工程 · 计算机科学 2024-04-26 Wenchuan Mu , Kwan Hui Lim

The opaque nature of transformer-based models, particularly in applications susceptible to unethical practices such as dark-patterns in user interfaces, requires models that integrate uncertainty quantification to enhance trust in…

Search-based testing is widely used to find bugs in models of complex Cyber-Physical Systems. Latest research efforts have improved this approach by casting it as a falsification procedure of formally specified temporal properties,…

计算机科学中的逻辑 · 计算机科学 2017-10-03 Simone Silvetti , Alberto Policriti , Luca Bortolussi

The rapid proliferation of deep neural networks (DNNs) across several domains has led to increasing concerns regarding intellectual property (IP) protection and model misuse. Trained DNNs represent valuable assets, often developed through…

密码学与安全 · 计算机科学 2026-03-17 Sangeeth B , Serena Nicolazzo , Deepa K. , Vinod P

In a world of increasing closed-source commercial machine learning models, model evaluations from developers must be taken at face value. These benchmark results-whether over task accuracy, bias evaluations, or safety checks-are…

Black-box finetuning is an emerging interface for adapting state-of-the-art language models to user needs. However, such access may also let malicious actors undermine model safety. To demonstrate the challenge of defending finetuning…

密码学与安全 · 计算机科学 2024-07-01 Danny Halawi , Alexander Wei , Eric Wallace , Tony T. Wang , Nika Haghtalab , Jacob Steinhardt

Machine learning (ML) techniques applied to quantum many-body physics have emerged as a new research field. While the numerical power of this approach is undeniable, the most expressive ML algorithms, such as neural networks, are black…

量子物理 · 物理学 2021-11-25 Anna Dawid , Patrick Huembeli , Michał Tomza , Maciej Lewenstein , Alexandre Dauphin

The recent Spectre attacks has demonstrated the fundamental insecurity of current computer microarchitecture. The attacks use features like pipelining, out-of-order and speculation to extract arbitrary information about the memory contents…

密码学与安全 · 计算机科学 2020-08-18 Roberto Guanciale , Musard Balliu , Mads Dam

Analog compute-in-memory (CIM) systems are promising for deep neural network (DNN) inference acceleration due to their energy efficiency and high throughput. However, as the use of DNNs expands, protecting user input privacy has become…

密码学与安全 · 计算机科学 2023-05-30 Ziyu Wang , Yuting Wu , Yongmo Park , Sangmin Yoo , Xinxin Wang , Jason K. Eshraghian , Wei D. Lu

The notion that collaborative machine learning can ensure privacy by just withholding the raw data is widely acknowledged to be flawed. Over the past seven years, the literature has revealed several privacy attacks that enable adversaries…

密码学与安全 · 计算机科学 2024-09-27 Federico Mazzone , Ahmad Al Badawi , Yuriy Polyakov , Maarten Everts , Florian Hahn , Andreas Peter

Auditing the use of data in training machine-learning (ML) models is an increasingly pressing challenge, as myriad ML practitioners routinely leverage the effort of content creators to train models without their permission. In this paper,…

密码学与安全 · 计算机科学 2025-01-28 Zonghao Huang , Neil Zhenqiang Gong , Michael K. Reiter

Nowadays, the use of machine learning models is becoming a utility in many applications. Companies deliver pre-trained models encapsulated as application programming interfaces (APIs) that developers combine with third party components and…

机器学习 · 计算机科学 2020-01-01 José Mena , Oriol Pujol , Jordi Vitrià