中文
相关论文

相关论文: Theoretical Analysis of Relative Errors in Gradien…

200 篇论文

In this paper, we study the problem of how to defend classifiers against adversarial attacks that fool the classifiers using subtly modified input data. In contrast to previous works, here we focus on the white-box adversarial defense where…

机器学习 · 计算机科学 2019-09-16 Zudi Lin , Hanspeter Pfister , Ziming Zhang

Cognitive vulnerabilities shape human decision-making and arise primarily from two sources: (1) cognitive capabilities, which include disparities in knowledge, education, expertise, or access to information, and (2) cognitive biases, such…

计算机科学与博弈论 · 计算机科学 2025-09-09 Ya-Ting Yang , Quanyan Zhu

Existing black-box attacks on deep neural networks (DNNs) so far have largely focused on transferability, where an adversarial instance generated for a locally trained model can "transfer" to attack other learning models. In this paper, we…

机器学习 · 计算机科学 2017-12-29 Arjun Nitin Bhagoji , Warren He , Bo Li , Dawn Song

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

机器学习 · 计算机科学 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

We derive computable error estimates for finite element approximations of linear elliptic partial differential equations (PDE) with rough stochastic coefficients. In this setting, the exact solutions contain high frequency content that…

数值分析 · 数学 2018-09-18 Eric Joseph Hall , Håkon Hoel , Mattias Sandberg , Anders Szepessy , Raúl Tempone

Promoting the connectivity of curvilinear structures, such as neuronal processes in biomedical scans and blood vessels in CT images, remains a key challenge in semantic segmentation. Traditional pixel-wise loss functions, including…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Elyar Esmaeilzadeh , Ehsan Garaaghaji , Farzad Hallaji Azad , Doruk Oner

Forward gradient learning computes a noisy directional gradient and is a biologically plausible alternative to backprop for learning deep neural networks. However, the standard forward gradient algorithm, when applied naively, suffers from…

机器学习 · 计算机科学 2023-03-03 Mengye Ren , Simon Kornblith , Renjie Liao , Geoffrey Hinton

Deep gradient inversion attacks expose a serious threat to Federated Learning (FL) by accurately recovering private data from shared gradients. However, the state-of-the-art heavily relies on impractical assumptions to access excessive…

密码学与安全 · 计算机科学 2024-04-02 Yu Sun , Gaojian Xiong , Xianxun Yao , Kailang Ma , Jian Cui

We experimented with front-end enhanced neural models where a differentiable and fully convolutional model with a skip connection is added before a frozen backbone classifier. By training such composite models using a small learning rate…

机器学习 · 计算机科学 2025-08-25 Leonid Boytsov , Ameya Joshi , Filipe Condessa

Contrastive learning, commonly applied in large-scale multimodal models, often relies on data from diverse and often unreliable sources, which can include misaligned or mislabeled text-image pairs. This frequently leads to robustness issues…

机器学习 · 计算机科学 2025-02-04 Lijie Hu , Chenyang Ren , Huanyi Xie , Khouloud Saadi , Shu Yang , Zhen Tan , Jingfeng Zhang , Di Wang

Compression of floating-point data will play an important role in high-performance computing as data bandwidth and storage become dominant costs. Lossy compression of floating-point data is powerful, but theoretical results are needed to…

This paper considers a natural fault-tolerant shortest paths problem: for some constant integer $f$, given a directed weighted graph with no negative cycles and two fixed vertices $s$ and $t$, compute (either explicitly or implicitly) for…

数据结构与算法 · 计算机科学 2022-09-16 Virginia Vassilevska Williams , Eyob Woldeghebriel , Yinzhan Xu

Tilted (entropic) risk, obtained by applying a log-exponential transform to a base loss, is a well established tool in statistics and machine learning for emphasizing rare or high loss events while retaining a tractable optimization…

机器学习 · 计算机科学 2025-12-04 Vahid R. Ramezani , Benjamin Englard

Researchers have widely used exploratory factor analysis (EFA) to learn the latent structure underlying multivariate data. Rotation and regularised estimation are two classes of methods in EFA that they often use to find interpretable…

统计方法学 · 统计学 2023-02-01 Xinyi Liu , Gabriel Wallin , Yunxiao Chen , Irini Moustaki

The evaluation of final-iteration tracking performance is a formidable obstacle in distributed online optimization algorithms. To address this issue, this paper proposes a novel evaluation metric named distributed forgetting-factor regret…

系统与控制 · 电气工程与系统科学 2025-03-28 Lipo Mo , Jianjun Li , Min Zuo , Lei Wang

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

机器学习 · 计算机科学 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

Attacking semantic segmentation models is significantly harder than image classification models because an attacker must flip thousands of pixel predictions simultaneously. Standard pixel-wise cross-entropy (CE) is ill-suited to this…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Alexander Matyasko , Xin Lou , Indriyati Atmosukarto , Wei Zhang

Finite-precision floating point arithmetic unavoidably introduces rounding errors which are traditionally bounded using a worst-case analysis. However, worst-case analysis might be overly conservative because worst-case errors can be…

数值分析 · 数学 2019-12-11 Fredrik Dahlqvist , Rocco Salvia , George A Constantinides

Advanced Persistent Threats (APTs) have created new security challenges for critical infrastructures due to their stealthy, dynamic, and adaptive natures. In this work, we aim to lay a game-theoretic foundation by establishing a multi-stage…

计算机科学与博弈论 · 计算机科学 2018-09-10 Linan Huang , Quanyan Zhu

Deep learning models have been shown to be vulnerable to adversarial attacks. In particular, gradient-based attacks have demonstrated high success rates recently. The gradient measures how each image pixel affects the model output, which…

计算机视觉与模式识别 · 计算机科学 2022-02-03 Hanbin Hong , Yuan Hong , Yu Kong