English
Related papers

Related papers: Theoretical Analysis of Relative Errors in Gradien…

200 papers

In this paper, we study the problem of how to defend classifiers against adversarial attacks that fool the classifiers using subtly modified input data. In contrast to previous works, here we focus on the white-box adversarial defense where…

Machine Learning · Computer Science 2019-09-16 Zudi Lin , Hanspeter Pfister , Ziming Zhang

Cognitive vulnerabilities shape human decision-making and arise primarily from two sources: (1) cognitive capabilities, which include disparities in knowledge, education, expertise, or access to information, and (2) cognitive biases, such…

Computer Science and Game Theory · Computer Science 2025-09-09 Ya-Ting Yang , Quanyan Zhu

Existing black-box attacks on deep neural networks (DNNs) so far have largely focused on transferability, where an adversarial instance generated for a locally trained model can "transfer" to attack other learning models. In this paper, we…

Machine Learning · Computer Science 2017-12-29 Arjun Nitin Bhagoji , Warren He , Bo Li , Dawn Song

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

Machine Learning · Computer Science 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

We derive computable error estimates for finite element approximations of linear elliptic partial differential equations (PDE) with rough stochastic coefficients. In this setting, the exact solutions contain high frequency content that…

Numerical Analysis · Mathematics 2018-09-18 Eric Joseph Hall , Håkon Hoel , Mattias Sandberg , Anders Szepessy , Raúl Tempone

Promoting the connectivity of curvilinear structures, such as neuronal processes in biomedical scans and blood vessels in CT images, remains a key challenge in semantic segmentation. Traditional pixel-wise loss functions, including…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Elyar Esmaeilzadeh , Ehsan Garaaghaji , Farzad Hallaji Azad , Doruk Oner

Forward gradient learning computes a noisy directional gradient and is a biologically plausible alternative to backprop for learning deep neural networks. However, the standard forward gradient algorithm, when applied naively, suffers from…

Machine Learning · Computer Science 2023-03-03 Mengye Ren , Simon Kornblith , Renjie Liao , Geoffrey Hinton

Deep gradient inversion attacks expose a serious threat to Federated Learning (FL) by accurately recovering private data from shared gradients. However, the state-of-the-art heavily relies on impractical assumptions to access excessive…

Cryptography and Security · Computer Science 2024-04-02 Yu Sun , Gaojian Xiong , Xianxun Yao , Kailang Ma , Jian Cui

We experimented with front-end enhanced neural models where a differentiable and fully convolutional model with a skip connection is added before a frozen backbone classifier. By training such composite models using a small learning rate…

Machine Learning · Computer Science 2025-08-25 Leonid Boytsov , Ameya Joshi , Filipe Condessa

Contrastive learning, commonly applied in large-scale multimodal models, often relies on data from diverse and often unreliable sources, which can include misaligned or mislabeled text-image pairs. This frequently leads to robustness issues…

Machine Learning · Computer Science 2025-02-04 Lijie Hu , Chenyang Ren , Huanyi Xie , Khouloud Saadi , Shu Yang , Zhen Tan , Jingfeng Zhang , Di Wang

Compression of floating-point data will play an important role in high-performance computing as data bandwidth and storage become dominant costs. Lossy compression of floating-point data is powerful, but theoretical results are needed to…

Numerical Analysis · Mathematics 2024-07-03 James Diffenderfer , Alyson Fox , Jeffrey Hittinger , Geoffrey Sanders , Peter Lindstrom

This paper considers a natural fault-tolerant shortest paths problem: for some constant integer $f$, given a directed weighted graph with no negative cycles and two fixed vertices $s$ and $t$, compute (either explicitly or implicitly) for…

Data Structures and Algorithms · Computer Science 2022-09-16 Virginia Vassilevska Williams , Eyob Woldeghebriel , Yinzhan Xu

Tilted (entropic) risk, obtained by applying a log-exponential transform to a base loss, is a well established tool in statistics and machine learning for emphasizing rare or high loss events while retaining a tractable optimization…

Machine Learning · Computer Science 2025-12-04 Vahid R. Ramezani , Benjamin Englard

Researchers have widely used exploratory factor analysis (EFA) to learn the latent structure underlying multivariate data. Rotation and regularised estimation are two classes of methods in EFA that they often use to find interpretable…

Methodology · Statistics 2023-02-01 Xinyi Liu , Gabriel Wallin , Yunxiao Chen , Irini Moustaki

The evaluation of final-iteration tracking performance is a formidable obstacle in distributed online optimization algorithms. To address this issue, this paper proposes a novel evaluation metric named distributed forgetting-factor regret…

Systems and Control · Electrical Eng. & Systems 2025-03-28 Lipo Mo , Jianjun Li , Min Zuo , Lei Wang

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

Machine Learning · Computer Science 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

Attacking semantic segmentation models is significantly harder than image classification models because an attacker must flip thousands of pixel predictions simultaneously. Standard pixel-wise cross-entropy (CE) is ill-suited to this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Alexander Matyasko , Xin Lou , Indriyati Atmosukarto , Wei Zhang

Finite-precision floating point arithmetic unavoidably introduces rounding errors which are traditionally bounded using a worst-case analysis. However, worst-case analysis might be overly conservative because worst-case errors can be…

Numerical Analysis · Mathematics 2019-12-11 Fredrik Dahlqvist , Rocco Salvia , George A Constantinides

Advanced Persistent Threats (APTs) have created new security challenges for critical infrastructures due to their stealthy, dynamic, and adaptive natures. In this work, we aim to lay a game-theoretic foundation by establishing a multi-stage…

Computer Science and Game Theory · Computer Science 2018-09-10 Linan Huang , Quanyan Zhu

Deep learning models have been shown to be vulnerable to adversarial attacks. In particular, gradient-based attacks have demonstrated high success rates recently. The gradient measures how each image pixel affects the model output, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Hanbin Hong , Yuan Hong , Yu Kong