English
Related papers

Related papers: Theoretical Analysis of Relative Errors in Gradien…

200 papers

Although the distributed machine learning methods can speed up the training of large deep neural networks, the communication cost has become the non-negligible bottleneck to constrain the performance. To address this challenge, the gradient…

Machine Learning · Computer Science 2022-01-25 An Xu , Zhouyuan Huo , Heng Huang

Scalability is a major challenge in modern recommender systems. In sequential recommendations, full Cross-Entropy (CE) loss achieves state-of-the-art recommendation quality but consumes excessive GPU memory with large item catalogs,…

Information Retrieval · Computer Science 2024-08-15 Danil Gusak , Gleb Mezentsev , Ivan Oseledets , Evgeny Frolov

The paper introduces a white-box attack on computer vision models using SHAP values. It demonstrates how adversarial evasion attacks can compromise the performance of deep learning models by reducing output confidence or inducing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Frank Mollard , Marcus Becker , Florian Roehrbein

Parallel cyber--physical attacks (PCPA) can simultaneously damage physical transmission lines and disrupt measurement data transmission in power grids, severely impairing system situational awareness and attack diagnosis. This paper…

Systems and Control · Electrical Eng. & Systems 2026-01-06 Junhao Ren , Kai Zhao , Guangxiao Zhang , Xinghua Liu , Chao Zhai , Gaoxi Xiao

This paper presents an extremum seeking control algorithm with an adaptive step-size that adjusts the aggressiveness of the controller based on the quality of the gradient estimate. The adaptive step-size ensures that the integral-action…

Optimization and Control · Mathematics 2021-12-21 Claus Danielson , Scott A. Bortoff , Ankush Chakrabarty

Federated learning---multi-party, distributed learning in a decentralized environment---is vulnerable to model poisoning attacks, even more so than centralized learning approaches. This is because malicious clients can collude and send in…

Machine Learning · Computer Science 2021-10-20 Atul Sharma , Wei Chen , Joshua Zhao , Qiang Qiu , Somali Chaterji , Saurabh Bagchi

Projected Gradient Descent (PGD) is a strong and widely used first-order adversarial attack, yet its computational cost scales poorly, as all training samples undergo identical iterative inner-loop optimization despite contributing…

Machine Learning · Computer Science 2025-12-29 Youran Ye , Dejin Wang , Ajinkya Bhandare

An unobservable false data injection (FDI) attack on AC state estimation (SE) is introduced and its consequences on the physical system are studied. With a focus on understanding the physical consequences of FDI attacks, a bi-level…

Systems and Control · Computer Science 2016-11-17 Jingwen Liang , Lalitha Sankar , Oliver Kosut

We introduce two-scale loss functions for use in various gradient descent algorithms applied to classification problems via deep neural networks. This new method is generic in the sense that it can be applied to a wide range of machine…

Numerical Analysis · Mathematics 2021-09-03 Leonid Berlyand , Robert Creese , Pierre-Emmanuel Jabin

Recently, in the context of covariance matrix estimation, in order to improve as well as to regularize the performance of the Tyler's estimator [1] also called the Fixed-Point Estimator (FPE) [2], a "shrinkage" fixed-point estimator has…

Applications · Statistics 2015-06-18 Frederic Pascal , Yacine Chitour , Yihui Quek

Federated learning reduces the risk of information leakage, but remains vulnerable to attacks. We investigate how several neural network design decisions can defend against gradients inversion attacks. We show that overlapping gradients…

Machine Learning · Computer Science 2022-04-28 Shaltiel Eloul , Fran Silavong , Sanket Kamthe , Antonios Georgiadis , Sean J. Moran

Learned indexes are a class of index data structures that enable fast search by approximating the cumulative distribution function (CDF) using machine learning models (Kraska et al., SIGMOD'18). However, recent studies have shown that…

Machine Learning · Computer Science 2026-03-03 Atsuki Sato , Martin Aumüller , Yusuke Matsui

Floating-point arithmetic performance determines the overall performance of important applications, from graphics to AI. Meeting the IEEE-754 specification for floating-point requires that final results of addition, subtraction,…

Mathematical Software · Computer Science 2024-04-02 Lucas M. Dutton , Christopher Kumar Anand , Robert Enenkel , Silvia Melitta Müller

Learning and computation of equilibria are central problems in game theory, theory of computation, and artificial intelligence. In this work, we introduce proximal regret, a new notion of regret based on proximal operators that lies…

Computer Science and Game Theory · Computer Science 2025-11-06 Yang Cai , Constantinos Daskalakis , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

Adversarial examples are input examples that are specifically crafted to deceive machine learning classifiers. State-of-the-art adversarial example detection methods characterize an input example as adversarial either by quantifying the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yuhang Wu , Sunpreet S. Arora , Yanhong Wu , Hao Yang

A novel method for tackling the problem of imbalanced data in medical image segmentation is proposed in this work. In balanced cross entropy (CE) loss, which is a type of weighted CE loss, the weight assigned to each class is the in-verse…

Image and Video Processing · Electrical Eng. & Systems 2024-12-10 Seyed Mohsen Hosseini , Mahdieh Soleymani Baghshah

Multilevel sampling methods, such as multilevel and multifidelity Monte Carlo, multilevel stochastic collocation, or delayed acceptance Markov chain Monte Carlo, have become standard uncertainty quantification (UQ) tools for a wide class of…

Numerical Analysis · Mathematics 2025-10-01 Josef Martínek , Erin Carson , Robert Scheichl

Most evaluations of autonomous driving policies under adversarial conditions are conducted in simulation, due to cost efficiency and the absence of physical risk. However, purely virtual testing fails to capture structural inconsistencies,…

Artificial Intelligence · Computer Science 2026-05-06 Adithya Mohan , Xujun Xie , Venkatesh Thirugnana Sambandham , Torsten Schön

Adversarial examples (AE) with good transferability enable practical black-box attacks on diverse target models, where insider knowledge about the target models is not required. Previous methods often generate AE with no or very limited…

Machine Learning · Computer Science 2023-07-11 Tao Wu , Tie Luo , Donald C. Wunsch

Modern GPUs are equipped with tensor cores (TCs) that are commonly used for matrix multiplication in artificial intelligence workloads. However, because they have high computational throughput, they can lead to significant performance gains…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-01 Brian Curless , Michael Gowanlock
‹ Prev 1 4 5 6 7 8 10 Next ›