English
Related papers

Related papers: Adversarial Orthogonal Regression: Two non-Linear …

200 papers

Orthogonal statistical learning and double machine learning have emerged as general frameworks for two-stage statistical prediction in the presence of a nuisance component. We establish non-asymptotic bounds on the excess risk of orthogonal…

Machine Learning · Statistics 2022-06-22 Lang Liu , Carlos Cinelli , Zaid Harchaoui

Additive regression provides an extension of linear regression by modeling the signal of a response as a sum of functions of covariates of relatively low complexity. We study penalized estimation in high-dimensional nonparametric additive…

Statistics Theory · Mathematics 2017-04-25 Zhiqiang Tan , Cun-Hui Zhang

Generating adversarial examples is the art of creating a noise that is added to an input signal of a classifying neural network, and thus changing the network's classification, while keeping the noise as tenuous as possible. While the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Roee Ben-Shlomo , Yevgeniy Men , Ido Imanuel

Contrastive learning relies on constructing a collection of negative examples that are sufficiently hard to discriminate against positive queries when their representations are self-trained. Existing contrastive learning methods either…

Machine Learning · Computer Science 2021-03-08 Qianjiang Hu , Xiao Wang , Wei Hu , Guo-Jun Qi

We study nonlinear regression of real valued data in an individual sequence manner, where we provide results that are guaranteed to hold without any statistical assumptions. We address the convergence and undertraining issues of…

Machine Learning · Computer Science 2014-10-08 N. Denizcan Vanli , Muhammed O. Sayin , Suleyman S. Kozat

Adversarial attacks refer to a set of methods that perturb the input to a classification model in order to fool the classifier. In this paper we apply different gradient based adversarial attack algorithms on five deep learning models…

Machine Learning · Computer Science 2019-08-16 Vinod Subramanian , Emmanouil Benetos , Ning Xu , SKoT McDonald , Mark Sandler

It is expensive to compute residual diffusivity in chaotic in-compressible flows by solving advection-diffusion equation due to the formation of sharp internal layers in the advection dominated regime. Proper orthogonal decomposition (POD)…

Computational Physics · Physics 2019-10-02 Jiancheng Lyu , Jack Xin , Yifeng Yu

Latent confounding has been a long-standing obstacle for causal reasoning from observational data. One popular approach is to model the data using acyclic directed mixed graphs (ADMGs), which describe ancestral relations between variables…

Machine Learning · Computer Science 2023-03-23 Matthew Ashman , Chao Ma , Agrin Hilmkil , Joel Jennings , Cheng Zhang

Understanding adversarial examples is crucial for improving model robustness, as they introduce imperceptible perturbations to deceive models. Effective adversarial examples, therefore, offer the potential to train more robust models by…

Machine Learning · Computer Science 2025-04-15 Xinheng Xie , Yue Wu , Cuiyu He

State-of-the-art machine learning models can be vulnerable to very small input perturbations that are adversarially constructed. Adversarial training is an effective approach to defend against such examples. It is formulated as a min-max…

Machine Learning · Statistics 2022-10-21 Antônio H. Ribeiro , Dave Zachariah , Thomas B. Schön

Algorithmic recourse aims to provide actionable recommendations to individuals to obtain a more favourable outcome from an automated decision-making system. As it involves reasoning about interventions performed in the physical world,…

Machine Learning · Statistics 2021-06-23 Julius von Kügelgen , Nikita Agarwal , Jakob Zeitler , Afsaneh Mastouri , Bernhard Schölkopf

Recent advances have established the identifiability of a directed acyclic graph (DAG) under additive noise models (ANMs), spurring the development of various causal discovery methods. However, most existing methods make restrictive model…

Machine Learning · Statistics 2026-04-24 Stella Huang , Qing Zhou

This paper demonstrates how to recover causal graphs from the score of the data distribution in non-linear additive (Gaussian) noise models. Using score matching algorithms as a building block, we show how to design a new generation of…

We analyze the properties of adversarial training for learning adversarially robust halfspaces in the presence of agnostic label noise. Denoting $\mathsf{OPT}_{p,r}$ as the best robust classification error achieved by a halfspace that is…

Machine Learning · Computer Science 2021-04-20 Difan Zou , Spencer Frei , Quanquan Gu

We provide the first oracle efficient sublinear regret algorithms for adversarial versions of the contextual bandit problem. In this problem, the learner repeatedly makes an action on the basis of a context and receives reward for the…

Machine Learning · Computer Science 2016-02-09 Vasilis Syrgkanis , Akshay Krishnamurthy , Robert E. Schapire

Existing segmentation models exhibit significant vulnerability to adversarial attacks.To improve robustness, adversarial training incorporates adversarial examples into model training. However, existing attack methods consider only global…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yufei Song , Ziqi Zhou , Menghao Deng , Yifan Hu , Shengshan Hu , Minghui Li , Leo Yu Zhang

Standard Direction of Arrival (DOA) estimation methods are typically derived based on the Gaussian noise assumption, making them highly sensitive to outliers. Therefore, in the presence of impulsive noise, the performance of these methods…

Machine Learning · Computer Science 2024-05-28 Y. Li , W. Xiao , L. Zhao , Z. Huang , Q. Li , L. Li , R. C. de Lamare

We demonstrate the existence of universal adversarial perturbations, which can fool a family of audio classification architectures, for both targeted and untargeted attack scenarios. We propose two methods for finding such perturbations.…

Machine Learning · Computer Science 2020-11-18 Sajjad Abdoli , Luiz G. Hafemann , Jerome Rony , Ismail Ben Ayed , Patrick Cardinal , Alessandro L. Koerich

This work proposes a machine-learning framework for constructing statistical models of errors incurred by approximate solutions to parameterized systems of nonlinear equations. These approximate solutions may arise from early termination of…

Numerical Analysis · Computer Science 2019-02-18 Brian A. Freno , Kevin T. Carlberg

Our objective is to estimate the unknown compositional input from its output response through an unknown system after estimating the inverse of the original system with a training set. The proposed methods using artificial neural networks…

Machine Learning · Computer Science 2020-01-27 Se Un Park