中文
相关论文

相关论文: DeepGUM: Learning Deep Robust Regression with a Ga…

200 篇论文

This paper studies the binary classification of unbounded data from ${\mathbb R}^d$ generated under Gaussian Mixture Models (GMMs) using deep ReLU neural networks. We obtain $\unicode{x2013}$ for the first time $\unicode{x2013}$…

机器学习 · 统计学 2023-08-17 Tian-Yi Zhou , Xiaoming Huo

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

统计理论 · 数学 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

Current approaches to novelty or anomaly detection are based on deep neural networks. Despite their effectiveness, neural networks are also vulnerable to imperceptible deformations of the input data. This is a serious issue in critical…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Ranya Almohsen , Shivang Patel , Donald A. Adjeroh , Gianfranco Doretto

Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the…

统计理论 · 数学 2023-05-05 Pierre Alquier , Mathieu Gerber

In recent years, the learned local descriptors have outperformed handcrafted ones by a large margin, due to the powerful deep convolutional neural network architectures such as L2-Net [1] and triplet based metric learning [2]. However,…

计算机视觉与模式识别 · 计算机科学 2019-01-29 Yanwu Xu , Mingming Gong , Tongliang Liu , Kayhan Batmanghelich , Chaohui Wang

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

机器学习 · 计算机科学 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Regression models are used for inference and prediction in a wide range of applications providing a powerful scientific tool for researchers and analysts from different fields. In many research fields the amount of available data as well as…

统计方法学 · 统计学 2018-06-08 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

In this paper, we study the implicit regularization of the gradient descent algorithm in homogeneous neural networks, including fully-connected and convolutional neural networks with ReLU or LeakyReLU activations. In particular, we study…

机器学习 · 计算机科学 2021-01-01 Kaifeng Lyu , Jian Li

We study a robust online convex optimization framework, where an adversary can introduce outliers by corrupting loss functions in an arbitrary number of rounds k, unknown to the learner. Our focus is on a novel setting allowing unbounded…

机器学习 · 计算机科学 2024-08-13 Adarsh Barik , Anand Krishna , Vincent Y. F. Tan

The generalized linear model (GLM) plays a key role in regression analyses. In high-dimensional data, the sparse GLM has been used but it is not robust against outliers. Recently, the robust methods have been proposed for the specific…

机器学习 · 统计学 2026-05-15 Takayuki Kawashima , Hironori Fujisawa

Additive models belong to the class of structured nonparametric regression models that do not suffer from the curse of dimensionality. Finding the additive components that are nonzero when the true model is assumed to be sparse is an…

统计方法学 · 统计学 2025-05-08 Suneel Babu Chatla , Abhijit Mandal

To have a superior generalization, a deep learning neural network often involves a large size of training sample. With increase of hidden layers in order to increase learning ability, neural network has potential degradation in accuracy.…

机器学习 · 计算机科学 2019-01-01 Lianfa Li , Ying Fang , Jun Wu , Jinfeng Wang

In this paper, we consider robust nonparametric regression using deep neural networks with ReLU activation function. While several existing theoretically justified methods are geared towards robustness against identical heavy-tailed noise…

统计方法学 · 统计学 2023-11-01 Juntong Chen

We consider the task of robust non-linear regression in the presence of both inlier noise and outliers. Assuming that the unknown non-linear function belongs to a Reproducing Kernel Hilbert Space (RKHS), our goal is to estimate the set of…

机器学习 · 计算机科学 2017-08-02 George Papageorgiou , Pantelis Bouboulis , Sergios Theodoridis

Knowledge about historic landslide event occurrence is important for supporting disaster risk reduction strategies. Building upon findings from 2022 Landslide4Sense Competition, we propose a deep neural network based system for landslide…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Cam Le , Lam Pham , Jasmin Lampert , Matthias Schlögl , Alexander Schindler

Repeated measures of biomarkers have the potential of explaining hazards of survival outcomes. In practice, these measurements are intermittently measured and are known to be subject to substantial measurement error. Joint modelling of…

应用统计 · 统计学 2019-12-12 Lisa McFetridge , Ozgur Asar , Jonas Wallin

Deep neural networks are vulnerable to adversarial examples. Prior defenses attempted to make deep networks more robust by either changing the network architecture or augmenting the training set with adversarial examples, but both have…

密码学与安全 · 计算机科学 2018-12-11 Yongshuai Liu , Jiyu Chen , Hao Chen

We derive a convex optimization problem for the task of segmenting sequential data, which explicitly treats presence of outliers. We describe two algorithms for solving this problem, one exact and one a top-down novel approach, and we…

机器学习 · 计算机科学 2014-11-19 Itamar Katz , Koby Crammer

While deep learning models have shown remarkable performance in various tasks, they are susceptible to learning non-generalizable spurious features rather than the core features that are genuinely correlated to the true label. In this…

机器学习 · 计算机科学 2023-10-31 Yihe Deng , Yu Yang , Baharan Mirzasoleiman , Quanquan Gu