English
Related papers

Related papers: A Bayesian Robust Regression Method for Corrupted …

200 papers

Sparse recovery and subset selection are fundamental problems in varied communities, including signal processing, statistics and machine learning. Herein, we focus on an important greedy algorithm for these problems: Backward Stepwise…

Optimization and Control · Mathematics 2021-06-08 Sebatian Ament , Carla Gomes

This paper proposes a robust Bayesian accelerated failure time model for censored survival data. We develop a new family of life-time distributions using a scale mixture of the generalized gamma distributions, where we propose a novel super…

Methodology · Statistics 2025-04-16 Yasuyuki Hamura , Takahiro Onizuka , Shintaro Hashimoto , Shonosuke Sugasawa

Modern machine learning applications should be able to address the intrinsic challenges arising over inference on massive real-world datasets, including scalability and robustness to outliers. Despite the multiple benefits of Bayesian…

Machine Learning · Computer Science 2020-11-10 Dionysis Manousakas , Cecilia Mascolo

Bayesian inference usually requires running potentially costly inference procedures separately for every new observation. In contrast, the idea of amortized Bayesian inference is to initially invest computational cost in training an…

Machine Learning · Computer Science 2023-05-25 Manuel Glöckler , Michael Deistler , Jakob H. Macke

This paper introduces a loss-based generalized Bayesian methodology for high-dimensional robust regression with serially correlated errors and predictors. The proposed framework employs a novel scaled pseudo-Huber (SPH) loss function, which…

Methodology · Statistics 2025-03-13 Saptarshi Chakraborty , Kshitij Khare , George Michailidis

In this paper, we introduce a robust transfer regression method designed to handle corrupted labels in target data, under the scenarios that the corruption affects a substantial portion of the labels and the locations of these corruptions…

Methodology · Statistics 2025-02-25 Sheng Pan

Robust Mixture Prior (RMP) is a popular Bayesian dynamic borrowing method, which combines an informative historical distribution with a less informative component (referred as robustification component) in a mixture prior to enhance the…

Methodology · Statistics 2026-03-18 Marco Ratta , Gaelle Saint-Hilary , Mauro Gasparini , Pavel Mozgunov

In 1-bit compressed sensing, the aim is to estimate a $k$-sparse unit vector $x\in S^{n-1}$ within an $\epsilon$ error (in $\ell_2$) from minimal number of linear measurements that are quantized to just their signs, i.e., from measurements…

Information Theory · Computer Science 2023-10-13 Namiko Matsumoto , Arya Mazumdar

To improve accuracy and speed of regressions and classifications, we present a data-based prediction method, Random Bits Regression (RBR). This method first generates a large number of random binary intermediate/derived features based on…

Machine Learning · Statistics 2016-11-04 Yi Wang , Yi Li , Momiao Xiong , Li Jin

Machine learning for malware classification shows encouraging results, but real deployments suffer from performance degradation as malware authors adapt their techniques to evade detection. This phenomenon, known as concept drift, occurs as…

Cryptography and Security · Computer Science 2024-01-09 Federico Barbero , Feargus Pendlebury , Fabio Pierazzi , Lorenzo Cavallaro

We propose a new method, {\it robust binary fused compressive sensing} (RoBFCS), to recover sparse piece-wise smooth signals from 1-bit compressive measurements. The proposed method is a modification of our previous {\it binary fused…

Computer Vision and Pattern Recognition · Computer Science 2014-03-21 Xiangrong Zeng , Mário A. T. Figueiredo

In many longitudinal studies, the covariate and response are often intermittently observed at irregular, mismatched and subject-specific times. How to deal with such data when covariate and response are observed asynchronously is an often…

Methodology · Statistics 2021-08-27 Hao Ran , Yang Bai

We give the first polynomial-time algorithm for performing linear or polynomial regression resilient to adversarial corruptions in both examples and labels. Given a sufficiently large (polynomial-size) training set drawn i.i.d. from…

Machine Learning · Computer Science 2020-06-05 Adam Klivans , Pravesh K. Kothari , Raghu Meka

Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the…

Statistics Theory · Mathematics 2023-05-05 Pierre Alquier , Mathieu Gerber

We introduce a meta-learning algorithm for adversarially robust classification. The proposed method tries to be as model agnostic as possible and optimizes a dataset prior to its deployment in a machine learning system, aiming to…

Machine Learning · Computer Science 2023-02-01 Nikolaos Tsilivis , Jingtong Su , Julia Kempe

We study robust regression under a contamination model in which covariates are clean while the responses may be corrupted in an adaptive manner. Unlike the classical Huber's contamination model, where both covariates and responses may be…

Statistics Theory · Mathematics 2026-04-07 Ilias Diakonikolas , Chao Gao , Daniel M. Kane , Ankit Pensia , Dong Xie

Enhancing model robustness under new and even adversarial environments is a crucial milestone toward building trustworthy machine learning systems. Current robust training methods such as adversarial training explicitly uses an "attack"…

Machine Learning · Computer Science 2020-12-23 Minhao Cheng , Pin-Yu Chen , Sijia Liu , Shiyu Chang , Cho-Jui Hsieh , Payel Das

Adversarial training (AT) aims to improve the robustness of deep learning models by mixing clean data and adversarial examples (AEs). Most existing AT approaches can be grouped into restricted and unrestricted approaches. Restricted AT…

Machine Learning · Computer Science 2020-04-14 Haidong Xie , Xueshuang Xiang , Naijin Liu , Bin Dong

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

Methodology · Statistics 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

In this work we revisit two classic high-dimensional online learning problems, namely linear regression and contextual bandits, from the perspective of adversarial robustness. Existing works in algorithmic robust statistics make strong…

Machine Learning · Computer Science 2021-06-14 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau