English
Related papers

Related papers: Prediction bounds for higher order total variation…

200 papers

We propose a general variational framework of fair clustering, which integrates an original Kullback-Leibler (KL) fairness term with a large class of clustering objectives, including prototype or graph based. Fundamentally different from…

Machine Learning · Computer Science 2020-12-07 Imtiaz Masud Ziko , Eric Granger , Jing Yuan , Ismail Ben Ayed

We consider the problem setting of prediction with expert advice with possibly heavy-tailed losses, i.e. the only assumption on the losses is an upper bound on their second moments, denoted by $\theta$. We develop adaptive algorithms that…

Machine Learning · Computer Science 2026-01-09 Antoine Moulin , Emmanuel Esposito , Dirk van der Hoeven

Variance reduction for causal inference in the presence of network interference is often achieved through either outcome modeling, typically analyzed under unit-randomized Bernoulli designs, or clustered experimental designs, typically…

Methodology · Statistics 2026-01-19 Matthew Eichhorn , Samir Khan , Johan Ugander , Christina Lee Yu

We construct an efficient numerical scheme for solving obstacle problems in divergence form. The numerical method is based on a reformulation of the obstacle in terms of an L1-like penalty on the variational problem. The reformulation is an…

Numerical Analysis · Mathematics 2014-04-08 Giang Tran , Hayden Schaeffer , William M. Feldman , Stanley J. Osher

We proposed a new penalized method in this paper to solve sparse Poisson Regression problems. Being different from $\ell_1$ penalized log-likelihood estimation, our new method can be viewed as penalized weighted score function method. We…

Statistics Theory · Mathematics 2017-03-14 Jinzhu Jia , Fang Xie , Lihu Xu

This work studies external regret in sequential prediction games with both positive and negative payoffs. External regret measures the difference between the payoff obtained by the forecasting strategy and the payoff of the best action. In…

Statistics Theory · Mathematics 2007-06-13 Nicolo Cesa-Bianchi , Yishay Mansour , Gilles Stoltz

The chaotic nature of fluid flow and the uncertainties in initial conditions limit predictability. Small errors that occur in the initial condition can grow exponentially until they saturate at $\mathcal{O}$(1). Ensemble forecasting…

Numerical Analysis · Mathematics 2024-07-16 Rui Fang

We give a general result concerning the rates of convergence of penalized empirical risk minimizers (PERM) in the regression model. Then, we consider the problem of agnostic learning of the regression, and give in this context an oracle…

Statistics Theory · Mathematics 2008-10-30 S. Gaïffas , G. Lecué

We tackle the problem of recovering an unknown signal observed in an ill-posed inverse problem framework. More precisely, we study a procedure commonly used in numerical analysis or image deblurring: minimizing an empirical loss function…

Statistics Theory · Mathematics 2007-09-18 J. M. Loubes

State estimation that combines observational data with mathematical models is central to many applications and is commonly addressed through filtering methods, such as ensemble Kalman filters. In this article, we examine the signal-tracking…

Numerical Analysis · Mathematics 2025-09-08 Nazanin Abedini , Jana de Wiljes , Svetlana Dubinkina

We consider a finite mixture of Gaussian regression model for high- dimensional data, where the number of covariates may be much larger than the sample size. We propose to estimate the unknown conditional mixture density by a maximum…

Statistics Theory · Mathematics 2014-09-05 Emilie Devijver

We introduce a new class of mean regression estimators -- penalized maximum tangent likelihood estimation -- for high-dimensional regression estimation and variable selection. We first explain the motivations for the key ingredient, maximum…

Methodology · Statistics 2017-08-23 Yichen Qin , Shaobo Li , Yang Li , Yan Yu

In this paper, we consider the minimization of a Tikhonov functional with an $\ell_1$ penalty for solving linear inverse problems with sparsity constraints. One of the many approaches used to solve this problem uses the Nemskii operator to…

Numerical Analysis · Mathematics 2020-08-26 Fabian Hinterer , Simon Hubmer , Ronny Ramlau

In a clustered observational study, a treatment is assigned to groups and all units within the group are exposed to the treatment. We develop a new method for statistical adjustment in clustered observational studies using approximate…

Methodology · Statistics 2023-03-06 Luke Keele , Eli Ben-Michael , Lindsay Page

We consider the problem of model selection type aggregation in the context of density estimation. We first show that empirical risk minimization is sub-optimal for this problem and it shares this property with the exponential weights…

Statistics Theory · Mathematics 2016-09-29 Pierre C. Bellec

In this paper, our aim is to analyse the generalization capabilities of first-order methods for statistical learning in multiple, different yet related, scenarios including supervised learning, transfer learning, robust learning and…

Machine Learning · Computer Science 2024-07-02 Kevin Scaman , Mathieu Even , Batiste Le Bars , Laurent Massoulié

In this paper we consider the trace regression model. Assume that we observe a small set of entries or linear combinations of entries of an unknown matrix $A_0$ corrupted by noise. We propose a new rank penalized estimator of $A_0$. For…

Statistics Theory · Mathematics 2011-09-14 Olga Klopp

The abundance of high-dimensional data in the modern sciences has generated tremendous interest in penalized estimators such as the lasso, scaled lasso, square-root lasso, elastic net, and many others. In this paper, we establish a general…

Statistics Theory · Mathematics 2018-03-14 Johannes Lederer , Lu Yu , Irina Gaynanova

We develop a Recursive $\mathcal{L}_1$-Regularized Least Squares (SPARLS) algorithm for the estimation of a sparse tap-weight vector in the adaptive filtering setting. The SPARLS algorithm exploits noisy observations of the tap-weight…

Information Theory · Computer Science 2009-01-08 Behtash Babadi , Nicholas Kalouptsidis , Vahid Tarokh

This paper derives a new variational equation for the linear least-squares backward error by expressing the backward error in terms of a generalized eigenvalue problem and using results from indefinite linear algebra. For problems with…

Numerical Analysis · Mathematics 2026-05-12 Eric Hallman