English
Related papers

Related papers: The Stein hull

200 papers

We consider the problem of sparse estimation in a factor analysis model. A traditional estimation procedure in use is the following two-step approach: the model is estimated by maximum likelihood method and then a rotation technique is…

Methodology · Statistics 2013-03-18 Kei Hirose , Michio Yamamoto

Penalty methods relax the incompressibility condition and uncouple velocity and pressure. Experience with them indicates that the velocity error is sensitive to the choice of penalty parameter $\epsilon$. So far, there is no effective \'a…

Numerical Analysis · Mathematics 2024-04-19 Rui Fang

The occurrence of successive extreme observations can have an impact on society. In extreme value theory there are parameters to evaluate the effect of clustering of high values, such as the extremal index. The estimation of the extremal…

Methodology · Statistics 2021-08-03 Helena Ferreira , Marta Ferreira

A novel approach to quantile estimation in multivariate linear regression models with change-points is proposed: the change-point detection and the model estimation are both performed automatically, by adopting either the quantile fused…

Statistics Theory · Mathematics 2019-04-10 Gabriela Ciuperca , Matus Maciak

We consider the problem of controlling an unknown linear dynamical system in the presence of (nonstochastic) adversarial perturbations and adversarial convex loss functions. In contrast to classical control, the a priori determination of an…

Machine Learning · Computer Science 2020-01-22 Elad Hazan , Sham M. Kakade , Karan Singh

We propose a new risk-constrained reformulation of the standard Linear Quadratic Regulator (LQR) problem. Our framework is motivated by the fact that the classical (risk-neutral) LQR controller, although optimal in expectation, might be…

Systems and Control · Electrical Eng. & Systems 2020-10-30 Anastasios Tsiamis , Dionysios S. Kalogerias , Luiz F. O. Chamon , Alejandro Ribeiro , George J. Pappas

Sparse parametric models are of great interest in statistical learning and are often analyzed by means of regularized estimators. Pathwise methods allow to efficiently compute the full solution path for penalized estimators, for any…

Machine Learning · Statistics 2024-12-06 Alessandro De Gregorio , Francesco Iafrate

To improve the efficiency of Monte Carlo estimation, practitioners are turning to biased Markov chain Monte Carlo procedures that trade off asymptotic exactness for computational speed. The reasoning is sound: a reduction in variance due to…

Machine Learning · Statistics 2019-01-03 Jackson Gorham , Lester Mackey

The estimation of the extremal dependence structure is spoiled by the impact of the bias, which increases with the number of observations used for the estimation. Already known in the univariate setting, the bias correction procedure is…

Statistics Theory · Mathematics 2015-04-03 Anne-Laure Fougères , Laurens de Haan , Cécile Mercadier

This paper addresses the scalar regression problem through a novel solution to exactly optimize the Huber loss in a general semi-supervised setting, which combines multi-view learning and manifold regularization. We propose a principled…

Machine Learning · Computer Science 2016-06-28 Jacopo Cavazza , Vittorio Murino

We propose, analyze and test a new adaptive penalty scheme that picks the penalty parameter $\epsilon$ element by element small where $\nabla\cdot u^h$ is large. We start by analyzing and testing the new scheme on the most simple but…

Numerical Analysis · Mathematics 2022-06-28 Xihui Xie

In this paper, we study the problem of fair sequential decision making with biased linear bandit feedback. At each round, a player selects an action described by a covariate and by a sensitive attribute. The perceived reward is a linear…

Statistics Theory · Mathematics 2022-06-06 Solenne Gaucher , Alexandra Carpentier , Christophe Giraud

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke

We consider in this paper the multivariate regression problem, when the target regression matrix $A$ is close to a low rank matrix. Our primary interest in on the practical case where the variance of the noise is unknown. Our main…

Statistics Theory · Mathematics 2011-06-24 Christophe Giraud

Win statistics, including the win ratio, net benefit, and win odds, summarize treatment effects on hierarchical composite endpoints by sequentially comparing patient pairs on component outcomes ordered by clinical importance, proceeding to…

Methodology · Statistics 2026-05-27 Xi Fang , Fan Li

Control variates are a well-established tool to reduce the variance of Monte Carlo estimators. However, for large-scale problems including high-dimensional and large-sample settings, their advantages can be outweighed by a substantial…

Machine Learning · Statistics 2021-07-22 Shijing Si , Chris. J. Oates , Andrew B. Duncan , Lawrence Carin , François-Xavier Briol

Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this work, we propose and…

Machine Learning · Statistics 2024-09-09 Haoyu Jiang , Jason Xu

Penalized Least Squares are widely used in signal and image processing. Yet, it suffers from a major limitation since it requires fine-tuning of the regularization parameters. Under assumptions on the noise probability distribution,…

Machine Learning · Statistics 2020-05-13 Barbara Pascal , Samuel Vaiter , Nelly Pustelnik , Patrice Abry

We consider the problem of controlling a known linear dynamical system under stochastic noise, adversarially chosen costs, and bandit feedback. Unlike the full feedback setting where the entire cost function is revealed after each decision,…

Machine Learning · Computer Science 2020-07-03 Asaf Cassel , Tomer Koren

In this paper, we study the mixed-integer nonlinear set given by a separable quadratic constraint on continuous variables, where each continuous variable is controlled by an additional indicator. This set occurs pervasively in optimization…

Optimization and Control · Mathematics 2022-09-07 Andres Gomez , Weijun Xie