English
Related papers

Related papers: Weak convergence of the regularization path in pen…

200 papers

We study a class of robust mean estimators $\widehat{\mu}$ obtained by adaptively shrinking the weights of sample points far from a base estimator $\widehat{\kappa}$. Given a data-dependent scaling factor $\widehat{\alpha}$ and a weighting…

Statistics Theory · Mathematics 2025-12-17 Antônio Catão , Lucas Resende , Paulo Orenstein

This paper studies $\ell_1$ regularization with high-dimensional features for support vector machines with a built-in reject option (meaning that the decision of classifying an observation can be withheld at a cost lower than that of…

Statistics Theory · Mathematics 2012-01-06 Marten Wegkamp , Ming Yuan

Reconstructing lens potentials and lensed sources can easily become an underconstrained problem, even when the degrees of freedom are low, due to degeneracies, particularly when potential perturbations superimposed on a smooth lens are…

Astrophysics of Galaxies · Physics 2022-07-27 Georgios Vernardos , Leon V. E. Koopmans

In this paper, we consider the $\ell_0$ minimization problem whose objective function is the sum of $\ell_0$-norm and convex differentiable function. A variable metric type method which combines the PIHT method and the skill in quasi-newton…

Optimization and Control · Mathematics 2021-08-10 Xue Zhang , Xiaoqun Zhang

We develop a novel and general framework for reduced-bias $M$-estimation from asymptotically unbiased estimating functions. The framework relies on an empirical approximation of the bias by a function of derivatives of estimating function…

Methodology · Statistics 2023-08-11 Ioannis Kosmidis , Nicola Lunardon

The perturbative $\beta$-function is known exactly in a number of supersymmetric theories and in the 't Hooft renormalization scheme in the $\phi_4^4$ model. It is shown how this allows one to compute the effective action exactly for…

High Energy Physics - Theory · Physics 2009-11-11 V. Elias , D. G. C. McKeon

We present a new finite-sample analysis of M-estimators of locations in $\mathbb{R}^d$ using the tool of the influence function. In particular, we show that the deviations of an M-estimator can be controlled thanks to its influence function…

Statistics Theory · Mathematics 2022-08-23 Timothée Mathieu

This paper investigates simple bilevel optimization problems where we minimize an upper-level objective over the optimal solution set of a convex lower-level objective. Existing methods for such problems either only guarantee asymptotic…

Optimization and Control · Mathematics 2024-11-05 Pengyu Chen , Xu Shi , Rujun Jiang , Jiulin Wang

Let $s$ be a source point and $t$ be a destination point inside an $n$-vertex simple polygon $P$. Euclidean shortest paths and minimum-link paths between $s$ and $t$ inside $P$ have been well studied. Both these kinds of paths are simple…

Computational Geometry · Computer Science 2014-05-02 Arijit Bishnu , Subir Kumar Ghosh , Partha Pratim Goswami , Sudebkumar Prasant Pal , Swami Sarvattomananda

We design and mathematically analyze sampling-based algorithms for regularized loss minimization problems that are implementable in popular computational models for large data, in which the access to the data is restricted in some way. Our…

Machine Learning · Computer Science 2019-06-04 Ryan R. Curtin , Sungjin Im , Ben Moseley , Kirk Pruhs , Alireza Samadian

In this paper, we investigate the construction of a diffusion process whose time-marginal densities are constrained to belong to a given set at all time. The construction is obtained from a penalization approximation to the constraint set,…

Probability · Mathematics 2017-04-20 Jean-Francois Jabir

We consider nonparametric estimation of a regression function for a situation where precisely measured predictors are used to estimate the regression curve for coarsened, that is, less precise or contaminated predictors. Specifically, while…

Statistics Theory · Mathematics 2008-12-18 Aurore Delaigle , Peter Hall , Hans-Georg Müller

We address the challenge of estimating the hyperuniformity exponent $\alpha$ of a spatial point process, given only one realization of it. Assuming that the structure factor $S$ of the point process follows a vanishing power law at the…

Statistics Theory · Mathematics 2024-07-25 Gabriel Mastrilli , Bartłomiej Błaszczyszyn , Frédéric Lavancier

In this paper we investigate panel regression models with interactive fixed effects. We propose two new estimation methods that are based on minimizing convex objective functions. The first method minimizes the sum of squared residuals with…

Econometrics · Economics 2026-02-10 Hyungsik Roger Moon , Martin Weidner

Beck and Teboulle's FISTA for finding the minimizer of the sum of two convex functions is one of the most important algorithms of the past decades. While function value convergence of the iterates was known, the actual convergence of the…

Optimization and Control · Mathematics 2026-03-03 Heinz H. Bauschke , Walaa M. Moursi

We tackle the inverse problem of reconstructing an unknown finite measure $\mu$ from a noisy observation of a generalized moment of $\mu$ defined as the integral of a continuous and bounded operator $\Phi$ with respect to $\mu$. When only a…

Statistics Theory · Mathematics 2009-06-03 Jean-Michel Loubes , Paul Rochet

We consider the problem of estimating the slope parameter in circular functional linear regression, where scalar responses Y1,...,Yn are modeled in dependence of 1-periodic, second order stationary random functions X1,...,Xn. We consider an…

Statistics Theory · Mathematics 2010-10-01 Fabienne Comte , Jan Johannes

In the classic expert problem, $\Phi$-regret measures the gap between the learner's total loss and that achieved by applying the best action transformation $\phi \in \Phi$. A recent work by Lu et al., [2025] introduces an adaptive algorithm…

Machine Learning · Computer Science 2025-12-16 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

Regularized system identification is the major advance in system identification in the last decade. Although many promising results have been achieved, it is far from complete and there are still many key problems to be solved. One of them…

Systems and Control · Electrical Eng. & Systems 2023-04-05 Yue Ju , Biqiang Mu , Lennart Ljung , Tianshi Chen

Network meta-analysis (NMA) of rare events has attracted little attention in the literature. Until recently, networks of interventions with rare events were analyzed using the inverse-variance NMA approach. However, when events are rare the…

Methodology · Statistics 2021-09-22 Theodoros Evrenoglou , Ian White , Sivem Afach , Dimitris Mavridis , Anna Chaimani