中文
相关论文

相关论文: Fast Exact Conformalization of Lasso using Piecewi…

200 篇论文

Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels that are guaranteed to contain the true label with high…

机器学习 · 计算机科学 2025-03-11 Botong Zhang , Shuo Li , Osbert Bastani

In applied time-to-event analysis, a flexible parametric approach is to model the hazard rate as a piecewise constant function of time. However, the change points and values of the piecewise constant hazard are usually unknown and need to…

统计方法学 · 统计学 2024-08-08 Manuel Rosenbaum , Jan Beyersmann , Michael Vogt

We consider the least-square linear regression problem with regularization by the l1-norm, a problem usually referred to as the Lasso. In this paper, we present a detailed asymptotic analysis of model consistency of the Lasso. For various…

机器学习 · 计算机科学 2008-12-18 Francis Bach

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

Large-scale sequential data is often exposed to some degree of inhomogeneity in the form of sudden changes in the parameters of the data-generating process. We consider the problem of detecting such structural changes in a high-dimensional…

统计方法学 · 统计学 2016-01-15 Florencia Leonardi , Peter Bühlmann

We introduce a novel scheme for choosing the regularization parameter in high-dimensional linear regression with Lasso. This scheme, inspired by Lepski's method for bandwidth selection in non-parametric regression, is equipped with both…

统计方法学 · 统计学 2016-11-09 Michaël Chichignoud , Johannes Lederer , Martin Wainwright

We study the theoretical properties of the fused lasso procedure originally proposed by \cite{tibshirani2005sparsity} in the context of a linear regression model in which the regression coefficient are totally ordered and assumed to be…

统计理论 · 数学 2023-06-28 Fan Wang , Oscar Hernan Madrid Padilla , Yi Yu , Alessandro Rinaldo

Conformal inference is a statistical method used to construct prediction sets for point predictors, providing reliable uncertainty quantification with probability guarantees. This method utilizes historical labeled data to estimate the…

机器学习 · 计算机科学 2024-11-05 Xiaoyi Su , Zhixin Zhou , Rui Luo

This paper examines LASSO, a widely-used $L_{1}$-penalized regression method, in high dimensional linear predictive regressions, particularly when the number of potential predictors exceeds the sample size and numerous unit root regressors…

计量经济学 · 经济学 2024-01-17 Ziwei Mei , Zhentao Shi

Conformal prediction uses past experience to determine precise levels of confidence in new predictions. Given an error probability $\epsilon$, together with a method that makes a prediction $\hat{y}$ of a label $y$, it produces a set of…

机器学习 · 计算机科学 2019-04-23 Glenn Shafer , Vladimir Vovk

We study tools for inference conditioned on model selection events that are defined by the generalized lasso regularization path. The generalized lasso estimate is given by the solution of a penalized least squares regression problem, where…

统计方法学 · 统计学 2016-06-14 Sangwon Hyun , Max G'Sell , Ryan J. Tibshirani

The LASSO is an attractive regularisation method for linear regression that combines variable selection with an efficient computation procedure. This paper is concerned with enhancing the performance of LASSO for square-free hierarchical…

统计方法学 · 统计学 2023-05-10 Shaoxiong Hu , Hugo Maruri-Aguliar , Zixiang Ma

In high dimensional settings, sparse structures are crucial for efficiency, both in term of memory, computation and performance. It is customary to consider $\ell_1$ penalty to enforce sparsity in such scenarios. Sparsity enforcing methods,…

机器学习 · 统计学 2017-11-22 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Vincent Leclère , Joseph Salmon

In optimization, it is known that when the objective functions are strictly convex and well-conditioned, gradient-based approaches can be extremely effective, e.g., achieving the exponential rate of convergence. On the other hand, the…

机器学习 · 统计学 2023-03-08 Yujie Zhao , Xiaoming Huo

Conformal prediction is a popular uncertainty quantification method that augments a base predictor to return sets of predictions with statistically valid coverage guarantees. However, current methods are often computationally expensive and…

机器学习 · 计算机科学 2026-03-05 Laura Lützow , Michael Eichelbeck , Mykel J. Kochenderfer , Matthias Althoff

We propose the Bayesian adaptive Lasso (BaLasso) for variable selection and coefficient estimation in linear regression. The BaLasso is adaptive to the signal level by adopting different shrinkage for different coefficients. Furthermore, we…

统计方法学 · 统计学 2010-09-14 Chenlei Leng , Minh Ngoc Tran , David Nott

The Graphical Lasso (GLasso) algorithm is fast and widely used for estimating sparse precision matrices (Friedman et al., 2008). Its central role in the literature of high-dimensional covariance estimation rivals that of Lasso regression…

统计计算 · 统计学 2024-03-20 Aramayis Dallakyan , Mohsen Pourahmadi

We consider the least-square linear regression problem with regularization by the $\ell^1$-norm, a problem usually referred to as the Lasso. In this paper, we first present a detailed asymptotic analysis of model consistency of the Lasso in…

机器学习 · 计算机科学 2009-01-22 Francis Bach

The Lasso has been widely used as a method for variable selection, valued for its simplicity and empirical performance. However, Lasso's selection stability deteriorates in the presence of correlated predictors. Several approaches have been…

统计方法学 · 统计学 2025-11-05 Mahdi Nouraie , Houying Zhu , Samuel Muller

Forward stagewise regression follows a very simple strategy for constructing a sequence of sparse regression estimates: it starts with all coefficients equal to zero, and iteratively updates the coefficient (by a small amount $\epsilon$) of…

机器学习 · 统计学 2015-06-16 Ryan J. Tibshirani