English
Related papers

Related papers: On homogeneous pinning models and penalizations

200 papers

High-dimensional data pose challenges in statistical learning and modeling. Sometimes the predictors can be naturally grouped where pursuing the between-group sparsity is desired. Collinearity may occur in real-world high-dimensional…

Machine Learning · Statistics 2011-11-11 Yiyuan She

The problem of estimating ARMA models is computationally interesting due to the nonconcavity of the log-likelihood function. Recent results were based on the convex minimization. Joint model selection using penalization by a convex norm,…

Statistics Theory · Mathematics 2015-08-10 Stéphane Chrétien , Tianwen Wei , Basad Ali Hussain Al-sarray

We derive asymptotic properties of penalized estimators for singular models for which identifiability may break and the true parameter values can lie on the boundary of the parameter space. Selection consistency of the estimators is also…

Statistics Theory · Mathematics 2023-01-24 Junichiro Yoshida , Nakahiro Yoshida

Confounding can lead to spurious associations. Typically, one must observe confounders in order to adjust for them, but in high-dimensional settings, recent research has shown that it becomes possible to adjust even for unobserved…

Methodology · Statistics 2025-10-07 Yujing Lu , Patrick Breheny

This paper investigates the property of the penalized estimating equations when both the mean and association structures are modelled. To select variables for the mean and association structures sequentially, we propose a hierarchical…

Statistics Theory · Mathematics 2012-08-23 Xin Gao , Grace Y. Yi

This paper focuses on stochastic optimal control problems with constraints in law, which are rewritten as optimization (minimization) of probability measures problem on the canonical space. We introduce a penalized version of this type of…

Optimization and Control · Mathematics 2025-03-18 Thibaut Bourdais , Nadia Oudjane , Francesco Russo

We describe a simple, efficient, permutation based procedure for selecting the penalty parameter in the LASSO. The procedure, which is intended for applications where variable selection is the primary focus, can be applied in a variety of…

Machine Learning · Statistics 2014-04-09 Jeremy Sabourin , William Valdar , Andrew Nobel

Penalized spline smoothing is a popular and flexible method of obtaining estimates in nonparametric regression but the classical least-squares criterion is highly susceptible to model deviations and atypical observations. Penalized spline…

Methodology · Statistics 2021-01-12 Ioannis Kalogridis , Stefan Van Aelst

In this paper we survey and further study partial sums of a stationary process via approximation with a martingale with stationary differences. Such an approximation is useful for transferring from the martingale to the original process the…

Probability · Mathematics 2011-05-24 Magda Peligrad

Marginal models involve restrictions on the conditional and marginal association structure of a set of categorical variables. They generalize log-linear models for contingency tables, which are the fundamental tools for modelling the…

Methodology · Statistics 2023-04-10 Tamas Rudas , Wicher Bergsma

We compare a recently proposed multivariate spline based on mixed partial derivatives with two other standard splines for the scattered data smoothing problem. The splines are defined as the minimiser of a penalised least squares…

Numerical Analysis · Mathematics 2020-03-04 Elizabeth Harris , Bishnu Lamichhane , Quoc Thong Le Gia

In this paper, a new family of resampling-based penalization procedures for model selection is defined in a general framework. It generalizes several methods, including Efron's bootstrap penalization and the leave-one-out penalization…

Statistics Theory · Mathematics 2009-06-19 Sylvain Arlot

The paper considers parameter estimation in count data models using penalized likelihood methods. The motivating data consists of multiple independent count variables with a moderate sample size per variable. The data were collected during…

Methodology · Statistics 2026-04-15 Minh Thu Bui , Cornelis J. Potgieter , Akihito Kamata

We wish to estimate conditional density using Gaussian Mixture Regression model with logistic weights and means depending on the covariate. We aim at selecting the number of components of this model as well as the other parameters by a…

Statistics Theory · Mathematics 2013-04-10 Lucie Montuelle , Erwan Le Pennec , Serge Cohen

We formulate a principle for classification with the knowledge of the marginal distribution over the data points (unlabeled data). The principle is cast in terms of Tikhonov style regularization where the regularization penalty articulates…

Machine Learning · Computer Science 2012-12-12 Adrian Corduneanu , Tommi S. Jaakkola

We discuss the semiparametric modeling of mark-recapture-recovery data where the temporal and/or individual variation of model parameters is explained via covariates. Typically, in such analyses a fixed (or mixed) effects parametric model…

Applications · Statistics 2015-05-21 Théo Michelot , Roland Langrock , Thomas Kneib , Ruth King

In contrast to the usual procedure of estimating the distribution of a time series and then obtaining the quantile from the distribution, we develop a compensatory model to improve the quantile estimation under a given distribution…

Mathematical Finance · Quantitative Finance 2021-12-15 Shuzhen Yang

We study the problem of parameter estimation for large exchangeable interacting particle systems when a sample of discrete observations from a single particle is known. We propose a novel method based on martingale estimating functions…

Numerical Analysis · Mathematics 2024-01-30 Grigorios A. Pavliotis , Andrea Zanoni

Variable selection in cluster analysis is important yet challenging. It can be achieved by regularization methods, which realize a trade-off between the clustering accuracy and the number of selected variables by using a lasso-type penalty.…

Methodology · Statistics 2016-12-23 Marbac Matthieu , Sedki Mohammed

This manuscript proposes a novel empirical Bayes technique for regularizing regression coefficients in predictive models. When predictions from a previously published model are available, this empirical Bayes method provides a natural…

Applications · Statistics 2017-10-12 Derek K Smith , Loren E Smith , Brett Kroncke , Frederic T Billings , Jens Meiler , Jeffrey Blume