English
Related papers

Related papers: Piecewise Convex Function Estimation: Representati…

200 papers

This paper is concerned with a semiparametric partially linear regression model with unknown regression coefficients, an unknown nonparametric function for the non-linear component, and unobservable Gaussian distributed random errors. We…

Statistics Theory · Mathematics 2016-08-16 Irène Gannaz

In this paper, we propose a new regularization technique called "functional SCAD". We then combine this technique with the smoothing spline method to develop a smooth and locally sparse (i.e., zero on some sub-regions) estimator for the…

Statistics Theory · Mathematics 2020-09-21 Zhenhua Lin , Jiguo Cao , Liangliang Wang , Haonan Wang

We introduce a novel function-on-function linear quantile regression model to characterize the entire conditional distribution of a functional response for a given functional predictor. Tensor cubic $B$-splines expansion is used to…

Methodology · Statistics 2025-04-01 Ufuk Beyaztas , Han Lin Shang , Semanur Saricam

The recovery of unknown signals from quadratic measurements finds extensive applications in fields such as phase retrieval, power system state estimation, and unlabeled distance geometry. This paper investigates the finite sample properties…

Statistics Theory · Mathematics 2026-04-15 Jun Fan , Jingyu Yang , Xinyu Zhang , Liqun Wang

The function-on-function regression model is fundamental for analyzing relationships between functional covariates and responses. However, most existing function-on-function regression methodologies assume independence between observations,…

Methodology · Statistics 2025-12-02 Ufuk Beyaztas , Han Lin Shang , Gizel Bakicierler Sezer

Graphical models trained using maximum likelihood are a common tool for probabilistic inference of marginal distributions. However, this approach suffers difficulties when either the inference process or the model is approximate. In this…

Machine Learning · Computer Science 2012-06-18 Justin Domke

This two-part paper is concerned with the problem of minimizing a linear objective function subject to a bilinear matrix inequality (BMI) constraint. In this part, we first consider a family of convex relaxations which transform BMI…

Optimization and Control · Mathematics 2018-09-27 Mohsen Kheirandishfard , Fariba Zohrizadeh , Ramtin Madani

The performance of penalized likelihood approaches depends profoundly on the selection of the tuning parameter; however, there is no commonly agreed-upon criterion for choosing the tuning parameter. Moreover, penalized likelihood estimation…

Methodology · Statistics 2018-05-09 Yang Liu , Peng Wang

We discuss the fundamental issue of identification in linear instrumental variable (IV) models with unknown IV validity. With the assumption of the "sparsest rule", which is equivalent to the plurality rule but becomes operational in…

Methodology · Statistics 2023-12-06 Yiqi Lin , Frank Windmeijer , Xinyuan Song , Qingliang Fan

Analyzing multi-layered graphical models provides insight into understanding the conditional relationships among nodes within layers after adjusting for and quantifying the effects of nodes from other layers. We obtain the penalized maximum…

Methodology · Statistics 2016-01-06 Jiahe Lin , Sumanta Basu , Moulinath Banerjee , George Michailidis

We address the problem of minimizing a convex smooth function $f(x)$ over a compact polyhedral set $D$ given a stochastic zeroth-order constraint feedback model. This problem arises in safety-critical machine learning applications, such as…

Optimization and Control · Mathematics 2019-12-10 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

We propose two novel approaches for estimating time-varying effects of functional predictors within a linear functional Cox model framework. This model allows for time-varying associations of a functional predictor observed at baseline,…

Methodology · Statistics 2024-12-20 Hongyu Du , Andrew Leroux

Semiparametric regression offers a flexible framework for modeling non-linear relationships between a response and covariates. A prime example are generalized additive models where splines (say) are used to approximate non-linear functional…

Statistics Theory · Mathematics 2018-10-05 Francis K. C. Hui , Chong You , Han Lin Shang , Samuel Müller

Surface reconstruction is a vital tool in a wide range of areas of medical image analysis and clinical research. Despite the fact that many methods have proposed solutions to the reconstruction problem, most, due to their deterministic…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Katarína Tóthová , Sarah Parisot , Matthew C. H. Lee , Esther Puyol-Antón , Lisa M. Koch , Andrew P. King , Ender Konukoglu , Marc Pollefeys

We present a convex approach to probabilistic segmentation and modeling of time series data. Our approach builds upon recent advances in multivariate total variation regularization, and seeks to learn a separate set of parameters for the…

Machine Learning · Statistics 2015-11-17 Matt Wytock , J. Zico Kolter

In some multivariate problems with missing data, pairs of variables exist that are never observed together. For example, some modern biological tools can produce data of this form. As a result of this structure, the covariance matrix is…

Methodology · Statistics 2013-08-13 Max Grazier G'Sell , Shai S. Shen-Orr , Robert Tibshirani

This paper focuses on variable selection for a partially linear single-index varying-coefficient model. A regularized variable selection procedure by combining basis function approximations with SCAD penalty is proposed. It can…

Statistics Theory · Mathematics 2024-12-19 Lijuan Han , Liugen Xue , Junshan Xie

Uncertainty estimation is critical in high-stakes machine learning applications. One effective way to estimate uncertainty is conformal prediction, which can provide predictive inference with statistical coverage guarantees. We present a…

Machine Learning · Computer Science 2023-11-03 Nathaniel Diamant , Ehsan Hajiramezanali , Tommaso Biancalani , Gabriele Scalia

Penalties that induce smoothness are common in nonparametric regression. In many settings, the amount of smoothness in the data generating function will not be known. Simon and Shojaie (2021) derived convergence rates for nonparametric…

Statistics Theory · Mathematics 2023-08-04 Marlena S. Bannick , Noah Simon

Conventional inverse optimization inputs a solution and finds the parameters of an optimization model that render a given solution optimal. The literature mostly focuses on inferring the objective function in linear problems when accepted…

Optimization and Control · Mathematics 2024-10-10 Houra Mahmoudzadeh , Kimia Ghobadi