English
Related papers

Related papers: The Lagrange approach in the monotone single index…

200 papers

Dimensionality reduction is essential in simulation-based shape design, where high-dimensional parameterizations hinder optimization, surrogate modeling, and systematic design-space exploration. Parametric Model Embedding (PME) addresses…

Computational Engineering, Finance, and Science · Computer Science 2026-05-13 Andrea Serani , Giorgio Palma , Matteo Diez

In this paper, we mainly focus on the penalized maximum likelihood estimation (MLE) of the high-dimensional approximate factor model. Since the current estimation procedure can not guarantee the positive definiteness of the error covariance…

Computation · Statistics 2019-01-18 Shaoxin Wang , Hu Yang , Chaoli Yao

In this paper, we consider polynomial optimization with correlative sparsity. We construct correlatively sparse Lagrange multiplier expressions (CS-LMEs) and propose CS-LME reformulations for polynomial optimization problems using the…

Optimization and Control · Mathematics 2023-11-03 Zheng Qu , Xindong Tang

A Support Vector Method for multivariate performance measures was recently introduced by Joachims (2005). The underlying optimization problem is currently solved using cutting plane methods such as SVM-Perf and BMRM. One can show that these…

Machine Learning · Computer Science 2012-02-20 Xinhua Zhang , Ankan Saha , S. V. N. Vishwanatan

We present a systematic approach to the optimal placement of finitely many sensors in order to infer a finite-dimensional parameter from point evaluations of the solution of an associated parameter-dependent elliptic PDE. The quality of the…

Optimization and Control · Mathematics 2021-03-30 Ira Neitzel , Konstantin Pieper , Boris Vexler , Daniel Walter

We propose a novel randomized framework for the estimation problem of large-scale linear statistical models, namely Sequential Least-Squares Estimators with Fast Randomized Sketching (SLSE-FRS), which integrates Sketch-and-Solve and…

Machine Learning · Statistics 2025-09-09 Guan-Yu Chen , Xi Yang

We consider within a finite element approach the usage of different adaptively refined meshes for different variables in systems of nonlinear, time-depended PDEs. To resolve different solution behaviours of these variables, the meshes can…

Numerical Analysis · Mathematics 2010-05-27 Thomas Witkowski , Axel Voigt

In this paper, we introduce a powerful technique based on Leave-one-out analysis to the study of low-rank matrix completion problems. Using this technique, we develop a general approach for obtaining fine-grained, entrywise bounds for…

Machine Learning · Statistics 2020-06-18 Lijun Ding , Yudong Chen

Shuffled linear regression (SLR) seeks to estimate latent features through a linear transformation, complicated by unknown permutations in the measurement dimensions. This problem extends traditional least-squares (LS) and Least Absolute…

Statistics Theory · Mathematics 2025-04-17 Hang Liu , Anna Scaglione

We study statistical estimators computed using iterative optimization methods that are not run until completion. Classical results on maximum likelihood estimators (MLEs) assert that a one-step estimator (OSE), in which a single…

Optimization and Control · Mathematics 2021-06-28 Robert Bassett , Julio Deride

We consider the problem of estimating parameters of stochastic differential equations (SDEs) with discrete-time observations that are either completely or partially observed. The transition density between two observations is generally…

Methodology · Statistics 2015-09-09 Libo Sun , Chihoon Lee , Jennifer A. Hoeting

This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Augusto Aubry , Prabhu Babu , Antonio De Maio , Massimo Rosamilia

Broadband signal transmission over frequency-selective fading channel often requires accurate channel state information at receiver. One of the most attracting adaptive channel estimation methods is least mean square (LMS) algorithm.…

Information Theory · Computer Science 2013-04-16 Guan Gui , Abolfazl Mehbodniya , Fumiyuki Adachi

In this paper we study the computation of the nonparametric maximum likelihood estimator (NPMLE) in multivariate mixture models. Our first approach discretizes this infinite dimensional convex optimization problem by fixing the support…

Methodology · Statistics 2024-02-20 Yangjing Zhang , Ying Cui , Bodhisattva Sen , Kim-Chuan Toh

In a classical regression model, it is usually assumed that the explanatory variables are independent of each other and error terms are normally distributed. But when these assumptions are not met, situations like the error terms are not…

Statistics Theory · Mathematics 2017-09-08 Bahadır Yüzbaşı , Yasin Asar , Ahmet Demiralp , M. Şamil Şık

We introduce a new class of mean regression estimators -- penalized maximum tangent likelihood estimation -- for high-dimensional regression estimation and variable selection. We first explain the motivations for the key ingredient, maximum…

Methodology · Statistics 2017-08-23 Yichen Qin , Shaobo Li , Yang Li , Yan Yu

Penalized least squares methods are commonly used for simultaneous estimation and variable selection in high-dimensional linear models. In this paper we compare several prevailing methods including the lasso, nonnegative garrote, and SCAD…

Computation · Statistics 2014-05-09 Ke Zhang , Fan Yin , Shifeng Xiong

In this paper, we propose a novel method to select significant variables and estimate the corresponding coefficients in multiple-index models with a group structure. All existing approaches for single-index models cannot be extended…

Statistics Theory · Mathematics 2015-04-13 Tao Wang , Peirong Xu , Lixing Zhu

This paper aims at achieving a simultaneously sparse and low-rank estimator from the semidefinite population covariance matrices. We first benefit from a convex optimization which develops $l_1$-norm penalty to encourage the sparsity and…

Statistics Theory · Mathematics 2014-08-08 Shenglong Zhou , Naihua Xiu , Ziyan Luo , Lingchen Kong

This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least…

Methodology · Statistics 2016-05-11 Abhishek Kaul , Hira L. Koul , Akshita Chawla , Soumendra N. Lahiri