English
Related papers

Related papers: Quasi Maximum Likelihood Estimation of High-Dimens…

200 papers

We develop estimation for potentially high-dimensional additive structural equation models. A key component of our approach is to decouple order search among the variables from feature or edge selection in a directed acyclic graph encoding…

Methodology · Statistics 2014-12-02 Peter Bühlmann , Jonas Peters , Jan Ernest

We study the fundamental problem of selecting optimal features for model construction. This problem is computationally challenging on large datasets, even with the use of greedy algorithm variants. To address this challenge, we extend the…

This work, for the first time, introduces two constant factor approximation algorithms with linear query complexity for non-monotone submodular maximization over a ground set of size $n$ subject to a knapsack constraint, $\mathsf{DLA}$ and…

Data Structures and Algorithms · Computer Science 2023-07-11 Canh V. Pham , Tan D. Tran , Dung T. K. Ha , My T. Thai

We propose a novel approximate factor model tailored for analyzing time-dependent curve data. Our model decomposes such data into two distinct components: a low-dimensional predictable factor component and an unpredictable error term. These…

Econometrics · Economics 2025-02-26 Sven Otto , Nazarii Salish

We study mixed models with a single grouping factor, where inference about unknown parameters requires optimizing a marginal likelihood defined by an intractable integral. Low-dimensional numerical integration techniques are regularly used…

Methodology · Statistics 2025-01-22 Alex Stringer , Blair Bilodeau , Yanbo Tang

In many applications, particularly in the natural sciences, the available high-dimensional set of features may contain variables that are not correlated with the response under consideration. Such irrelevant features can, in certain cases,…

Statistics Theory · Mathematics 2025-07-28 Gianluca Finocchio , Tatyana Krivobokova

We develop a factor analysis for mixed continuous and binary observed variables. To this end, we utilized a recently developed multivariate probability distribution for mixed-type random variables, the Gaussian-Grassmann distribution. In…

Methodology · Statistics 2025-12-12 Takashi Arai

We study the factor model problem, which aims to uncover low-dimensional structures in high-dimensional datasets. Adopting a robust data-driven approach, we formulate the problem as a saddle-point optimization. Our primary contribution is a…

Optimization and Control · Mathematics 2026-04-13 Shabnam Khodakaramzadeh , Soroosh Shafiee , Gabriel de Albuquerque Gleizer , Peyman Mohajerin Esfahani

This paper studies simultaneous feature selection and extraction in supervised and unsupervised learning. We propose and investigate selective reduced rank regression for constructing optimal explanatory factors from a parsimonious subset…

Methodology · Statistics 2016-10-27 Yiyuan She

This paper develops theory for feasible estimators of finite-dimensional parameters identified by general conditional quantile restrictions, under much weaker assumptions than previously seen in the literature. This includes instrumental…

Statistics Theory · Mathematics 2021-10-07 Luciano de Castro , Antonio F. Galvao , David M. Kaplan , Xin Liu

We consider the theory for the high-dimensional generalized linear model with the Lasso. After a short review on theoretical results in literature, we present an extension of the oracle results to the case of quasi-likelihood loss. We prove…

Statistics Theory · Mathematics 2013-01-07 Sara van de Geer , Patric Müller

A fundamental problem with nonlinear models is that maximum likelihood estimates are not guaranteed to exist. Though nonexistence is a well known problem in the binary response model literature, it presents significant challenges for other…

Econometrics · Economics 2026-05-07 Sergio Correia , Paulo Guimarães , Thomas Zylkin

Using observation data to estimate unknown parameters in computational models is broadly important. This task is often challenging because solutions are non-unique due to the complexity of the model and limited observation data. However,…

Methodology · Statistics 2018-12-18 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

Scientific explanation often requires inferring maximally predictive features from a given data set. Unfortunately, the collection of minimal maximally predictive features for most stochastic processes is uncountably infinite. In such…

Statistical Mechanics · Physics 2017-05-31 Sarah E. Marzen , James P. Crutchfield

The article considers parameter estimation constructing such as quasi-maximum likelyhood estimation and one step estimation in statistical models generated by solution of stochastic differential equation. It has been developed a software…

Statistics Theory · Mathematics 2021-03-12 Dmytro Ivanenko , Rostyslav Pogorielov

The bifactor model and its extensions are multidimensional latent variable models, under which each item measures up to one subdimension on top of the primary dimension(s). Despite their wide applications to educational and psychological…

Statistics Theory · Mathematics 2020-12-23 Guanhua Fang , Xin Xu , Jinxin Guo , Zhiliang Ying , Susu Zhang

Parametric high-dimensional regression analysis requires the usage of regularization terms to get interpretable models. The respective estimators can be regarded as regularized M-functionals which are naturally highly nonlinear. We study…

Statistics Theory · Mathematics 2019-09-04 Tino Werner

Fitting high-dimensional statistical models often requires the use of non-linear parameter estimation procedures. As a consequence, it is generally impossible to obtain an exact characterization of the probability distribution of the…

Methodology · Statistics 2014-04-03 Adel Javanmard , Andrea Montanari

This paper extends some prominent statistical results including \emph{Fisher Theorem and Wilks phenomenon} to the penalized maximum likelihood estimation with a quadratic penalization. It appears that sharp expansions for the penalized MLE…

Methodology · Statistics 2015-08-11 Vladimir Spokoiny

We consider the problem of constructing nonparametric undirected graphical models for high-dimensional functional data. Most existing statistical methods in this context assume either a Gaussian distribution on the vertices or linear…

Statistics Theory · Mathematics 2021-03-22 Eftychia Solea , Holger Dette
‹ Prev 1 8 9 10 Next ›