English
Related papers

Related papers: Weak Identification in Low-Dimensional Factor Mode…

200 papers

We propose a dynamic multiplicative factor model for process data, which arise from complex problem-solving items, an emerging testing mode in large-scale educational assessment. The proposed model can be viewed as an extension of the…

Methodology · Statistics 2026-02-26 Fangyi Chen , Hok Kan Ling , Zhiliang Ying

Identifiability concerns finding which unknown parameters of a model can be quantified from given input-output data. Many linear ODE models, used in systems biology and pharmacokinetics, are unidentifiable, which means that parameters can…

Algebraic Geometry · Mathematics 2013-12-12 Nicolette Meshkat , Seth Sullivant

Structural identifiability concerns the question of which unknown parameters of a model can be recovered from (perfect) input-output data. If all of the parameters of a model can be recovered from data, the model is said to be identifiable.…

Systems and Control · Electrical Eng. & Systems 2025-06-11 Nicolette Meshkat , Alexey Ovchinnikov , Thomas Scanlon

Factor analysis models explain dependence among observed variables by a smaller number of unobserved factors. A main challenge in confirmatory factor analysis is determining whether the factor loading matrix is identifiable from the…

Statistics Theory · Mathematics 2026-01-21 Nils Sturma , Miriam Kranzlmueller , Irem Portakal , Mathias Drton

We study modeling and identification of processes with a spectral density matrix of low rank. Equivalently, we consider processes having an innovation of reduced dimension for which Prediction Error Methods (PEM) algorithms are not directly…

Systems and Control · Electrical Eng. & Systems 2021-05-11 Giorgio Picci , Wenqi Cao , Anders Lindquist

In this letter, we propose a new identification criterion that guarantees the recovery of the low-rank latent factors in the nonnegative matrix factorization (NMF) model, under mild conditions. Specifically, using the proposed criterion, it…

Machine Learning · Computer Science 2018-03-14 Xiao Fu , Kejun Huang , Nicholas D. Sidiropoulos

Structural models that admit multiple reduced forms, such as game-theoretic models with multiple equilibria, pose challenges in practice, especially when parameters are set-identified and the identified set is large. In such cases,…

Econometrics · Economics 2021-01-29 Nathan Canen , Kyungchul Song

Low-rank adapters enable fine-tuning of large models with only a small number of parameters, thus reducing storage costs and minimizing the risk of catastrophic forgetting. However, they often pose optimization challenges, with poor…

Machine Learning · Computer Science 2024-12-16 Piotr Teterwak , Kate Saenko , Bryan A. Plummer , Ser-Nam Lim

We show that in a locally lambda-presentable category, every lambda(m)-injectivity class (i.e., the class of all the objects injective with respect to some class of lambda-presentable morphisms) is a weakly reflective subcategory determined…

Category Theory · Mathematics 2007-05-23 Michel Hebert

An approach to the acceleration of parametric weak classifier boosting is proposed. Weak classifier is called parametric if it has fixed number of parameters and, so, can be represented as a point into multidimensional space. Genetic…

Machine Learning · Computer Science 2009-06-05 Boris Yangel

A new type of robust estimation problem is introduced where the goal is to recover a statistical model that has been corrupted after it has been estimated from data. Methods are proposed for "repairing" the model using only the design and…

Statistics Theory · Mathematics 2020-05-21 Chao Gao , John Lafferty

The use of machine learning algorithms is an attractive way to produce very fast detector simulations for scattering reactions that can otherwise be computationally expensive. Here we develop a factorised approach where we deal with each…

Data Analysis, Statistics and Probability · Physics 2022-07-26 D. Darulis , R. Tyson , D. G. Ireland , D. I. Glazier , B. McKinnon , P. Pauli

This paper studies the principal components (PC) estimator for high dimensional approximate factor models with weak factors in that the factor loading ($\boldsymbol{\Lambda}^0$) scales sublinearly in the number $N$ of cross-section units,…

Econometrics · Economics 2024-02-12 Jungjun Choi , Ming Yuan

The method of estimation in Scott and Wild (Biometrika 84 (1997) 57--71 and J. Statist. Plann. Inference 96 (2001) 3--27) uses a reparametrization of the profile likelihood that often reduces the computation times dramatically. Showing the…

Statistics Theory · Mathematics 2012-05-10 Yuichi Hirose , Alan Lee

Low-variance gradient estimation is crucial for learning directed graphical models parameterized by neural networks, where the reparameterization trick is widely used for those with continuous variables. While this technique gives…

Machine Learning · Statistics 2016-11-07 Seiya Tokui , Issei sato

In the research on checking whether the underlying model is of parametric single-index structure with outliers in observations, the purpose of this paper is two-fold. First, a test that is robust against outliers is suggested. The Hampel's…

Methodology · Statistics 2015-10-13 Cuizhen Niu , Lixing Zhu

A common way to learn and analyze statistical models is to consider operations in the model parameter space. But what happens if we optimize in the parameter space and there is no one-to-one mapping between the parameter space and the…

Machine Learning · Computer Science 2022-06-20 Pascal Mattia Esser , Frank Nielsen

Replicability analysis aims to identify the findings that replicated across independent studies that examine the same features. We provide powerful novel replicability analysis procedures for two studies for FWER and for FDR control on the…

Methodology · Statistics 2019-03-01 Marina Bogomolov , Ruth Heller

When employing mechanistic models to study biological phenomena, practical parameter identifiability is important for making accurate predictions across wide range of unseen scenarios, as well as for understanding the underlying mechanisms.…

Quantitative Methods · Quantitative Biology 2023-10-19 Yue Liu , Kevin Suh , Philip K. Maini , Daniel J. Cohen , Ruth E. Baker

Identifying the number of factors in a high-dimensional factor model has attracted much attention in recent years and a general solution to the problem is still lacking. A promising ratio estimator based on the singular values of the lagged…

Methodology · Statistics 2018-01-23 Zeng Li , Qinwen Wang , Jianfeng Yao