English
Related papers

Related papers: Solving Non-identifiable Latent Feature Models

200 papers

Probabilistic modeling is one of the foundations of modern machine learning and artificial intelligence. In this paper, we propose a novel type of probabilistic models named latent dependency forest models (LDFMs). A LDFM models the…

Artificial Intelligence · Computer Science 2016-11-22 Shanbo Chu , Yong Jiang , Kewei Tu

This paper presents a method for investigating, through an automatic procedure, the (lack of) identifiability of parametrized dynamical models. This method takes into account constraints on parameters and returns parameters whose…

Dynamical Systems · Mathematics 2016-10-11 Nathalie Verdière , Sébastien Orange

As one of the most commonly seen data challenges, missing data, in particular, multiple, non-monotone missing patterns, complicates estimation and inference due to the fact that missingness mechanisms are often not missing at random, and…

Methodology · Statistics 2025-04-21 Jianing Dong , Raymond K. W. Wong , Kwun Chuen Gary Chan

Mathematical models are invaluable for understanding and predicting how biological systems behave, although their construction requires specifying mechanisms and relationships that are often not perfectly known. In the presence of multiple…

This paper presents a data-driven algorithm for simultaneous system identification and parameter estimation in control-affine nonlinear systems. Parameter estimation is achieved by training a data-driven predictive model using state-action…

Optimization and Control · Mathematics 2026-04-28 Moad Abudia , Opeyemi Owolabi , Joel A. Rosenfeld , Rushikesh Kamalapurkar

We consider the problem of parameter estimation using weakly supervised datasets, where a training sample consists of the input and a partially specified annotation, which we refer to as the output. The missing information in the annotation…

Machine Learning · Computer Science 2012-06-22 M. Pawan Kumar , Ben Packer , Daphne Koller

In this paper, we propose a feature pioneering method using Large Language Models (LLMs). In the proposed method, we use Chat-GPT 1 to find new sensor locations and new features. Then we evaluate the machine learning model which uses the…

Human-Computer Interaction · Computer Science 2023-10-10 Haru Kaneko , Sozo Inoue

In this paper an adaptive state observer and parameter identification algorithm for a linear time-varying system are developed under condition that the state matrix of the system contains unknown time-varying parameters of a known form. The…

Systems and Control · Electrical Eng. & Systems 2024-02-22 Olga Kozachek , Nikolay Nikolaev , Olga Slita , Alexey Bobtsov

A novel framework is introduced to formalize identifiability in well-specified but ill-posed linear regression models. The framework is distribution-free and accommodates highly correlated features that may or may not relate to the…

Statistics Theory · Mathematics 2026-03-05 Gianluca Finocchio , Tatyana Krivobokova

We introduce a new approach to probabilistic unsupervised learning based on the recognition-parametrised model (RPM): a normalised semi-parametric hypothesis class for joint distributions over observed and latent variables. Under the key…

Machine Learning · Computer Science 2023-04-21 William I. Walker , Hugo Soulat , Changmin Yu , Maneesh Sahani

Structured latent attribute models (SLAMs) are a special family of discrete latent variable models widely used in social and biological sciences. This paper considers the problem of learning significant attribute patterns from a SLAM with…

Methodology · Statistics 2019-06-07 Yuqi Gu , Gongjun Xu

During the past few decades, missing-data problems have been studied extensively, with a focus on the ignorable missing case, where the missing probability depends only on observable quantities. By contrast, research into non-ignorable…

Methodology · Statistics 2019-08-06 Yukun Liu , Pengfei Li , Jing Qin

Deep latent variable models learn condensed representations of data that, hopefully, reflect the inner workings of the studied phenomena. Unfortunately, these latent representations are not statistically identifiable, meaning they cannot be…

Machine Learning · Statistics 2025-06-02 Stas Syrota , Yevgen Zainchkovskyy , Johnny Xi , Benjamin Bloem-Reddy , Søren Hauberg

In this work, we consider the problem of robust parameter estimation from observational data in the context of linear structural equation models (LSEMs). LSEMs are a popular and well-studied class of models for inferring causality in the…

Machine Learning · Computer Science 2020-07-15 Karthik Abinav Sankararaman , Anand Louis , Navin Goyal

Estimating population quantities such as mean outcomes from user feedback is fundamental to platform evaluation and social science, yet feedback is often missing not at random (MNAR): users with stronger opinions are more likely to respond,…

Machine Learning · Statistics 2026-02-19 Hongyu Chen , David Simchi-Levi , Ruoxuan Xiong

Latent class models have recently become popular for multiple-systems estimation in human rights applications. However, it is currently unknown when a given family of latent class models is identifiable in this context. We provide necessary…

Statistics Theory · Mathematics 2020-08-25 Serge Aleshin-Guendel

When a missing-data mechanism is NMAR or non-ignorable, missingness is itself vital information and it must be taken into the likelihood, which, however, needs to introduce additional parameters to be estimated. The incompleteness of the…

Methodology · Statistics 2014-05-15 Kosuke Morikawa , Yutaka Kano

Predictive modeling often faces challenges due to limited data availability and quality, especially in domains where collected features are weakly correlated with outcomes and where additional feature collection is constrained by ethical or…

Machine Learning · Computer Science 2024-10-08 Bingxuan Li , Pengyi Shi , Amy Ward

We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Such data often exhibit {\em longitudinal correlation} (LC)…

Machine Learning · Statistics 2019-11-25 Junjie Liang , Dongkuan Xu , Yiwei Sun , Vasant Honavar

The problem of identifiability of model parameters for open quantum systems is considered by investigating two-level dephasing systems. We discuss under which conditions full information about the Hamiltonian and dephasing parameters can be…

Quantum Physics · Physics 2015-01-15 Er-ling Gong , Weiwei Zhou , S. G. Schirmer , Zhi-Qiang Sun , Ming Zhang