English
Related papers

Related papers: Solving Non-identifiable Latent Feature Models

200 papers

Multi-sensor state space models underpin fusion applications in networks of sensors. Estimation of latent parameters in these models has the potential to provide highly desirable capabilities such as network self-calibration. Conventional…

Systems and Control · Computer Science 2018-01-04 Murat Uney , Bernard Mulgrew , Daniel E Clark

A key goal of unsupervised representation learning is "inverting" a data generating process to recover its latent properties. Existing work that provably achieves this goal relies on strong assumptions on relationships between the latent…

Machine Learning · Computer Science 2021-11-01 Kartik Ahuja , Jason Hartford , Yoshua Bengio

Nonignorable missing outcomes are common in real world datasets and often require strong parametric assumptions to achieve identification. These assumptions can be implausible or untestable, and so we may forgo them in favour of partially…

Methodology · Statistics 2023-10-19 Daniel Daly-Grafstein , Paul Gustafson

In this paper, we prove that finite state space non parametric hidden Markov models are identifiable as soon as the transition matrix of the latent Markov chain has full rank and the emission probability distributions are linearly…

Methodology · Statistics 2013-06-20 Elisabeth Gassiat , Alice Cleynen , Stéphane Robin

Identifiability is a desirable property of a statistical model: it implies that the true model parameters may be estimated to any desired precision, given sufficient computational resources and data. We study identifiability in the context…

Machine Learning · Statistics 2020-07-09 Geoffrey Roeder , Luke Metz , Diederik P. Kingma

With nonignorable missing data, likelihood-based inference should be based on the joint distribution of the study variables and their missingness indicators. These joint models cannot be estimated from the data alone, thus requiring the…

Statistics Theory · Mathematics 2017-01-06 Mauricio Sadinle , Jerome P. Reiter

Factor models are widely used to reduce dimensionality in modeling high-dimensional data. However, there remains a need for models that can be reliably fit in modest sample sizes and are identifiable, interpretable, and flexible. To address…

Methodology · Statistics 2025-06-19 Maoran Xu , Steven Winter , Amy H. Herring , David B. Dunson

Bayesian Neural Networks with Latent Variables (BNN+LVs) capture predictive uncertainty by explicitly modeling model uncertainty (via priors on network weights) and environmental stochasticity (via a latent input noise variable). In this…

Machine Learning · Computer Science 2022-09-19 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

Interpreting data is central to modern research. Large language models (LLMs) show promise in providing such natural language interpretations of data, yet simple feature extraction methods such as prompting often fail to produce accurate…

Artificial Intelligence · Computer Science 2025-05-30 Michal Bravansky , Vaclav Kubon , Suhas Hariharan , Robert Kirk

Structural identifiability is an important property of parametric ODE models. When conducting an experiment and inferring the parameter value from the time-series data, we want to know if the value is globally, locally, or non-identifiable.…

Discrete Mathematics · Computer Science 2024-06-25 Natali Gogishvili

We are often interested in explaining data through a set of hidden factors or features. When the number of hidden features is unknown, the Indian Buffet Process (IBP) is a nonparametric latent feature model that does not bound the number of…

Machine Learning · Computer Science 2012-05-14 Finale Doshi-Velez , Zoubin Ghahramani

Semantic feature norms, lists of features that concepts do and do not possess, have played a central role in characterizing human conceptual knowledge, but require extensive human labor. Large language models (LLMs) offer a novel avenue for…

Computation and Language · Computer Science 2023-04-12 Kushin Mukherjee , Siddharth Suresh , Timothy T. Rogers

Identifiability concerns finding which unknown parameters of a model can be estimated from given input-output data. If some subset of the parameters of a model cannot be determined given input-output data, then we say the model is…

Algebraic Geometry · Mathematics 2014-11-03 Nicolette Meshkat , Seth Sullivant , Marisa Eisenberg

Latent Class Models (LCMs) are used to cluster multivariate categorical data (e.g. group participants based on survey responses). Traditional LCMs assume a property called conditional independence. This assumption can be restrictive,…

Machine Learning · Statistics 2024-06-19 Jesse Bowers , Steve Culpepper

The Linear Multistep Method Particle Filter (LMM PF) is a method for predicting the evolution in time of a evolutionary system governed by a system of differential equations. If some of the parameters of the governing equations are…

Numerical Analysis · Computer Science 2016-05-18 Daniela Calvetti , Salvatore Cuomo , Monica Pragliola , Erkki Somersalo , Gerardo Toraldo

Nonlinear dynamic models are widely used for characterizing functional forms of processes that govern complex biological pathway systems. Over the past decade, validation and further development of these models became possible due to data…

Methodology · Statistics 2019-08-13 Itai Dattner , Shota Gugushvili , Harold Ship , Eberhard O. Voit

How should researchers conduct causal inference when the outcome of interest is latent and measured imperfectly by multiple indicators? We develop a general nonparametric framework for identifying and estimating average treatment effects on…

Methodology · Statistics 2026-04-22 Jiawei Fu , Donald P. Green

Hierarchical learning models, such as mixture models and Bayesian networks, are widely employed for unsupervised learning tasks, such as clustering analysis. They consist of observable and hidden variables, which represent the given data…

Machine Learning · Statistics 2018-01-08 Keisuke Yamazaki

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

Identifying control-friendly models of nonlinear systems remains one of the major challenges at the intersection of system identification and control. The Linear Parameter-Varying (LPV) framework offers a promising solution, but existing…

Systems and Control · Electrical Eng. & Systems 2026-05-13 Roel Drenth , Jan H. Hoekstra , Maarten Schoukens , Roland Tóth