English
Related papers

Related papers: On the Identifiability of Latent Models for Depend…

200 papers

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as…

Machine Learning · Computer Science 2024-12-02 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

In this study, we develop a latent factor model for analysing high-dimensional binary data. Specifically, a standard probit model is used to describe the regression relationship between the observed binary data and the continuous latent…

Methodology · Statistics 2024-04-15 Jiaxin Shi , Yuan Gao , Rui Pan , Hansheng Wang

Latent class models with covariates are widely used for psychological, social, and educational research. Yet the fundamental identifiability issue of these models has not been fully addressed. Among the previous research on the…

Methodology · Statistics 2025-01-08 Jing Ouyang , Gongjun Xu

The latent class model is a powerful tool for identifying latent classes within populations that share common characteristics for categorical data in social, psychological, and behavioral sciences. In this article, we propose two new…

Machine Learning · Computer Science 2023-10-31 Huan Qing

Modern time series forecasting methods, such as Transformer and its variants, have shown strong ability in sequential data modeling. To achieve high performance, they usually rely on redundant or unexplainable structures to model complex…

Machine Learning · Computer Science 2023-11-30 Jingyi Hou , Zhen Dong , Jiayu Zhou , Zhijie Liu

Mixture models have been widely used in modeling of continuous observations. For the possibility to estimate the parameters of a mixture model consistently on the basis of observations from the mixture, identifiability is a necessary…

Probability · Mathematics 2014-07-02 ZiQiang Shi , TieRan Zheng , JiQing Han

In this paper, a concurrent learning based adaptive observer is developed for a class of second-order linear time-invariant systems with uncertain system matrices. The developed technique yields an exponentially convergent state estimator…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar

Overcomplete latent representations have been very popular for unsupervised feature learning in recent years. In this paper, we specify which overcomplete models can be identified given observable moments of a certain order. We consider…

Machine Learning · Computer Science 2013-08-14 Animashree Anandkumar , Daniel Hsu , Majid Janzamin , Sham Kakade

Latent feature modeling allows capturing the latent structure responsible for generating the observed properties of a set of objects. It is often used to make predictions either for new values of interest or missing information in the…

Machine Learning · Statistics 2018-03-09 Isabel Valera , Melanie F. Pradier , Maria Lomeli , Zoubin Ghahramani

In this paper we consider the joint problems of state estimation and model identification for a class of continuous-time nonlinear systems in output-feedback canonical form. An adaptive observer is proposed that combines an extended…

Systems and Control · Electrical Eng. & Systems 2020-12-01 Michelangelo Bin , Lorenzo Marconi

The Latent Block Model (LBM) is a model-based method to cluster simultaneously the $d$ columns and $n$ rows of a data matrix. Parameter estimation in LBM is a difficult and multifaceted problem. Although various estimation strategies have…

Statistics Theory · Mathematics 2020-02-26 Vincent Brault , Christine Keribin , Mahendra Mariadassou

This paper establishes fundamental results for statistical inference of diagnostic classification models (DCM). The results are developed at a high level of generality, applicable to essentially all diagnostic classification models. In…

Statistics Theory · Mathematics 2025-01-08 Guanhua Fang , Jingchen Liu , Zhiliang Ying

Latent factor models are widely used to measure unobserved latent traits in social and behavioral sciences, including psychology, education, and marketing. When used in a confirmatory manner, design information is incorporated, yielding…

Methodology · Statistics 2019-06-14 Yunxiao Chen , Xiaoou Li , Siliang Zhang

Learning identifiable representations and models from low-level observations is helpful for an intelligent spacecraft to complete downstream tasks reliably. For temporal observations, to ensure that the data generating process is provably…

Machine Learning · Computer Science 2024-12-05 Congxi Zhang , Yongchun Xie

Suppose two Bayesian agents each learn a generative model of the same environment. We will assume the two have converged on the predictive distribution, i.e. distribution over some observables in the environment, but may have different…

Probability · Mathematics 2025-09-05 John Wentworth , David Lorell

Extracting time-varying latent variables from computational cognitive models is a key step in model-based neural analysis, which aims to understand the neural correlates of cognitive processes. However, existing methods only allow…

Machine Learning · Computer Science 2025-09-01 Ti-Fen Pan , Jing-Jing Li , Bill Thompson , Anne Collins

Machine learning (ML) and deep learning models are extensively used for parameter optimization and regression problems. However, not all inverse problems in ML are ``identifiable,'' indicating that model parameters may not be uniquely…

Machine Learning · Computer Science 2023-07-24 Reza Sameni

We consider a model identification problem in which an outcome variable contains nonignorable missing values. Statistical inference requires a guarantee of the model identifiability to obtain estimators enjoying theoretically reasonable…

Methodology · Statistics 2023-07-06 Kenji Beppu , Kosuke Morikawa

Latent variable models provide a powerful framework for incorporating and inferring unobserved factors in observational data. In causal inference, they help account for hidden factors influencing treatment or outcome, thereby addressing…

Machine Learning · Computer Science 2025-08-29 Tetsuro Morimura , Tatsushi Oka , Yugo Suzuki , Daisuke Moriwaki