English
Related papers

Related papers: ICE-BeeM: Identifiable Conditional Energy-Based De…

200 papers

Identifiability of a single module in a network of transfer functions is determined by whether a particular transfer function in the network can be uniquely distinguished within a network model set, on the basis of data. Whereas previous…

Systems and Control · Electrical Eng. & Systems 2021-12-22 Shengling Shi , Xiaodong Cheng , Paul M. J. Van den Hof

Model identifiability is a desirable property in the context of unsupervised representation learning. In absence thereof, different models may be observationally indistinguishable while yielding representations that are nontrivially related…

Machine Learning · Statistics 2022-02-15 Shubhangi Ghosh , Luigi Gresele , Julius von Kügelgen , Michel Besserve , Bernhard Schölkopf

In this paper, we propose conjugate energy-based models (CEBMs), a new class of energy-based models that define a joint density over data and latent variables. The joint density of a CEBM decomposes into an intractable distribution over…

Machine Learning · Computer Science 2021-06-28 Hao Wu , Babak Esmaeili , Michael Wick , Jean-Baptiste Tristan , Jan-Willem van de Meent

In this paper, we address the problem of conditional modality learning, whereby one is interested in generating one modality given the other. While it is straightforward to learn a joint distribution over multiple modalities using a deep…

Computer Vision and Pattern Recognition · Computer Science 2016-08-29 Gaurav Pandey , Ambedkar Dukkipati

Recently, an extension of independent component analysis (ICA) from one to multiple datasets, termed independent vector analysis (IVA), has been the subject of significant research interest. IVA has also been shown to be a generalization of…

Machine Learning · Computer Science 2016-08-11 Matthew Anderson , Geng-Shen Fu , Ronald Phlypo , Tülay Adalı

In this paper we first analyzed the inductive bias underlying the data scattered across complex free energy landscapes (FEL), and exploited it to train deep neural networks which yield reduced and clustered representation for the FEL. Our…

Statistical Mechanics · Physics 2021-03-19 Jun Zhang , Yao-Kun Lei , Xing Che , Zhen Zhang , Yi Isaac Yang , Yi Qin Gao

This paper establishes fundamental results for statistical inference of diagnostic classification models (DCM). The results are developed at a high level of generality, applicable to essentially all diagnostic classification models. In…

Statistics Theory · Mathematics 2025-01-08 Guanhua Fang , Jingchen Liu , Zhiliang Ying

In recent years, there has been growing interest in jointly analyzing a foreground dataset, representing an experimental group, and a background dataset, representing a control group. The goal of such contrastive investigations is to…

Statistics Theory · Mathematics 2026-01-27 Kexin Wang , Aida Maraj , Anna Seigal

Unsupervised feature learning algorithms based on convolutional formulations of independent components analysis (ICA) have been demonstrated to yield state-of-the-art results in several action recognition benchmarks. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Sotirios P. Chatzis

Spatial Independent Component Analysis (ICA) is an increasingly used data-driven method to analyze functional Magnetic Resonance Imaging (fMRI) data. To date, it has been used to extract sets of mutually correlated brain regions without…

Applications · Statistics 2011-02-08 G. Varoquaux , S. Sadaghiani , P. Pinel , A. Kleinschmidt , J. B. Poline , B. Thirion

Reliable predictions from systems biology models require knowing whether parameters can be estimated from available data, and with what certainty. Identifiability analysis reveals whether parameters are learnable in principle (structural…

Identifiability is a necessary condition for successful parameter estimation of dynamic system models. A major component of identifiability analysis is determining the identifiable parameter combinations, the functional forms for the…

Quantitative Methods · Quantitative Biology 2013-10-07 Marisa C. Eisenberg , Michael A. L. Hayashi

Learning models of dynamical systems with external inputs, which may be, for example, nonsmooth or piecewise, is crucial for studying complex phenomena and predicting future state evolution, which is essential for applications such as…

Machine Learning · Computer Science 2025-04-16 Zhaoyi Li , Wenjie Mei , Ke Yu , Yang Bai , Shihua Li

A crucial design decision for any robot learning pipeline is the choice of policy representation: what type of model should be used to generate the next set of robot actions? Owing to the inherent multi-modal nature of many robotic tasks,…

Robotics · Computer Science 2023-09-13 Sumeet Singh , Stephen Tu , Vikas Sindhwani

Independent component analysis (ICA) is linked up with the problem of estimating a non linear functional of a density, for which optimal estimators are well known. The precision of ICA is analyzed from the viewpoint of functional spaces in…

Statistics Theory · Mathematics 2007-06-13 Pascal Barbedor

The inferential model (IM) framework provides valid prior-free probabilistic inference by focusing on predicting unobserved auxiliary variables. But, efficient IM-based inference can be challenging when the auxiliary variable is of higher…

Statistics Theory · Mathematics 2015-01-20 Ryan Martin , Chuanhai Liu

Cosine similarity is widely used to measure the similarity between two embeddings, while interpretations based on angle and correlation coefficient are common. In this study, we focus on the interpretable axes of embeddings transformed by…

Computation and Language · Computer Science 2024-12-18 Hiroaki Yamagiwa , Momose Oyama , Hidetoshi Shimodaira

A parameter of a mathematical model is structurally identifiable if it can be determined from noiseless experimental data. Here, we examine the identifiability properties of two important classes of linear compartmental models:…

Dynamic networks are structured interconnections of dynamical systems (modules) driven by external excitation and disturbance signals. In order to identify their dynamical properties and/or their topology consistently from measured data, we…

Systems and Control · Computer Science 2018-04-12 Harm H. M. Weerts , Paul M. J. Van den Hof , Arne G. Dankers

We are interested in consistent estimation of the mixing matrix in the ICA model, when the error distribution is close to (but different from) Gaussian. In particular, we consider $n$ independent samples from the ICA model $X = A\epsilon$,…

Statistics Theory · Mathematics 2014-08-26 Alexander Sokol , Marloes H. Maathuis , Benjamin Falkeborg