English
Related papers

Related papers: Modeling Latent Variable Uncertainty for Loss-base…

200 papers

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

Uncertainty quantification is a key pillar of trustworthy machine learning. It enables safe reactions under unsafe inputs, like predicting only when the machine learning model detects sufficient evidence, discarding anomalous data, or…

Machine Learning · Computer Science 2024-08-27 Michael Kirchhof

We revisit a model for time-varying linear regression that assumes the unknown parameters evolve according to a linear dynamical system. Counterintuitively, we show that when the underlying dynamics are stable the parameters of this model…

Statistics Theory · Mathematics 2022-01-03 Ali Jadbabaie , Horia Mania , Devavrat Shah , Suvrit Sra

Hierarchical parametric models consisting of observable and latent variables are widely used for unsupervised learning tasks. For example, a mixture model is a representative hierarchical model for clustering. From the statistical point of…

Machine Learning · Statistics 2014-01-24 Keisuke Yamazaki

Latent or unobserved phenomena pose a significant difficulty in data analysis as they induce complicated and confounding dependencies among a collection of observed variables. Factor analysis is a prominent multivariate statistical modeling…

Methodology · Statistics 2020-06-22 Armeen Taeb , Venkat Chandrasekaran

We introduce an unsupervised formulation to estimate heteroscedastic uncertainty in retrieval systems. We propose an extension to triplet loss that models data uncertainty for each input. Besides improving performance, our formulation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ahmed Taha , Yi-Ting Chen , Teruhisa Misu , Abhinav Shrivastava , Larry Davis

We propose to learn latent graphical models when data have mixed variables and missing values. This model could be used for further data analysis, including regression, classification, ranking etc. It also could be used for imputing missing…

Methodology · Statistics 2015-11-17 Xiao Li , Jinzhu Jia , Yuan Yao

In this paper, we address the discovery of robotic options from demonstrations in an unsupervised manner. Specifically, we present a framework to jointly learn low-level control policies and higher-level policies of how to use them from…

Machine Learning · Computer Science 2020-06-30 Tanmay Shankar , Abhinav Gupta

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

Inferring causal relationships from observed data is an important task, yet it becomes challenging when the data is subject to various external interferences. Most of these interferences are the additional effects of external factors on…

Machine Learning · Computer Science 2025-11-14 Ruichu Cai , Xiaokai Huang , Wei Chen , Zijian Li , Zhifeng Hao

We consider deep multivariate models for heterogeneous collections of random variables. In the context of computer vision, such collections may e.g. consist of images, segmentations, image attributes, and latent variables. When developing…

Machine Learning · Computer Science 2026-02-03 Dmitrij Schlesinger , Boris Flach , Alexander Shekhovtsov

Learning and decision-making in domains with naturally high noise-to-signal ratio, such as Finance or Healthcare, is often challenging, while the stakes are very high. In this paper, we study the problem of learning and acting under a…

Machine Learning · Computer Science 2023-09-26 Yikai Zhang , Songzhu Zheng , Mina Dalirrooyfard , Pengxiang Wu , Anderson Schneider , Anant Raj , Yuriy Nevmyvaka , Chao Chen

Observed associations in a database may be due in whole or part to variations in unrecorded (latent) variables. Identifying such variables and their causal relationships with one another is a principal goal in many scientific and practical…

Machine Learning · Computer Science 2012-12-12 Ricardo Silva , Richard Scheines , Clark Glymour , Peter L. Spirtes

A new dynamic latent space eigenmodel (LSM) is proposed for weighted temporal networks. The model accommodates integer-valued weights, excess of zeros, time-varying node positions (features), and time-varying network sparsity. The latent…

Methodology · Statistics 2026-04-15 Roberto Casarin , Matteo Iacopini , Antonio Peruzzi

We propose a probabilistic graphical model realizing a minimal encoding of real variables dependencies based on possibly incomplete observation and an empirical cumulative distribution function per variable. The target application is a…

Probability · Mathematics 2015-08-28 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

One of the fundamental representation learning tasks is unsupervised sequential disentanglement, where latent codes of inputs are decomposed to a single static factor and a sequence of dynamic factors. To extract this latent information,…

Machine Learning · Computer Science 2025-10-09 Nimrod Berman , Ilan Naiman , Idan Arbiv , Gal Fadlon , Omri Azencot

Modelling uncertainty in Machine Learning models is essential for achieving safe and reliable predictions. Most research on uncertainty focuses on output uncertainty (predictions), but minimal attention is paid to uncertainty at inputs. We…

Machine Learning · Computer Science 2024-06-28 Matias Valdenegro-Toro , Ivo Pascal de Jong , Marco Zullich

Weakly-supervised learning is a paradigm for alleviating the scarcity of labeled data by leveraging lower-quality but larger-scale supervision signals. While existing work mainly focuses on utilizing a certain type of weak supervision, we…

Machine Learning · Statistics 2019-10-11 Yivan Zhang , Nontawat Charoenphakdee , Masashi Sugiyama

Recent progress in deep latent variable models has largely been driven by the development of flexible and scalable variational inference methods. Variational training of this type involves maximizing a lower bound on the log-likelihood,…

Machine Learning · Computer Science 2016-06-02 Andriy Mnih , Danilo J. Rezende

Annotators exhibit disagreement during data labeling, which can be termed as annotator label uncertainty. Annotator label uncertainty manifests in variations of labeling quality. Training with a single low-quality annotation per sample…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Chen Zhou , Mohit Prabhushankar , Ghassan AlRegib