English
Related papers

Related papers: An Expectation-Maximization Algorithm for Domain A…

200 papers

We introduce a new predictive mechanism that operates in the presence of hidden confounding across distributionally diverse data sources while ensuring consistent estimation of causal parameters-despite their recognized suboptimality for…

Statistics Theory · Mathematics 2025-04-01 Carlos García Meixide , David Ríos Insua

A fundamental task in AI is providing performance guarantees for predictions made in unseen domains. In practice, there can be substantial uncertainty about the distribution of new data, and corresponding variability in the performance of…

Machine Learning · Computer Science 2025-04-01 Kasra Jalaldoust , Alexis Bellot , Elias Bareinboim

We aim for source-free domain adaptation, where the task is to deploy a model pre-trained on source domains to target domains. The challenges stem from the distribution shift from the source to the target domain, coupled with the…

Machine Learning · Computer Science 2022-10-20 Mengmeng Jing , Xiantong Zhen , Jingjing Li , Cees G. M. Snoek

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

Machine Learning · Computer Science 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

Scalable spatial GPs for massive datasets can be built via sparse Directed Acyclic Graphs (DAGs) where a small number of directed edges is sufficient to flexibly characterize spatial dependence. The DAG can be used to devise fast algorithms…

Methodology · Statistics 2025-03-31 Michele Peruzzi , Sudipto Banerjee , David B. Dunson , Andrew O. Finley

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

We study a class of weakly identifiable location-scale mixture models for which the maximum likelihood estimates based on $n$ i.i.d. samples are known to have lower accuracy than the classical $n^{- \frac{1}{2}}$ error. We investigate…

Statistics Theory · Mathematics 2021-11-17 Raaz Dwivedi , Nhat Ho , Koulik Khamaru , Martin J. Wainwright , Michael I. Jordan , Bin Yu

Expectation Maximization (EM) is among the most popular algorithms for estimating parameters of statistical models. However, EM, which is an iterative algorithm based on the maximum likelihood principle, is generally only guaranteed to find…

Statistics Theory · Mathematics 2016-08-30 Ji Xu , Daniel Hsu , Arian Maleki

Current domain adaptation methods under missingness shift are restricted to Missing At Random (MAR) missingness mechanisms. However, in many real-world examples, the MAR assumption may be too restrictive. When covariates are Missing Not At…

Methodology · Statistics 2025-04-02 Tyrel Stokes , Hyungrok Do , Saul Blecker , Rumi Chunara , Samrachana Adhikari

We propose an Anderson Acceleration (AA) scheme for the adaptive Expectation-Maximization (EM) algorithm for unsupervised learning a finite mixture model from multivariate data (Figueiredo and Jain 2002). The proposed algorithm is able to…

Machine Learning · Computer Science 2020-09-29 Truong Nguyen , Guangye Chen , Luis Chacon

We consider unsupervised domain adaptation (UDA) for classification problems in the presence of missing data in the unlabelled target domain. More precisely, motivated by practical applications, we analyze situations where distribution…

Machine Learning · Computer Science 2021-09-21 Matthieu Kirchmeyer , Patrick Gallinari , Alain Rakotomamonjy , Amin Mantrach

We propose a novel distributed expectation maximization (EM) method for non-cooperative RF device localization using a wireless sensor network. We consider the scenario where few or no sensors receive line-of-sight signals from the target.…

Information Theory · Computer Science 2014-08-15 Wenjie Xu , Francois Quitin , Mei Leng , Wee Peng Tay , Sirajudeen G. Razul

We give methods for Bayesian inference of directed acyclic graphs, DAGs, and the induced causal effects from passively observed complete data. Our methods build on a recent Markov chain Monte Carlo scheme for learning Bayesian networks,…

Machine Learning · Computer Science 2020-11-19 Jussi Viinikka , Antti Hyttinen , Johan Pensar , Mikko Koivisto

We propose a novel Bayesian model framework for discrete ordinal and count data based on conditional transformations of the responses. The conditional transformation function is estimated from the data in conjunction with an a priori chosen…

Methodology · Statistics 2022-05-19 Manuel Carlan , Thomas Kneib

We consider the problem of learning the underlying causal structure among a set of variables, which are assumed to follow a Bayesian network or, more specifically, a linear recursive structural equation model (SEM) with the associated…

Statistics Theory · Mathematics 2025-08-05 Anamitra Chaudhuri , Anirban Bhattacharya , Yang Ni

An essential problem in domain adaptation is to understand and make use of distribution changes across domains. For this purpose, we first propose a flexible Generative Domain Adaptation Network (G-DAN) with specific latent variables to…

Machine Learning · Statistics 2018-06-29 Mingming Gong , Kun Zhang , Biwei Huang , Clark Glymour , Dacheng Tao , Kayhan Batmanghelich

Domain generalization (DG) seeks to develop models that generalize well to unseen target domains, addressing the prevalent issue of distribution shifts in real-world applications. One line of research in DG focuses on aligning domain-level…

Machine Learning · Computer Science 2025-06-10 Yuen Chen , Haozhe Si , Guojun Zhang , Han Zhao

Dramatic increases in the size and dimensionality of many recent data sets make crucial the need for sophisticated methods that can exploit inherent structure and handle missing values. In this article we derive an expectation-maximization…

Methodology · Statistics 2013-09-26 Hunter Glanz , Luis Carvalho

It is shown how expectation maximization (EM) may be viewed as a message passing algorithm in factor graphs. In particular, a general EM message computation rule is identified. As a factor graph tool, EM may be used to break cycles in a…

Information Theory · Computer Science 2009-10-16 Justin Dauwels , Andrew Eckford , Sascha Korl , Hans-Andrea Loeliger

This research deals with the estimation and imputation of missing data in longitudinal models with a Poisson response variable inflated with zeros. A methodology is proposed that is based on the use of maximum likelihood, assuming that data…

Methodology · Statistics 2024-09-18 D. S. Martinez-Lobo , O. O. Melo , N. A. Cruz