English
Related papers

Related papers: Invariant Modeling for Joint Distributions

200 papers

This paper is concerned with modeling the dependence structure of two (or more) time-series in the presence of a (possible multivariate) covariate which may include past values of the time series. We assume that the covariate influences…

Statistics Theory · Mathematics 2018-12-11 Natalie Neumeyer , Marek Omelka , Sarka Hudecova

Motivated by challenges in the analysis of biomedical data and observational studies, we develop statistical boosting for the general class of bivariate distributional copula regression with arbitrary marginal distributions, which is suited…

Methodology · Statistics 2024-03-05 Guillermo Briseño Sanchez , Nadja Klein , Hannah Klinkhammer , Andreas Mayr

Invariant risk minimization (IRM) aims to enable out-of-distribution (OOD) generalization in deep learning by learning invariant representations. As IRM poses an inherently challenging bi-level optimization problem, most existing approaches…

Machine Learning · Computer Science 2025-05-26 Kotaro Yoshida , Konstantinos Slavakis

Instance-wise feature selection and ranking methods can achieve a good selection of task-friendly features for each sample in the context of neural networks. However, existing approaches that assume feature subsets to be independent are…

Machine Learning · Computer Science 2023-08-02 Hanyu Peng , Guanhua Fang , Ping Li

Copula models of multivariate data are popular because they allow separate specification of marginal distributions and the copula function. These components can be treated as inter-related modules in a modified Bayesian inference approach…

Methodology · Statistics 2026-04-03 Lucas Kock , David T. Frazier , Michael Stanley Smith , David J. Nott

We develop a Bayesian approach for selecting the model which is the most supported by the data within a class of marginal models for categorical variables formulated through equality and/or inequality constraints on generalised logits…

Statistics Theory · Mathematics 2012-02-21 Francesco Bartolucci , Luisa Scaccia , Alessio Farcomeni

While there is substantial need for dependence models in higher dimensions, most existing models quickly become rather restrictive and barely balance parsimony and flexibility. Hierarchical constructions may improve on that by grouping…

Methodology · Statistics 2013-10-11 Eike Christian Brechmann

A fundamental problem in statistics is to compare the outcomes attained by members of subpopulations. This problem arises in the analysis of randomized controlled trials, in the analysis of A/B tests, and in the assessment of fairness and…

Methodology · Statistics 2021-12-02 Mark Tygert

We present a Bayesian mixture model for estimating the joint distribution of mixed ordinal, nominal, and continuous data conditional on a set of fixed variables. The model uses multivariate normal and categorical mixture kernels for the…

Methodology · Statistics 2016-07-14 Maria DeYoreo , Jerome P. Reiter

We introduce a copula mixture model to perform dependency-seeking clustering when co-occurring samples from different data sources are available. The model takes advantage of the great flexibility offered by the copulas framework to extend…

Methodology · Statistics 2012-07-03 Melanie Rey , Volker Roth

We present a joint copula-based model for insurance claims and sizes. It uses bivariate copulae to accommodate for the dependence between these quantities. We derive the general distribution of the policy loss without the restrictive…

Statistics Theory · Mathematics 2012-09-25 Nicole Kraemer , Eike C. Brechmann , Daniel Silvestrini , Claudia Czado

Independent component analysis (ICA) is a fundamental statistical tool used to reveal hidden generative processes from observed data. However, traditional ICA approaches struggle with the rotational invariance inherent in Gaussian…

Machine Learning · Computer Science 2024-08-21 Ignavier Ng , Yujia Zheng , Xinshuai Dong , Kun Zhang

We propose a method for inference in generalised linear mixed models (GLMMs) and several extensions of these models. First, we extend the GLMM by allowing the distribution of the random components to be non-Gaussian, that is, assuming an…

Methodology · Statistics 2021-07-27 Jeanett S. Pelck , Rodrigo Labouriau

A marginal problem asks whether a given family of marginal distributions for some set of random variables arises from some joint distribution of these variables. Here we point out that the existence of such a joint distribution imposes…

Information Theory · Computer Science 2013-01-25 Tobias Fritz , Rafael Chaves

When scholars study joint distributions of multiple variables, copulas are useful. However, if the variables are not linearly correlated with each other yet are still not independent, most of conventional copulas are not up to the task.…

Methodology · Statistics 2023-08-08 Kentaro Fukumoto

Automatic image annotation (AIA) raises tremendous challenges to machine learning as it requires modeling of data that are both ambiguous in input and output, e.g., images containing multiple objects and labeled with multiple semantic tags.…

Machine Learning · Computer Science 2012-03-19 Shuang Hong Yang , Jiang Bian , Hongyuan Zha

When approximating the joint distribution of the component counts of a decomposable combinatorial structure that is `almost' in the logarithmic class, but nonetheless has irregular structure, it is useful to be able first to establish that…

Probability · Mathematics 2010-11-02 A. D. Barbour , Anna Pósfai

While diffusion models have emerged as a powerful class of generative models, their learning dynamics remain poorly understood. We address this issue first by empirically showing that standard diffusion models trained on natural images…

Machine Learning · Statistics 2026-05-21 Lorenzo Bardone , Claudia Merger , Sebastian Goldt

This paper presents an introduction to the stochastic concepts of \emph{coupling} and \emph{copula}. Coupling means the construction of a joint distribution of two or more random variables that need not be defined on one and the same…

Methodology · Statistics 2015-11-18 Hans Colonius

We introduce a novel generative formulation of deep probabilistic models implementing "soft" constraints on their function dynamics. In particular, we develop a flexible methodological framework where the modeled functions and derivatives…

Machine Learning · Statistics 2018-06-19 Marco Lorenzi , Maurizio Filippone