English
Related papers

Related papers: Random Utility Models with Skewed Random Component…

200 papers

Variational inference (VI) is a widely used framework in Bayesian estimation. For most of the non-Gaussian statistical models, it is infeasible to find an analytically tractable solution to estimate the posterior distributions of the…

Machine Learning · Statistics 2020-01-31 Zhanyu Ma , Jalil Taghia , Jun Guo

Vanilla variational inference finds an optimal approximation to the Bayesian posterior distribution, but even the exact Bayesian posterior is often not meaningful under model misspecification. We propose predictive variational inference…

Machine Learning · Statistics 2026-03-31 Jinlin Lai , Antonio Linero , Yuling Yao

Structural equation models (SEMs) are commonly used to study the structural relationship between observed variables and latent constructs. Recently, Bayesian fitting procedures for SEMs have received more attention thanks to their potential…

Methodology · Statistics 2024-07-12 Khue-Dung Dang , Luca Maestrini , Francis K. C. Hui

We aim to analyze the behaviour of a finite-time stochastic system, whose model is not available, in the context of more rare and harmful outcomes. Standard estimators are not effective in making predictions about such outcomes due to their…

Methodology · Statistics 2022-07-29 Evan Arsenault , Yuheng Wang , Margaret P. Chapman

Estimating the expectations of functionals applied to sums of random variables (RVs) is a well-known problem encountered in many challenging applications. Generally, closed-form expressions of these quantities are out of reach. A naive…

Information Theory · Computer Science 2022-10-27 Eya Ben Amar , Nadhir Ben Rached , Abdul-Lateef Haji-Ali , Raúl Tempone

Scalable and effective exploration remains a key challenge in reinforcement learning (RL). While there are methods with optimality guarantees in the setting of discrete state and action spaces, these methods cannot be applied in…

Machine Learning · Computer Science 2017-01-30 Rein Houthooft , Xi Chen , Yan Duan , John Schulman , Filip De Turck , Pieter Abbeel

The classical multivariate extreme value theory tries to capture the extremal dependence between the components under a multivariate domain of attraction condition and it requires each of the components to be in the domain of attraction of…

Probability · Mathematics 2011-04-13 Rajat Subhra Hazra , Krishanu Maulik

Extreme value statistics provides accurate estimates for the small occurrence probabilities of rare events. While theory and statistical tools for univariate extremes are well-developed, methods for high-dimensional and complex data sets…

Methodology · Statistics 2021-01-06 Sebastian Engelke , Jevgenijs Ivanovs

Energy-based models (EBMs) are powerful probabilistic models, but suffer from intractable sampling and density evaluation due to the partition function. As a result, inference in EBMs relies on approximate sampling algorithms, leading to a…

Machine Learning · Computer Science 2020-01-10 Dieterich Lawson , George Tucker , Bo Dai , Rajesh Ranganath

Random features (RFs) are a popular technique to scale up kernel methods in machine learning, replacing exact kernel evaluations with stochastic Monte Carlo estimates. They underpin models as diverse as efficient transformers (by…

Machine Learning · Statistics 2024-10-04 Isaac Reid , Stratis Markou , Krzysztof Choromanski , Richard E. Turner , Adrian Weller

We propose a novel neural network architecture that enables non-parametric calibration and generation of multivariate extreme value distributions (MEVs). MEVs arise from Extreme Value Theory (EVT) as the necessary class of models when…

Machine Learning · Statistics 2022-03-03 Ali Hasan , Khalil Elkhalil , Yuting Ng , Joao M. Pereira , Sina Farsiu , Jose H. Blanchet , Vahid Tarokh

In natural phenomena, data distributions often deviate from normality. One can think of cataclysms as a self-explanatory example: events that occur almost never, and at the same time are many standard deviations away from the common…

Machine Learning · Computer Science 2022-12-16 Nuno Costa , Nuno Moniz

Relative Validity Indices (RVIs) such as the Silhouette Width Criterion and Davies Bouldin indices are the most widely used tools for evaluating and optimising clustering outcomes. Traditionally, their ability to rank collections of…

Learning models that can handle distribution shifts is a key challenge in domain generalization. Invariance learning, an approach that focuses on identifying features invariant across environments, improves model generalization by capturing…

Machine Learning · Statistics 2026-05-11 Yiran Jia , Jelena Bradic

This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Matrix Theory (RMT) as a zero information hypothesis, we…

Machine Learning · Computer Science 2025-11-07 Max Staats , Matthias Thamm , Bernd Rosenow

Mutualistic networks are used to study the structure and processes inherent to mutualistic relationships. In this paper, we introduce a random matrix ensemble (RME) representing the adjacency matrices of mutualistic networks composed by two…

Disordered Systems and Neural Networks · Physics 2021-11-10 C. T. Martínez-Martínez , J. A. Méndez-Bermúdez , Thomas Peron , Yamir Moreno

We study the characteristics of the Pickands' dependence function for bivariate extreme distribution for minima, BEVM, when considering the stochastics ordering of the two variables. The existing Pickand's dependence function terminologies…

Statistics Theory · Mathematics 2009-01-13 Mohd Bakri Adam

Invariant risk minimization (IRM) aims to enable out-of-distribution (OOD) generalization in deep learning by learning invariant representations. As IRM poses an inherently challenging bi-level optimization problem, most existing approaches…

Machine Learning · Computer Science 2025-05-26 Kotaro Yoshida , Konstantinos Slavakis

To overcome the sim-to-real gap in reinforcement learning (RL), learned policies must maintain robustness against environmental uncertainties. While robust RL has been widely studied in single-agent regimes, in multi-agent environments, the…

Machine Learning · Computer Science 2024-05-10 Laixi Shi , Eric Mazumdar , Yuejie Chi , Adam Wierman

Stochastic User Equilibrium (SUE) models depict the perception differences in traffic assignment problems. According to the assumption of an unbounded perceived travel time distribution, the conventional SUE problems result in a positive…

General Economics · Economics 2024-02-29 Songyot Kitthamkesorn , Anthony Chen