English
Related papers

Related papers: High-Dimensional Probability Estimation with Deep …

200 papers

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Out-of-distribution detection is crucial to the safe deployment of machine learning systems. Currently, unsupervised out-of-distribution detection is dominated by generative-based approaches that make use of estimates of the likelihood or…

The generalised linear model (GLM) is a very important tool for analysing real data in biology, sociology, agriculture, engineering and many other application domain where the relationship between the response and explanatory variables may…

Methodology · Statistics 2016-07-04 Abhik Ghosh , Ayanendranath Basu

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

Machine Learning · Computer Science 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

Diffusion models have shown remarkable performance on many generative tasks. Despite recent success, most diffusion models are restricted in that they only allow linear transformation of the data distribution. In contrast, broader family of…

Machine Learning · Computer Science 2024-06-04 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

In recent years there has been increased interest in understanding the interplay between deep generative models (DGMs) and the manifold hypothesis. Research in this area focuses on understanding the reasons why commonly-used DGMs succeed or…

Machine Learning · Computer Science 2024-09-27 Gabriel Loaiza-Ganem , Brendan Leigh Ross , Rasa Hosseinzadeh , Anthony L. Caterini , Jesse C. Cresswell

Methods for anomaly detection of new physics processes are often limited to low-dimensional spaces due to the difficulty of learning high-dimensional probability densities. Particularly at the constituent level, incorporating desirable…

High Energy Physics - Phenomenology · Physics 2024-03-06 Vinicius Mikuni , Benjamin Nachman

Nowadays, denoising diffusion probabilistic models have been adapted for many image segmentation tasks. However, existing end-to-end models have already demonstrated remarkable capabilities. Rather than using denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shi Zhenning , Dong Changsheng , Xie Xueshuo , Pan Bin , He Along , Li Tao

Density estimation is a fundamental problem in both statistics and machine learning. In this study, we proposed Roundtrip as a general-purpose neural density estimator based on deep generative models. Roundtrip retains the generative power…

Machine Learning · Computer Science 2021-04-27 Qiao Liu , Jiaze Xu , Rui Jiang , Wing Hung Wong

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

Uncertainty estimation is a crucial aspect of deploying dependable deep learning models in safety-critical systems. In this study, we introduce a novel and efficient method for deterministic uncertainty estimation called Discriminant…

Machine Learning · Computer Science 2024-02-21 Jiaxin Zhang , Kamalika Das , Sricharan Kumar

Density-functional theory is a formally exact description of a many-body quantum system in terms of its density; in practice, however, approximations to the universal density functional are required. In this work, a model based on deep…

Computational Physics · Physics 2016-08-02 Jeffrey M. McMahon

In recent years, neural network-based anomaly detection methods have attracted considerable attention in the hyperspectral remote sensing domain due to the powerful reconstruction ability compared with traditional methods. However, actual…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Shaoqi Yu , Xiaorun Li , Shuhan Chen , Liaoying Zhao

The multivariate hypergeometric distribution describes sampling without replacement from a discrete population of elements divided into multiple categories. Addressing a gap in the literature, we tackle the challenge of estimating discrete…

Machine Learning · Computer Science 2024-06-11 Liam Hodgson , Danilo Bzdok

Diffusion models indirectly estimate the probability density over a data space, which can be used to study its structure. In this work, we show that geodesics can be computed in diffusion latent space, where the norm induced by the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Qingtao Yu , Jaskirat Singh , Zhaoyuan Yang , Peter Henry Tu , Jing Zhang , Hongdong Li , Richard Hartley , Dylan Campbell

High-dimensional probability density estimation for inference suffers from the "curse of dimensionality". For many physical inference problems, the full posterior distribution is unwieldy and seldom used in practice. Instead, we propose…

Machine Learning · Statistics 2020-11-13 Niall Jeffrey , Benjamin D. Wandelt

The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Abdullah , Tao Huang , Ickjai Lee , Euijoon Ahn

Diffusion models (DMs) have emerged as a powerful class of generative AI models, showing remarkable potential in anomaly detection (AD) tasks across various domains, such as cybersecurity, fraud detection, healthcare, and manufacturing. The…

Machine Learning · Computer Science 2025-02-28 Jing Liu , Zhenchao Ma , Zepu Wang , Chenxuanyin Zou , Jiayang Ren , Zehua Wang , Liang Song , Bo Hu , Yang Liu , Victor C. M. Leung

The problem of distance metric learning is mostly considered from the perspective of learning an embedding space, where the distances between pairs of examples are in correspondence with a similarity metric. With the rise and success of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yehao Li , Ting Yao , Yingwei Pan , Hongyang Chao , Tao Mei

Although Convolutional Neural Networks (CNNs) have achieved promising results in image classification, they still are vulnerable to affine transformations including rotation, translation, flip and shuffle. The drawback motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Zijie Tan , Guanfang Dong , Chenqiu Zhao , Anup Basu