English
Related papers

Related papers: Density-based Feasibility Learning with Normalizin…

200 papers

Modern deep learning techniques have illustrated their excellent capabilities in many areas, but relies on large training data. Optimization-based meta-learning train a model on a variety tasks, such that it can solve new learning tasks…

Machine Learning · Computer Science 2023-02-23 Penghao Jiang , Ke Xin , Zifeng Wang , Chunxi Li

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-02-28 Zhen Fang , Yixuan Li , Jie Lu , Jiahua Dong , Bo Han , Feng Liu

Performance degradation owing to data heterogeneity and low output interpretability are the most significant challenges faced by federated learning in practical applications. Personalized federated learning diverges from traditional…

Machine Learning · Computer Science 2024-02-28 Mengen Luo , Chi Xu , Ercan Engin Kuruoglu

Beyond their impressive sampling capabilities, score-based diffusion models offer a powerful analysis tool in the form of unbiased density estimation of a query sample under the training data distribution. In this work, we investigate the…

Machine Learning · Computer Science 2023-10-12 Marius Arvinte , Cory Cornelius , Jason Martin , Nageen Himayat

Deep Neural Networks (DNNs) have demonstrated exceptional recognition capabilities in traditional computer vision (CV) tasks. However, existing CV models often suffer a significant decrease in accuracy when confronted with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Shuangchen Zhao , Changde Du , Hui Li , Huiguang He

In supervised machine learning, the assumption that training data is labelled correctly is not always satisfied. In this paper, we investigate an instance of labelling error for classification tasks in which the dataset is corrupted with…

Sound · Computer Science 2020-02-13 Turab Iqbal , Yin Cao , Qiuqiang Kong , Mark D. Plumbley , Wenwu Wang

Fueled by the expressive power of deep neural networks, normalizing flows have achieved spectacular success in generative modeling, or learning to draw new samples from a distribution given a finite dataset of training samples. Normalizing…

Machine Learning · Computer Science 2023-05-05 Yuehaw Khoo , Michael Lindsey , Hongli Zhao

The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

Machine Learning · Statistics 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

As deep learning methods form a critical part in commercially important applications such as autonomous driving and medical diagnostics, it is important to reliably detect out-of-distribution (OOD) inputs while employing these algorithms.…

Machine Learning · Computer Science 2018-09-12 Apoorv Vyas , Nataraj Jammalamadaka , Xia Zhu , Dipankar Das , Bharat Kaul , Theodore L. Willke

In this paper, we explore the potential of generative machine learning models as an alternative to the computationally expensive Monte Carlo (MC) simulations commonly used by the Large Hadron Collider (LHC) experiments. Our objective is to…

High Energy Physics - Experiment · Physics 2023-11-21 Allison Xu , Shuo Han , Xiangyang Ju , Haichen Wang

Centralized trajectory optimization in the joint space of multiple robots allows access to a larger feasible space that can result in smoother trajectories, especially while planning in tight spaces. Unfortunately, it is often…

Robotics · Computer Science 2026-04-22 Simon Idoko , Prajyot Jadhav , Arun Kumar Singh

Out-of-distribution (OOD) detection and lossless compression constitute two problems that can be solved by the training of probabilistic models on a first dataset with subsequent likelihood evaluation on a second dataset, where data…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Mingtian Zhang , Andi Zhang , Steven McDonagh

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Simulation-based inference provides a powerful framework for extracting rich information from nonlinear scales in current and upcoming cosmological surveys, and ensuring its robustness requires stringent validation of forward models. In…

Cosmology and Nongalactic Astrophysics · Physics 2025-08-12 Kangning Diao , Biwei Dai , Uros Seljak

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

We are interested in learning generative models for complex geometries described via manifolds, such as spheres, tori, and other implicit surfaces. Current extensions of existing (Euclidean) generative models are restricted to specific…

Machine Learning · Statistics 2021-11-04 Noam Rozen , Aditya Grover , Maximilian Nickel , Yaron Lipman

This paper proposes a new design method for a stochastic control policy using a normalizing flow (NF). In reinforcement learning (RL), the policy is usually modeled as a distribution model with trainable parameters. When this…

Robotics · Computer Science 2024-12-18 Taisuke Kobayashi , Takumi Aotani

Out-of-distribution (OOD) detection is crucial to modern deep learning applications by identifying and alerting about the OOD samples that should not be tested or used for making predictions. Current OOD detection methods have made…

Machine Learning · Computer Science 2023-09-22 Xinheng Wu , Jie Lu , Zhen Fang , Guangquan Zhang

For many applications, such as computing the expected value of different magnitudes, sampling from a known probability density function, the target density, is crucial but challenging through the inverse transform. In these cases, rejection…

Machine Learning · Computer Science 2020-03-24 Sebastian Pina-Otey , Thorsten Lux , Federico Sánchez , Vicens Gaitan