English
Related papers

Related papers: Robust model training and generalisation with Stud…

200 papers

Normalizing flows provide a general mechanism for defining expressive probability distributions, only requiring the specification of a (usually simple) base distribution and a series of bijective transformations. There has been much recent…

Real-world data is laden with outlying values. The challenge for machine learning is that the learner typically has no prior knowledge of whether the feedback it receives (losses, gradients, etc.) will be heavy-tailed or not. In this work,…

Machine Learning · Statistics 2020-12-16 Matthew J. Holland

Sampling-based motion planning is the predominant paradigm in many real-world robotic applications, but its performance is immensely dependent on the quality of the samples. The majority of traditional planners are inefficient as they use…

Robotics · Computer Science 2020-10-23 Tin Lai , Fabio Ramos

Normalizing flows are an established approach for modelling complex probability densities through invertible transformations from a base distribution. However, the accuracy with which the target distribution can be captured by the…

Machine Learning · Statistics 2024-02-02 Harry Bevins , Will Handley , Thomas Gessey-Jones

Normalizing flows are a powerful class of generative models demonstrating strong performance in several speech and vision problems. In contrast to other generative models, normalizing flows are latent variable models with tractable…

Machine Learning · Computer Science 2021-08-06 Dmitry Baranchuk , Vladimir Aliev , Artem Babenko

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

Normalizing flows can transform a simple prior probability distribution into a more complex target distribution. Here, we evaluate the ability and efficiency of generative machine learning methods to sample the Boltzmann distribution of an…

Soft Condensed Matter · Physics 2024-09-16 Gerhard Jung , Giulio Biroli , Ludovic Berthier

We present elliptical processes, a family of non-parametric probabilistic models that subsume Gaussian processes and Student's t processes. This generalization includes a range of new heavy-tailed behaviors while retaining computational…

Machine Learning · Computer Science 2023-11-23 Maria Bånkestad , Jens Sjölund , Jalil Taghia , Thomas B. Schöon

Normalizing flows are a powerful class of generative models for continuous random variables, showing both strong model flexibility and the potential for non-autoregressive generation. These benefits are also desired when modeling discrete…

Machine Learning · Statistics 2019-06-06 Zachary M. Ziegler , Alexander M. Rush

Safe and reliable state estimation techniques are a critical component of next-generation robotic systems. Agents in such systems must be able to reason about the intentions and trajectories of other agents for safe and efficient motion…

Robotics · Computer Science 2023-06-28 Harrison Delecki , Liam A. Kruse , Marc R. Schlichting , Mykel J. Kochenderfer

Real-world data is often unbalanced and long-tailed, but deep models struggle to recognize rare classes in the presence of frequent classes. To address unbalanced data, most studies try balancing the data, the loss, or the classifier to…

Machine Learning · Computer Science 2021-11-02 Dvir Samuel , Gal Chechik

Normalizing flows have emerged as an important family of deep neural networks for modelling complex probability distributions. In this note, we revisit their coupling and autoregressive transformation layers as probabilistic graphical…

Machine Learning · Computer Science 2020-06-05 Antoine Wehenkel , Gilles Louppe

Modeling real-world distributions can often be challenging due to sample data that are subjected to perturbations, e.g., instrumentation errors, or added random noise. Since flow models are typically nonlinear algorithms, they amplify these…

Machine Learning · Computer Science 2022-10-11 Sameera Ramasinghe , Kasun Fernando , Salman Khan , Nick Barnes

Forecasting multivariate time series is a computationally intensive task challenged by extreme or redundant samples. Recent resampling methods aim to increase training efficiency by reweighting samples based on their running losses.…

Machine Learning · Computer Science 2024-06-21 Jiang You , Arben Cela , René Natowicz , Jacob Ouanounou , Patrick Siarry

Our goal is to develop a Bayesian model averaging technique in linear regression models that accommodates heavier tailed error densities than the normal distribution. Motivated by the use of the Huber loss function in the presence of…

Methodology · Statistics 2024-11-26 Shamriddha De , Joyee Ghosh

Diffusion models achieve state-of-the-art generation quality across many applications, but their ability to capture rare or extreme events in heavy-tailed distributions remains unclear. In this work, we show that traditional diffusion and…

Machine Learning · Computer Science 2024-10-30 Kushagra Pandey , Jaideep Pathak , Yilun Xu , Stephan Mandt , Michael Pritchard , Arash Vahdat , Morteza Mardani

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

We introduce ImitationFlow, a novel Deep generative model that allows learning complex globally stable, stochastic, nonlinear dynamics. Our approach extends the Normalizing Flows framework to learn stable Stochastic Differential Equations.…

Machine Learning · Computer Science 2020-10-27 Julen Urain , Michelle Ginesi , Davide Tateo , Jan Peters

Generative models, particularly normalizing flows, have shown exceptional performance in learning probability distributions across various domains of physics, including statistical mechanics, collider physics, and lattice field theory. In…

Strongly Correlated Electrons · Physics 2025-01-14 Dominic Schuh , Janik Kreit , Evan Berkowitz , Lena Funcke , Thomas Luu , Kim A. Nicoli , Marcel Rodekamp

We introduce a general class of continuous univariate distributions with positive support obtained by transforming the class of two-piece distributions. We show that this class of distributions is very flexible, easy to implement, and…

Applications · Statistics 2015-11-06 Francisco J. Rubio , Yili Hong