English
Related papers

Related papers: CVAE-H: Conditionalizing Variational Autoencoders …

200 papers

Motion forecasting in highly interactive scenarios is a challenging problem in autonomous driving. In such scenarios, we need to accurately predict the joint behavior of interacting agents to ensure the safe and efficient navigation of…

Robotics · Computer Science 2022-08-15 Lingfeng Sun , Chen Tang , Yaru Niu , Enna Sachdeva , Chiho Choi , Teruhisa Misu , Masayoshi Tomizuka , Wei Zhan

To achieve high-levels of autonomy, modern robots require the ability to detect and recover from anomalies and failures with minimal human supervision. Multi-modal sensor signals could provide more information for such anomaly detection…

Robotics · Computer Science 2020-12-17 Tianchen Ji , Sri Theja Vuppala , Girish Chowdhary , Katherine Driggs-Campbell

Multi-Entity Dependence Learning (MEDL) explores conditional correlations among multiple entities. The availability of rich contextual information requires a nimble learning scheme that tightly integrates with deep neural networks and has…

Machine Learning · Computer Science 2017-09-19 Luming Tang , Yexiang Xue , Di Chen , Carla P. Gomes

One of the major shortcomings of variational autoencoders is the inability to produce generations from the individual modalities of data originating from mixture distributions. This is primarily due to the use of a simple isotropic Gaussian…

Machine Learning · Computer Science 2019-12-02 Frantzeska Lavda , Magda Gregorová , Alexandros Kalousis

This work proposes variational autoencoders (VAEs) to predict a vehicle's jerk signals from torque demand in the context of limited real-world drivetrain datasets. We implement both unconditional and conditional VAEs, trained on…

Variational Autoencoders (VAEs) have experienced recent success as data-generating models by using simple architectures that do not require significant fine-tuning of hyperparameters. However, VAEs are known to suffer from…

Machine Learning · Statistics 2020-07-22 Wei Cheng , Gregory Darnell , Sohini Ramachandran , Lorin Crawford

Variational Autoencoders (VAE) are popular generative models used to sample from complex data distributions. Despite their empirical success in various machine learning tasks, significant gaps remain in understanding their theoretical…

Machine Learning · Statistics 2025-12-23 Sobihan Surendran , Antoine Godichon-Baggioni , Sylvain Le Corff

Predicting future frames for a video sequence is a challenging generative modeling task. Promising approaches include probabilistic latent variable models such as the Variational Auto-Encoder. While VAEs can handle uncertainty and model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Lluis Castrejon , Nicolas Ballas , Aaron Courville

Adaptive controllers on quadrotors typically rely on estimation of disturbances to ensure robust trajectory tracking. Estimating disturbances across diverse environmental contexts is challenging due to the inherent variability and…

Robotics · Computer Science 2025-09-30 Kasra Torshizi , Chak Lam Shek , Khuzema Habib , Guangyao Shi , Pratap Tokekar , Troi Williams

In this technical report, we present our solutions to the Traffic4cast 2022 core challenge and extended challenge. In this competition, the participants are required to predict the traffic states for the future 15-minute based on the…

Machine Learning · Computer Science 2022-12-16 Leyan Deng , Chenwang Wu , Defu Lian , Min Zhou

A data-driven framework is proposed towards the end of predictive modeling of complex spatio-temporal dynamics, leveraging nested non-linear manifolds. Three levels of neural networks are used, with the goal of predicting the future state…

Computational Physics · Physics 2020-09-14 Jiayang Xu , Karthik Duraisamy

In this study, a deep learning based conditional density estimation technique known as conditional variational auto-encoder (CVAE) is used to fill gaps typically observed in particle image velocimetry (PIV) measurements in combustion…

Fluid Dynamics · Physics 2023-12-12 Shashank Yellapantula

Multi-agent trajectory forecasting in autonomous driving requires an agent to accurately anticipate the behaviors of the surrounding vehicles and pedestrians, for safe and reliable decision-making. Due to partial observability in these…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Seong Hyeon Park , Gyubok Lee , Manoj Bhat , Jimin Seo , Minseok Kang , Jonathan Francis , Ashwin R. Jadhav , Paul Pu Liang , Louis-Philippe Morency

Precisely predicting the future trajectories of surrounding traffic participants is a crucial but challenging problem in autonomous driving, due to complex interactions between traffic agents, map context and traffic rules. Vector-based…

Structured output representation is a generative task explored in computer vision that often times requires the mapping of low dimensional features to high dimensional structured outputs. Losses in complex spatial information in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Mohamed Debbagh

The integrative analysis of histopathological images and genomic data has received increasing attention for survival prediction of human cancers. However, the existing studies always hold the assumption that full modalities are available.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Junjie Zhou , Jiao Tang , Yingli Zuo , Peng Wan , Daoqiang Zhang , Wei Shao

Predicting the behaviour (i.e., manoeuvre/trajectory) of other road users, including vehicles, is critical for the safe and efficient operation of autonomous vehicles (AVs), a.k.a., automated driving systems (ADSs). Due to the uncertain…

Machine Learning · Computer Science 2023-07-27 Sajjad Mozaffari , Mreza Alipour Sormoli , Konstantinos Koufos , Mehrdad Dianati

In a given scene, humans can often easily predict a set of immediate future events that might happen. However, generalized pixel-level anticipation in computer vision systems is difficult because machine learning struggles with the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-28 Jacob Walker , Carl Doersch , Abhinav Gupta , Martial Hebert

We address the problem of one-to-many mappings in supervised learning, where a single instance has many different solutions of possibly equal cost. The framework of conditional variational autoencoders describes a class of methods to tackle…

Machine Learning · Statistics 2019-09-11 Alexej Klushyn , Nutan Chen , Botond Cseke , Justin Bayer , Patrick van der Smagt

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing