English
Related papers

Related papers: Deep Generative Networks For Sequence Prediction

200 papers

In this paper, we propose a deep generative time series approach using latent temporal processes for modeling and holistically analyzing complex disease trajectories. We aim to find meaningful temporal latent representations of an…

This work addresses the scarcity of annotated hyperspectral data required to train deep neural networks. Especially, we investigate generative adversarial networks and their application to the synthesis of consistent labeled spectra. By…

Neural and Evolutionary Computing · Computer Science 2018-06-08 Nicolas Audebert , Bertrand Le Saux , Sébastien Lefèvre

We introduce a self-consistent deep-learning framework which, for a noisy deterministic time series, provides unsupervised filtering, state-space reconstruction, identification of the underlying differential equations and forecasting.…

Machine Learning · Computer Science 2021-08-05 Zhe Wang , Claude Guet

Multivariate time series anomaly detection has become an active area of research in recent years, with Deep Learning models outperforming previous approaches on benchmark datasets. Among reconstruction-based models, most previous work has…

Machine Learning · Computer Science 2022-02-28 Cristian Challu , Peihong Jiang , Ying Nian Wu , Laurent Callot

Semi-supervised learning (SSL) over graph-structured data emerges in many network science applications. To efficiently manage learning over graphs, variants of graph neural networks (GNNs) have been developed recently. By succinctly…

Machine Learning · Computer Science 2021-10-22 Alireza Sadeghi , Meng Ma , Bingcong Li , Georgios B. Giannakis

Disentangled representation learning offers useful properties such as dimension reduction and interpretability, which are essential to modern deep learning approaches. Although deep learning techniques have been widely applied to…

Machine Learning · Computer Science 2022-04-11 Sichen Zhao , Wei Shao , Jeffrey Chan , Flora D. Salim

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Most current computer vision datasets are composed of disconnected sets, such as images from different classes. We prove that distributions of this type of data cannot be represented with a continuous generative network without error. They…

Machine Learning · Computer Science 2020-06-26 Lorenzo Luzi , Randall Balestriero , Richard G. Baraniuk

An approach to utilize recent advances in deep generative models for anomaly detection in a granular (continuous) sense on a real-world image dataset with quality issues is detailed using recent normalizing flow models, with implications in…

Machine Learning · Computer Science 2020-01-14 John Just

Due to a huge volume of information in many domains, the need for classification methods is imperious. In spite of many advances, most of the approaches require a large amount of labeled data, which is often not available, due to costs and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Lucas Pascotti Valem , Daniel Carlos Guimarães Pedronette , Longin Jan Latecki

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

Disordered Systems and Neural Networks · Physics 2026-02-23 O. Duranthon , L. Zdeborová

Many real-world problems require reasoning across multiple scales, demanding models which operate not on single data points, but on entire distributions. We introduce generative distribution embeddings (GDE), a framework that lifts…

Machine Learning · Computer Science 2026-02-23 Nic Fishman , Gokul Gowri , Peng Yin , Jonathan Gootenberg , Omar Abudayyeh

Sequential modelling of high-dimensional data is an important problem that appears in many domains including model-based reinforcement learning and dynamics identification for control. Latent variable models applied to sequential data…

Machine Learning · Computer Science 2023-01-23 Oliver Limoyo , Trevor Ablett , Jonathan Kelly

Devising and analyzing learning models for spatiotemporal network data is of importance for tasks including forecasting, anomaly detection, and multi-agent coordination, among others. Graph Convolutional Neural Networks (GCNNs) are an…

Machine Learning · Computer Science 2022-07-01 Mohammad Sabbaqi , Elvin Isufi

Generative Adversarial Networks (GANs) have proven to be a powerful framework for learning to draw samples from complex distributions. However, GANs are also notoriously difficult to train, with mode collapse and oscillations a common…

Machine Learning · Statistics 2018-11-28 Kevin J Liang , Chunyuan Li , Guoyin Wang , Lawrence Carin

Tensor networks are efficient representations of high-dimensional tensors which have been very successful for physics and mathematics applications. We demonstrate how algorithms for optimizing such networks can be adapted to supervised…

Machine Learning · Statistics 2017-05-22 E. Miles Stoudenmire , David J. Schwab

We present a general numerical approach for learning unknown dynamical systems using deep neural networks (DNNs). Our method is built upon recent studies that identified the residue network (ResNet) as an effective neural network structure.…

Machine Learning · Computer Science 2021-06-02 Zhen Chen , Dongbin Xiu

Learning probabilistic models that can estimate the density of a given set of samples, and generate samples from that density, is one of the fundamental challenges in unsupervised machine learning. We introduce a new generative model based…

Machine Learning · Computer Science 2020-06-11 Siavash A. Bigdeli , Geng Lin , Tiziano Portenier , L. Andrea Dunbar , Matthias Zwicker

Deep learning is a hot research topic in the field of machine learning methods and applications. Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) provide impressive image generations from Gaussian white noise, but…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Jiasong Wu , Jing Zhang , Fuzhi Wu , Youyong Kong , Guanyu Yang , Lotfi Senhadji , Huazhong Shu