English
Related papers

Related papers: HGAN-SDEs: Learning Neural Stochastic Differential…

200 papers

Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have…

Machine Learning · Computer Science 2022-10-17 Kazuki Irie , Francesco Faccio , Jürgen Schmidhuber

Developing efficient time series anomaly detection techniques is important to maintain service quality and provide early alarms. Generative neural network methods are one class of the unsupervised approaches that are achieving increasing…

Machine Learning · Computer Science 2022-10-07 Yueyan Gu , Farrokh Jazizadeh

The conjoining of dynamical systems and deep learning has become a topic of great interest. In particular, neural differential equations (NDEs) demonstrate that neural networks and differential equation are two sides of the same coin.…

Machine Learning · Computer Science 2022-02-08 Patrick Kidger

Generative Adversarial Networks (GANs) are an unsupervised generative model that learns data distribution through adversarial training. However, recent experiments indicated that GANs are difficult to train due to the requirement of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wenliang Qian , Yang Xu , Wangmeng Zuo , Hui Li

Training generative adversarial networks (GAN) in a distributed fashion is a promising technology since it is contributed to training GAN on a massive of data efficiently in real-world applications. However, GAN is known to be difficult to…

Machine Learning · Computer Science 2020-10-27 Xiaojun Chen , Shu Yang , Li Shen , Xuanrong Pang

In recent years, Generative Adversarial Networks (GAN) have emerged as a powerful method for learning the mapping from noisy latent spaces to realistic data samples in high-dimensional space. So far, the development and application of GANs…

Machine Learning · Statistics 2018-01-30 Atanas Mirchev , Seyed-Ahmad Ahmadi

Generative adversarial networks (GANs) form a generative modeling approach known for producing appealing samples, but they are notably difficult to train. One common way to tackle this issue has been to propose new formulations of the GAN…

Machine Learning · Computer Science 2020-09-01 Gauthier Gidel , Hugo Berard , Gaëtan Vignoud , Pascal Vincent , Simon Lacoste-Julien

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

Recent work has shown significant progress in the direction of synthetic data generation using Generative Adversarial Networks (GANs). GANs have been applied in many fields of computer vision including text-to-image conversion, domain…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Mkhuseli Ngxande , Jules-Raymond Tapamo , Michael Burke

Deep neural networks are susceptible to human imperceptible adversarial perturbations. One of the strongest defense mechanisms is \emph{Adversarial Training} (AT). In this paper, we aim to address two predominant problems in AT. First,…

Machine Learning · Computer Science 2023-08-21 Jianhui Sun , Sanchit Sinha , Aidong Zhang

Generating graph-structured data requires learning the underlying distribution of graphs. Yet, this is a challenging problem, and the previous graph generative methods either fail to capture the permutation-invariance property of graphs or…

Machine Learning · Computer Science 2022-06-16 Jaehyeong Jo , Seul Lee , Sung Ju Hwang

We present a method for learning latent stochastic differential equations (SDEs) from high-dimensional time series data. Given a high-dimensional time series generated from a lower dimensional latent unknown It\^o process, the proposed…

Machine Learning · Statistics 2021-11-30 Ali Hasan , João M. Pereira , Sina Farsiu , Vahid Tarokh

Generative adversarial networks (GAN) became a hot topic, presenting impressive results in the field of computer vision. However, there are still open problems with the GAN model, such as the training stability and the hand-design of…

Neural and Evolutionary Computing · Computer Science 2019-12-16 Victor Costa , Nuno Lourenço , Penousal Machado

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

Dynamical systems that are subject to continuous uncertain fluctuations can be modelled using Stochastic Differential Equations (SDEs). Controlling such system results in solving path constrained SDEs. Broadly, these problems fall under the…

Optimization and Control · Mathematics 2023-06-16 Sumit Suthar , Soumyendu Raha

Generative models can be categorized into two types: explicit generative models that define explicit density forms and allow exact likelihood inference, such as score-based diffusion models (SDMs) and normalizing flows; implicit generative…

Machine Learning · Statistics 2023-07-06 Jingwei Zhang , Han Shi , Jincheng Yu , Enze Xie , Zhenguo Li

This study introduces a training-free conditional diffusion model for learning unknown stochastic differential equations (SDEs) using data. The proposed approach addresses key challenges in computational efficiency and accuracy for modeling…

Machine Learning · Computer Science 2024-10-07 Yanfang Liu , Yuan Chen , Dongbin Xiu , Guannan Zhang

Heterogeneous temporal graphs (HTGs) are ubiquitous data structures in the real world. Recently, to enhance representation learning on HTGs, numerous attention-based neural networks have been proposed. Despite these successes, existing…

Machine Learning · Computer Science 2025-10-22 Yili Wang , Tairan Huang , Changlong He , Qiutong Li , Jianliang Gao

How to improve generative modeling by better exploiting spatial regularities and coherence in images? We introduce a novel neural network for building image generators (decoders) and apply it to variational autoencoders (VAEs). In our…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Đorđe Miladinović , Aleksandar Stanić , Stefan Bauer , Jürgen Schmidhuber , Joachim M. Buhmann

Neural network-based approaches have recently shown significant promise in solving partial differential equations (PDEs) in science and engineering, especially in scenarios featuring complex domains or incorporation of empirical data. One…

Machine Learning · Computer Science 2025-03-19 Chuqi Chen , Yahong Yang , Yang Xiang , Wenrui Hao