English
Related papers

Related papers: Train Stochastic Non Linear Coupled ODEs to Classi…

200 papers

Leveraging advances in variational inference, we propose to enhance recurrent neural networks with latent variables, resulting in Stochastic Recurrent Networks (STORNs). The model i) can be trained with stochastic gradient methods, ii)…

Machine Learning · Statistics 2015-03-09 Justin Bayer , Christian Osendorfer

Set prediction is about learning to predict a collection of unordered variables with unknown interrelations. Training such models with set losses imposes the structure of a metric space over sets. We focus on stochastic and underdefined…

Machine Learning · Computer Science 2021-02-23 David W. Zhang , Gertjan J. Burghouts , Cees G. M. Snoek

This paper investigates the theoretical behavior of generative models under finite training populations. Within the stochastic interpolation generative framework, we derive closed-form expressions for the optimal velocity field and score…

Machine Learning · Computer Science 2025-09-29 Yunchen Li , Shaohui Lin , Zhou Yu

A stochastic model of excitatory and inhibitory interactions which bears universality traits is introduced and studied. The endogenous component of noise, stemming from finite size corrections, drives robust inter-nodes correlations, that…

Disordered Systems and Neural Networks · Physics 2017-08-16 Clement Zankoc , Duccio Fanelli , Francesco Ginelli , Roberto Livi

Deep generative neural networks have proven effective at both conditional and unconditional modeling of complex data distributions. Conditional generation enables interactive control, but creating new controls often requires expensive…

Machine Learning · Computer Science 2017-12-25 Jesse Engel , Matthew Hoffman , Adam Roberts

We develop a novel probabilistic generative model based on the variational autoencoder approach. Notable aspects of our architecture are: a novel way of specifying the latent variables prior, and the introduction of an ordinality enforcing…

Machine Learning · Statistics 2018-12-20 Joel Jaskari , Jyri J. Kivinen

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

We consider a neural network with adapting synapses whose dynamics can be analitically computed. The model is made of $N$ neurons and each of them is connected to $K$ input neurons chosen at random in the network. The synapses are…

Disordered Systems and Neural Networks · Physics 2009-10-30 G. Lattanzi , G. Nardulli , G. Pasquariello , S. Stramaglia

Stochastic neural networks are a prototypical computational device able to build a probabilistic representation of an ensemble of external stimuli. Building on the relationship between inference and learning, we derive a synaptic plasticity…

Disordered Systems and Neural Networks · Physics 2018-10-23 Luca Saglietti , Federica Gerace , Alessandro Ingrosso , Carlo Baldassi , Riccardo Zecchina

Modern generative machine learning models demonstrate surprising ability to create realistic outputs far beyond their training data, such as photorealistic artwork, accurate protein structures, or conversational text. These successes…

Machine Learning · Computer Science 2024-01-17 William Gilpin

Stochastic processes offer a flexible mathematical formalism to model and reason about systems. Most analysis tools, however, start from the premises that models are fully specified, so that any parameters controlling the system's dynamics…

Systems and Control · Computer Science 2017-01-11 Luca Bortolussi , Guido Sanguinetti

Stochastic differential equations (SDEs) are a ubiquitous modeling framework that finds applications in physics, biology, engineering, social science, and finance. Due to the availability of large-scale data sets, there is growing interest…

Machine Learning · Statistics 2025-03-04 Ziheng Guo , James Greene , Ming Zhong

In this paper, a non-autonomous stochastic logistic system is considered. An interesting result on the effect of stochastically perturbation for the dynamic behavior are obtained. That is, under certain conditions the stochastic system have…

Dynamical Systems · Mathematics 2012-08-08 Hu Hongxiao

Many recent generative models make use of neural networks to transform the probability distribution of a simple low-dimensional noise process into the complex distribution of the data. This raises the question of whether biological networks…

Neural and Evolutionary Computing · Computer Science 2018-02-07 Hesham Mostafa , Gert Cauwenberghs

This paper contributes to a development of randomized methods for neural networks. The proposed learner model is generated incrementally by stochastic configuration (SC) algorithms, termed as Stochastic Configuration Networks (SCNs). In…

Neural and Evolutionary Computing · Computer Science 2018-02-14 Dianhui Wang , Ming Li

Macroscopic traffic flow is stochastic, but the physics-informed deep learning methods currently used in transportation literature embed deterministic PDEs and produce point-valued outputs; the stochasticity of the governing dynamics plays…

Systems and Control · Electrical Eng. & Systems 2026-03-11 Wuping Xin

Linear thresholding systems have been used as a model of neural activation and have more recently been proposed as a model of gene activation. Deterministic linear thresholding systems can be turned into non-deterministic systems by the…

Neurons and Cognition · Quantitative Biology 2023-11-23 Anna Laddach , Michael Shapiro

The identification of nonlinear dynamics from observations is essential for the alignment of the theoretical ideas and experimental data. The last, in turn, is often corrupted by the side effects and noise of different natures, so…

Machine Learning · Computer Science 2020-06-08 Anna Shalova , Ivan Oseledets

We prove that stochastic gradient descent efficiently converges to the global optimizer of the maximum likelihood objective of an unknown linear time-invariant dynamical system from a sequence of noisy observations generated by the system.…

Machine Learning · Computer Science 2019-02-12 Moritz Hardt , Tengyu Ma , Benjamin Recht

We present a general framework for classifying partially observed dynamical systems based on the idea of learning in the model space. In contrast to the existing approaches using model point estimates to represent individual data items, we…

Machine Learning · Statistics 2017-04-19 Yuan Shen , Peter Tino , Krasimira Tsaneva-Atanasova