English
Related papers

Related papers: Dynamic Sum Product Networks for Tractable Inferen…

200 papers

Deep Neural Networks (DNNs) have become very popular for prediction in many areas. Their strength is in representation with a high number of parameters that are commonly learned via gradient descent or similar optimization methods. However,…

Machine Learning · Statistics 2016-10-11 Anthony Caterini , Dong Eui Chang

Spiking Neural Networks (SNN) are models for "realistic" neuronal computation, which makes them somehow different in scope from "ordinary" deep-learning models widely used in AI platforms nowadays. SNNs focus on timed latency (and possibly…

Artificial Intelligence · Computer Science 2025-06-17 Zhen Yao , Elisabetta De Maria , Robert De Simone

Dynamic probabilistic networks are a compact representation of complex stochastic processes. In this paper we examine how to learn the structure of a DPN from data. We extend structure scoring rules for standard probabilistic networks to…

Artificial Intelligence · Computer Science 2013-02-01 Nir Friedman , Kevin Murphy , Stuart Russell

Deep neural networks (DNNs) have demonstrated remarkable empirical performance in large-scale supervised learning problems, particularly in scenarios where both the sample size $n$ and the dimension of covariates $p$ are large. This study…

Machine Learning · Statistics 2024-07-12 Yuqian Zhang , Jelena Bradic

Detection and modeling of change-points in time-series can be considerably challenging. In this paper we approach this problem by incorporating the class of Dynamic Generalized Linear Models (DGLM) into the well know class of Product…

The reverse engineering problem with probabilities and sequential behavior is introducing here, using the expression of an algorithm. The solution is partially founded, because we solve the problem only if we have a Probabilistic Sequential…

Dynamical Systems · Mathematics 2007-08-13 Maria A. Avino-Diaz

Superpixels provide an efficient low/mid-level representation of image data, which greatly reduces the number of image primitives for subsequent vision tasks. Existing superpixel algorithms are not differentiable, making them difficult to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Varun Jampani , Deqing Sun , Ming-Yu Liu , Ming-Hsuan Yang , Jan Kautz

We present a new type of probabilistic model which we call DISsimilarity COefficient Networks (DISCO Nets). DISCO Nets allow us to efficiently sample from a posterior distribution parametrised by a neural network. During training, DISCO…

Computer Vision and Pattern Recognition · Computer Science 2016-10-31 Diane Bouchacourt , M. Pawan Kumar , Sebastian Nowozin

We present simplicial neural networks (SNNs), a generalization of graph neural networks to data that live on a class of topological spaces called simplicial complexes. These are natural multi-dimensional extensions of graphs that encode not…

Machine Learning · Computer Science 2020-12-29 Stefania Ebli , Michaël Defferrard , Gard Spreemann

In modern transportation systems, an enormous amount of traffic data is generated every day. This has led to rapid progress in short-term traffic prediction (STTP), in which deep learning methods have recently been applied. In traffic…

Machine Learning · Computer Science 2020-09-03 Kyungeun Lee , Moonjung Eo , Euna Jung , Yoonjin Yoon , Wonjong Rhee

Inference in discrete graphical models with variational methods is difficult because of the inability to re-parameterize gradients of the Evidence Lower Bound (ELBO). Many sampling-based methods have been proposed for estimating these…

Machine Learning · Computer Science 2020-10-23 Andy Shih , Stefano Ermon

Image-guided depth completion aims to generate dense depth maps with sparse depth measurements and corresponding RGB images. Currently, spatial propagation networks (SPNs) are the most popular affinity-based methods in depth completion, but…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Yuankai Lin , Tao Cheng , Qi Zhong , Wending Zhou , Hua Yang

We study the problem of finite-horizon probabilistic invariance for discrete-time Markov processes over general (uncountable) state spaces. We compute discrete-time, finite-state Markov chains as formal abstractions of general Markov…

Systems and Control · Computer Science 2015-07-03 Sadegh Esmaeil Zadeh Soudjani , Alessandro Abate , Rupak Majumdar

In Deep Neural Networks (DNN) and Spiking Neural Networks (SNN), the information of a neuron is computed based on the sum of the amplitudes (weights) of the electrical potentials received in input from other neurons. We propose here a new…

Neural and Evolutionary Computing · Computer Science 2025-01-22 Alban Gattepaille , Alexandre Muzy

Differential equations are a ubiquitous tool to study dynamics, ranging from physical systems to complex systems, where a large number of agents interact through a graph with non-trivial topological features. Data-driven approximations of…

Statistical Mechanics · Physics 2024-04-26 Vaiva Vasiliauskaite , Nino Antulov-Fantulin

Despite the recent successes of probabilistic programming languages (PPLs) in AI applications, PPLs offer only limited support for random variables whose distributions combine discrete and continuous elements. We develop the notion of…

Artificial Intelligence · Computer Science 2018-06-11 Yi Wu , Siddharth Srivastava , Nicholas Hay , Simon Du , Stuart Russell

Recurrent neural networks (RNNs) have drawn interest from machine learning researchers because of their effectiveness at preserving past inputs for time-varying data processing tasks. To understand the success and limitations of RNNs, it is…

Information Theory · Computer Science 2017-01-30 Adam Charles , Dong Yin , Christopher Rozell

Predicting user responses, such as clicks and conversions, is of great importance and has found its usage in many Web applications including recommender systems, web search and online advertising. The data in those applications is mostly…

Machine Learning · Computer Science 2016-11-02 Yanru Qu , Han Cai , Kan Ren , Weinan Zhang , Yong Yu , Ying Wen , Jun Wang

Spatio-temporal data are ubiquitous in the agricultural, ecological, and environmental sciences, and their study is important for understanding and predicting a wide variety of processes. One of the difficulties with modeling spatial…

Machine Learning · Statistics 2019-02-25 Christopher K. Wikle

Sum-Product Networks with complex probability distribution at the leaves have been shown to be powerful tractable-inference probabilistic models. However, while learning the internal parameters has been amply studied, learning complex leaf…

Machine Learning · Computer Science 2017-06-15 Mattia Desana , Christoph Schnörr