English
Related papers

Related papers: HyperSPNs: Compact and Expressive Probabilistic Ci…

200 papers

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

Community structure is common in many real networks, with nodes clustered in groups sharing the same connections patterns. While many community detection methods have been developed for networks with binary edges, few of them are applicable…

Methodology · Statistics 2023-03-13 Andressa Cerqueira , Elizaveta Levina

Distributionally robust chance-constrained programs (DR-CCP) over Wasserstein ambiguity sets exhibit attractive out-of-sample performance and admit big-$M$-based mixed-integer programming (MIP) reformulations with conic constraints.…

Optimization and Control · Mathematics 2021-01-14 Nam Ho-Nguyen , Fatma Kılınç-Karzan , Simge Küçükyavuz , Dabeen Lee

We show that introducing short-range attractive couplings between the weights of a neural network during training provides a novel avenue for model quantization. These couplings rapidly induce the discretization of a model's weight…

Machine Learning · Computer Science 2026-01-30 Daniel T. Bernstein , Luca Di Carlo , David Schwab

This paper presents a distributed stochastic model predictive control (SMPC) approach for large-scale linear systems with private and common uncertainties in a plug-and-play framework. Using the so-called scenario approach, the centralized…

Optimization and Control · Mathematics 2019-01-09 V. Rostampour , T. Keviczky

Recurrent neural networks (RNNs) have recently achieved remarkable successes in a number of applications. However, the huge sizes and computational burden of these models make it difficult for their deployment on edge devices. A practically…

Machine Learning · Computer Science 2019-12-10 Liangjian Wen , Xuanyang Zhang , Haoli Bai , Zenglin Xu

Mechanistic network models specify the mechanisms by which networks grow and change, allowing researchers to investigate complex systems using both simulation and analytical techniques. Unfortunately, it is difficult to write likelihoods…

Methodology · Statistics 2023-07-19 Jonathan Larson , Jukka-Pekka Onnela

Confidence calibration - the process to calibrate the output probability distribution of neural networks - is essential for safety-critical applications of such networks. Recent works verify the link between mis-calibration and overfitting.…

Machine Learning · Computer Science 2023-05-24 Linwei Tao , Minjing Dong , Daochang Liu , Changming Sun , Chang Xu

The customizable nature of deep learning models have allowed them to be successful predictors in various disciplines. These models are often trained with respect to thousands or millions of instances for complicated problems, but the…

Machine Learning · Computer Science 2019-12-24 Drimik Roy Chowdhury , Muhammad Firmansyah Kasim

Despite the recent successes of probabilistic programming languages (PPLs) in AI applications, PPLs offer only limited support for random variables whose distributions combine discrete and continuous elements. We develop the notion of…

Artificial Intelligence · Computer Science 2018-06-11 Yi Wu , Siddharth Srivastava , Nicholas Hay , Simon Du , Stuart Russell

Many problems plague empirical Phillips curves (PCs). Among them is the hurdle that the two key components, inflation expectations and the output gap, are both unobserved. Traditional remedies include proxying for the absentees or…

Econometrics · Economics 2024-10-25 Philippe Goulet Coulombe

Hyperuniform particle arrangements are characterized by a local number variance that grows more slowly than the volume of the observation window. We generalize this concept to describe particle systems in which particles carry weights:…

Statistical Mechanics · Physics 2026-03-04 Salvatore Torquato , Jaeuk Kim , Michael A. Klatt , Roberto Car , Paul J. Steinhardt

We introduce a novel generative formulation of deep probabilistic models implementing "soft" constraints on their function dynamics. In particular, we develop a flexible methodological framework where the modeled functions and derivatives…

Machine Learning · Statistics 2018-06-19 Marco Lorenzi , Maurizio Filippone

Probability density estimation is a classical and well studied problem, but standard density estimation methods have historically lacked the power to model complex and high-dimensional image distributions. More recent generative models…

Machine Learning · Computer Science 2019-02-27 Ryen Krusinga , Sohil Shah , Matthias Zwicker , Tom Goldstein , David Jacobs

Robust machine learning models with accurately calibrated uncertainties are crucial for safety-critical applications. Probabilistic machine learning and especially the Bayesian formalism provide a systematic framework to incorporate…

Machine Learning · Computer Science 2022-10-11 Sumegha Premchandar , Sandeep Madireddy , Sanket Jantre , Prasanna Balaprakash

Discrete-time modeling of acoustic, mechanical and electrical systems is a prominent topic in the musical signal processing literature. Such models are mostly derived by discretizing a mathematical model, given in terms of ordinary or…

Convolutional neural networks (CNNs) with deep architectures have substantially advanced the state-of-the-art in computer vision tasks. However, deep networks are typically resource-intensive and thus difficult to be deployed on mobile…

Neural and Evolutionary Computing · Computer Science 2017-06-08 Yiwen Guo , Anbang Yao , Hao Zhao , Yurong Chen

Diffusion models have emerged as a powerful framework for generative tasks in deep learning. They decompose generative modeling into two computational primitives: deterministic neural-network evaluation and stochastic sampling. Current…

Machine Learning · Computer Science 2026-03-31 Nihal Sanjay Singh , Mazdak Mohseni-Rajaee , Shaila Niazi , Kerem Y. Camsari

Neural processes are a family of probabilistic models that inherit the flexibility of neural networks to parameterize stochastic processes. Despite providing well-calibrated predictions, especially in regression problems, and quick…

Machine Learning · Computer Science 2023-07-04 Peiman Mohseni , Nick Duffield , Bani Mallick , Arman Hasanzadeh

Probabilistic spin logic (PSL) is a recently proposed computing paradigm based on unstable stochastic units called probabilistic bits (p-bits) that can be correlated to form probabilistic circuits (p-circuits). These p-circuits can be used…

Emerging Technologies · Computer Science 2018-11-05 Ahmed Zeeshan Pervaiz , Brian M. Sutton , Lakshmi Anirudh Ghantasala , Kerem Y. Camsari