English
Related papers

Related papers: Borch: A Deep Universal Probabilistic Programming …

200 papers

Deep learning algorithms have made many breakthroughs and have various applications in real life. Computational resources become a bottleneck as the data and complexity of the deep learning pipeline increases. In this paper, we propose…

Machine Learning · Computer Science 2021-05-05 Salman Ahmed , Hammad Naveed

PyTorch \texttt{2.x} introduces a compiler designed to accelerate deep learning programs. However, for machine learning researchers, adapting to the PyTorch compiler to full potential can be challenging. The compiler operates at the Python…

Machine Learning · Computer Science 2024-03-22 Kaichao You , Runsheng Bai , Meng Cao , Jianmin Wang , Ion Stoica , Mingsheng Long

Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. Despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to…

Machine Learning · Computer Science 2021-12-07 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

Complex nonlinear models such as deep neural network (DNNs) have become an important tool for image classification, speech recognition, natural language processing, and many other fields of application. These models however lack…

Complex cyber-physical systems interact in real-time and must consider both timing and uncertainty. Developing software for such systems is expensive and difficult, especially when modeling, inference, and real-time behavior must be…

Programming Languages · Computer Science 2024-07-09 Lars Hummelgren , Matthias Becker , David Broman

Probabilistic Logic Programming (PLP) under the Distribution Semantics is a leading approach to practical reasoning under uncertainty. An advantage of the Distribution Semantics is its suitability for implementation as a Prolog or Python…

Logic in Computer Science · Computer Science 2026-01-14 Damiano Azzolini , Fabrizio Riguzzi , Theresa Swift

In this paper, we evaluate the capability of transformer-based language models in making inferences over uncertain text that includes uncertain rules of reasoning. We cover both Pre-trained Language Models (PLMs) and generative Large…

Computation and Language · Computer Science 2024-02-12 Aliakbar Nafar , Kristen Brent Venable , Parisa Kordjamshidi

Recursive calls over recursive data are useful for generating probability distributions, and probabilistic programming allows computations over these distributions to be expressed in a modular and intuitive way. Exact inference is also…

Programming Languages · Computer Science 2023-03-28 David Chiang , Colin McDonald , Chung-chieh Shan

Deep neural networks have seen enormous success in various real-world applications. Beyond their predictions as point estimates, increasing attention has been focused on quantifying the uncertainty of their predictions. In this review, we…

Machine Learning · Computer Science 2023-02-06 Chengyu Dong

Modern deep models for summarization attains impressive benchmark performance, but they are prone to generating miscalibrated predictive uncertainty. This means that they assign high confidence to low-quality predictions, leading to…

Computation and Language · Computer Science 2023-04-19 Polina Zablotskaia , Du Phan , Joshua Maynez , Shashi Narayan , Jie Ren , Jeremiah Liu

Probabilistic models are a critical part of the modern deep learning toolbox - ranging from generative models (VAEs, GANs), sequence to sequence models used in machine translation and speech processing to models over functional spaces…

Machine Learning · Computer Science 2018-12-10 Krishnamurthy Dvijotham , Marta Garnelo , Alhussein Fawzi , Pushmeet Kohli

The field of statistical relational learning aims at unifying logic and probability to reason and learn from data. Perhaps the most successful paradigm in the field is probabilistic logic programming: the enabling of stochastic primitives…

Machine Learning · Computer Science 2018-09-20 Stefanie Speichert , Vaishak Belle

The goal of universal machine translation is to learn to translate between any pair of languages, given a corpus of paired translated documents for \emph{a small subset} of all pairs of languages. Despite impressive empirical results and an…

Machine Learning · Computer Science 2020-08-12 Han Zhao , Junjie Hu , Andrej Risteski

Cooper is an open-source package for solving constrained optimization problems involving deep learning models. Cooper implements several Lagrangian-based first-order update schemes, making it easy to combine constrained optimization…

Machine Learning · Computer Science 2025-04-03 Jose Gallego-Posada , Juan Ramirez , Meraj Hashemizadeh , Simon Lacoste-Julien

We enable aProbLog---a probabilistic logical programming approach---to reason in presence of uncertain probabilities represented as Beta-distributed random variables. We achieve the same performance of state-of-the-art algorithms for highly…

Artificial Intelligence · Computer Science 2018-11-16 Federico Cerutti , Lance Kaplan , Angelika Kimmig , Murat Sensoy

DeeProb-kit is a unified library written in Python consisting of a collection of deep probabilistic models (DPMs) that are tractable and exact representations for the modelled probability distributions. The availability of a representative…

Machine Learning · Computer Science 2022-12-09 Lorenzo Loconte , Gennaro Gala

Many machine learning applications require the ability to learn from and reason about noisy multi-relational data. To address this, several effective representations have been developed that provide both a language for expressing the…

Artificial Intelligence · Computer Science 2012-03-19 Matthias Brocheler , Lilyana Mihalkova , Lise Getoor

This paper introduces UncertaintyPlayground, a Python library built on PyTorch and GPyTorch for uncertainty estimation in supervised learning tasks. The library offers fast training for Gaussian and multi-modal outcome distributions through…

Machine Learning · Statistics 2023-10-25 Ilia Azizi

Calibration is a well-studied property of predictors which guarantees meaningful uncertainty estimates. Multicalibration is a related notion -- originating in algorithmic fairness -- which requires predictors to be simultaneously calibrated…

Machine Learning · Computer Science 2024-11-06 Dutch Hansen , Siddartha Devic , Preetum Nakkiran , Vatsal Sharan

We examine popular gradient-based algorithms for nonlinear control in the light of the modern complexity analysis of first-order optimization algorithms. The examination reveals that the complexity bounds can be clearly stated in terms of…

Optimization and Control · Mathematics 2019-08-22 Vincent Roulet , Siddhartha Srinivasa , Dmitriy Drusvyatskiy , Zaid Harchaoui