English
Related papers

Related papers: Statically Bounded-Memory Delayed Sampling for Pro…

200 papers

Stochastic neural networks are a prototypical computational device able to build a probabilistic representation of an ensemble of external stimuli. Building on the relationship between inference and learning, we derive a synaptic plasticity…

Disordered Systems and Neural Networks · Physics 2018-10-23 Luca Saglietti , Federica Gerace , Alessandro Ingrosso , Carlo Baldassi , Riccardo Zecchina

Prompting has become a practical method for utilizing pre-trained language models (LMs). This approach offers several advantages. It allows an LM to adapt to new tasks with minimal training and parameter updates, thus achieving efficiency…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-26 Kai-Wei Chang , Haibin Wu , Yu-Kai Wang , Yuan-Kuei Wu , Hua Shen , Wei-Cheng Tseng , Iu-thing Kang , Shang-Wen Li , Hung-yi Lee

Event-based sampling has been proposed as a general technique for lowering the average communication rate in remote state estimation, which can be important in scenarios with constraints on resources such as network bandwidth or sensor…

Systems and Control · Electrical Eng. & Systems 2022-09-29 Johan Ruuskanen , Anton Cervin

Probabilistic programming (PP) is a programming paradigm that allows for writing statistical models like ordinary programs, performing simulations by running those programs, and analyzing and refining their statistical behavior using…

Programming Languages · Computer Science 2024-06-19 Martin Kuhn , Joscha Grüger , Christoph Matheja , Andrey Rivkin

From a continuous-time long memory stochastic process, a discrete-time randomly sampled one is drawn. We investigate the second-order properties of this process and establish some time-and frequency-domain asymptotic results. We mainly…

Statistics Theory · Mathematics 2021-10-12 Mohamedou Ould Haye , Anne Philippe , Caroline Robet

Pretrained language models have achieved state-of-the-art performance when adapted to a downstream NLP task. However, theoretical analysis of these models is scarce and challenging since the pretraining and downstream tasks can be very…

Machine Learning · Computer Science 2022-04-22 Colin Wei , Sang Michael Xie , Tengyu Ma

Gaussian Processes (GPs) are widely used tools in statistics, machine learning, robotics, computer vision, and scientific computation. However, despite their popularity, they can be difficult to apply; all but the simplest classification or…

Machine Learning · Computer Science 2016-01-06 Ulrich Schaechtle , Ben Zinberg , Alexey Radul , Kostas Stathis , Vikash K. Mansinghka

Sampling-based planning is the predominant paradigm for motion planning in robotics. Most sampling-based planners use a global random sampling scheme to guarantee probabilistic completeness. However, most schemes are often inefficient as…

Robotics · Computer Science 2020-01-22 Tin Lai , Philippe Morere , Fabio Ramos , Gilad Francis

Probabilistic programming makes it easy to represent a probabilistic model as a program. Building an individual model, however, is only one step of probabilistic modeling. The broader challenge of probabilistic modeling is in understanding…

Programming Languages · Computer Science 2022-08-15 Ryan Bernstein

Among the biggest challenges in property-based testing (PBT) is the constrained random generation problem: given a predicate on program values, randomly sample from the set of all values satisfying that predicate, and only those values.…

Programming Languages · Computer Science 2026-04-15 Harrison Goldstein , Hila Peleg , Cassia Torczon , Daniel Sainati , Leonidas Lampropoulos , Benjamin C. Pierce

Approximate inference in dynamic systems is the problem of estimating the state of the system given a sequence of actions and partial observations. High precision estimation is fundamental in many applications like diagnosis, natural…

Artificial Intelligence · Computer Science 2012-06-18 Hannaneh Hajishirzi , Eyal Amir

The recent advent of programmable switches makes distributed algorithms readily deployable in real-world datacenter networks. However, there are still gaps between theory and practice that prevent the smooth adaptation of CONGEST algorithms…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-16 Ran Ben Basat , Keren Censor-Hillel , Yi-Jun Chang , Wenchen Han , Dean Leitersdorf , Gregory Schwartzman

Predictive process monitoring is a subfield of process mining that aims to estimate case or event features for running process instances. Such predictions are of significant interest to the process stakeholders. However, most of the…

Previous work has suggested that the structural restrictions of graphs from classes of bounded expansion--locally dense pockets in a globally sparse graph--naturally coincide with common properties of real-world networks such as clustering…

Data Structures and Algorithms · Computer Science 2018-04-24 Michael P. O'Brien , Blair D. Sullivan

Flow matching has recently emerged as a powerful paradigm for generative modeling and has been extended to probabilistic time series forecasting in latent spaces. However, the impact of the specific choice of probability path model on…

Machine Learning · Statistics 2025-08-19 Soon Hoe Lim , Yijin Wang , Annan Yu , Emma Hart , Michael W. Mahoney , Xiaoye S. Li , N. Benjamin Erichson

Parameter identification problems are formulated in a probabilistic language, where the randomness reflects the uncertainty about the knowledge of the true values. This setting allows conceptually easily to incorporate new information, e.g.…

Numerical Analysis · Computer Science 2013-03-19 Bojana V. Rosić , Anna Kučerová , Jan Sýkora , Oliver Pajonk , Alexander Litvinenko , Hermann G. Matthies

Despite some empirical success at correcting exposure bias in machine translation, scheduled sampling algorithms suffer from a major drawback: they incorrectly assume that words in the reference translations and in sampled sequences are…

Computation and Language · Computer Science 2019-05-07 Weijia Xu , Xing Niu , Marine Carpuat

We address the problem of delay in an arithmetic coding system. Due to the nature of the arithmetic coding process, source sequences causing arbitrarily large encoding or decoding delays exist. This phenomena raises the question of just how…

Information Theory · Computer Science 2007-07-13 Ofer Shayevitz , Ram Zamir , Meir Feder

The problem of sequentially maximizing the expectation of a function seeks to maximize the expected value of a function of interest without having direct control on its features. Instead, the distribution of such features depends on a given…

Machine Learning · Statistics 2022-10-26 Diego Martinez-Taboada , Dino Sejdinovic

Causal inference can be formalized as Bayesian inference that combines a prior distribution over causal models and likelihoods that account for both observations and interventions. We show that it is possible to implement this approach…

Artificial Intelligence · Computer Science 2019-11-01 Sam Witty , Alexander Lew , David Jensen , Vikash Mansinghka