English
Related papers

Related papers: Stochastic Chaining and Strengthened Information-T…

200 papers

Diffusions are a successful technique to sample from high-dimensional distributions. The target distribution can be either explicitly given or learnt from a collection of samples. They implement a diffusion process whose endpoint is a…

Machine Learning · Computer Science 2025-09-03 Andrea Montanari

We consider the problem of online linear regression in the stochastic setting. We derive high probability regret bounds for online ridge regression and the forward algorithm. This enables us to compare online regression algorithms more…

Machine Learning · Computer Science 2021-11-03 Reda Ouhamma , Odalric Maillard , Vianney Perchet

Stochastic restoration algorithms allow to explore the space of solutions that correspond to the degraded input. In this paper we reveal additional fundamental advantages of stochastic methods over deterministic ones, which further motivate…

Image and Video Processing · Electrical Eng. & Systems 2024-05-21 Guy Ohayon , Theo Adrai , Michael Elad , Tomer Michaeli

In this paper, we present Partially Stochastic Infinitely Deep Bayesian Neural Networks, a novel family of architectures that integrates partial stochasticity into the framework of infinitely deep neural networks. Our new class of…

Machine Learning · Computer Science 2024-07-16 Sergio Calvo-Ordonez , Matthieu Meunier , Francesco Piatti , Yuantao Shi

In this paper we present a novel quasi-Newton algorithm for use in stochastic optimisation. Quasi-Newton methods have had an enormous impact on deterministic optimisation problems because they afford rapid convergence and computationally…

Systems and Control · Electrical Eng. & Systems 2019-09-04 Adrian Wills , Thomas Schön

In this work, we introduce a learning model designed to meet the needs of applications in which computational resources are limited, and robustness and interpretability are prioritized. Learning problems can be formulated as constrained…

Systems and Control · Electrical Eng. & Systems 2025-09-26 Christos Mavridis , John Baras

Imprecise continuous-time Markov chains are a robust type of continuous-time Markov chains that allow for partially specified time-dependent parameters. Computing inferences for them requires the solution of a non-linear differential…

Probability · Mathematics 2018-10-11 Alexander Erreygers , Jasper De Bock

We propose a deterministic denoising algorithm for discrete-state diffusion models. The key idea is to derandomize the generative reverse Markov chain by introducing a variant of the herding algorithm, which induces deterministic state…

Machine Learning · Computer Science 2026-01-30 Hideyuki Suzuki , Wataru Kurebayashi , Hiroshi Yamashita

Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…

Probability · Mathematics 2014-03-10 Christophe Andrieu , Matti Vihola

We derive information-theoretic generalization bounds for supervised learning algorithms based on the information contained in predictions rather than in the output of the training algorithm. These bounds improve over the existing…

Machine Learning · Computer Science 2021-10-06 Hrayr Harutyunyan , Maxim Raginsky , Greg Ver Steeg , Aram Galstyan

Multilayer networks generalize single-layered connectivity data in several directions. These generalizations include, among others, settings where multiple types of edges are observed among the same set of nodes (edge-colored networks) or…

Methodology · Statistics 2025-05-16 Daniele Durante , Francesco Gaffi , Antonio Lijoi , Igor Prünster

Markov chains are fundamental models for stochastic dynamics, with applications in a wide range of areas such as population dynamics, queueing systems, reinforcement learning, and Monte Carlo methods. Estimating the transition matrix and…

Statistics Theory · Mathematics 2026-01-26 Lasse Leskelä , Maximilien Dreveton

We propose a method to sample stationary properties of solutions of stochastic differential equations, which is accurate and efficient if there are rarely visited regions or rare transitions between distinct regions of the state space. The…

Statistical Mechanics · Physics 2016-03-23 Rüdiger Kürsten , Ulrich Behn

With the increasing popularity of machine learning techniques, it has become common to see prediction algorithms operating within some larger process. However, the criteria by which we train these algorithms often differ from the ultimate…

Machine Learning · Computer Science 2019-04-26 Priya L. Donti , Brandon Amos , J. Zico Kolter

Constraint-based methods are one of the main approaches for causal structure learning that are particularly valued as they are asymptotically guaranteed to find a structure that is Markov equivalent to the causal graph of the system. On the…

Machine Learning · Computer Science 2021-05-24 Ehsan Mokhtarian , Sina Akbari , AmirEmad Ghassami , Negar Kiyavash

We address the reachability problem for continuous-time stochastic dynamic systems. Our objective is to present a unified framework that characterizes the reachable set of a dynamic system in the presence of both stochastic disturbances and…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Saber Jafarpour , Zishun Liu , Yongxin Chen

This paper addresses the problem of optimizing partition functions in a stochastic learning setting. We propose a stochastic variant of the bound majorization algorithm that relies on upper-bounding the partition function with a quadratic…

Machine Learning · Computer Science 2020-11-04 Jing Wang , Anna Choromanska

There has been a growing interest in studying online stochastic packing under more general correlation structures, motivated by the complex data sets and models driving modern applications. Several past works either assume correlations are…

Optimization and Control · Mathematics 2025-09-03 Sabri Cetin , Yilun Chen , David A. Goldberg

Edge intelligence enables AI inference at the network edge, co-located with or near the radio access network, rather than in centralized clouds or on mobile devices. It targets low-latency, resource-constrained applications with large data…

Networking and Internet Architecture · Computer Science 2026-01-26 Jaume Anguera Peris , Joakim Jaldén

In this paper, we propose a stochastic search algorithm for solving general optimization problems with little structure. The algorithm iteratively finds high quality solutions by randomly sampling candidate solutions from a parameterized…

Optimization and Control · Mathematics 2013-01-08 Enlu Zhou , Jiaqiao Hu
‹ Prev 1 3 4 5 6 7 10 Next ›