English
Related papers

Related papers: Analysis of Random Sequential Message Passing Algo…

200 papers

High dimensional piecewise stationary graphical models represent a versatile class for modelling time varying networks arising in diverse application areas, including biology, economics, and social sciences. There has been recent work in…

Machine Learning · Statistics 2018-06-21 Hossein Keshavarz , George Michailidis , Yves Atchade

A class of random non-stationary signals termed timbre x dynamics is introduced and studied. These signals are obtained by non-linear transformations of sta-tionary random gaussian signals, in such a way that the transformation can be…

Information Theory · Computer Science 2015-10-29 H Omer , B Torrésani

State space models (SSMs) have shown remarkable empirical performance on many long sequence modeling tasks, but a theoretical understanding of these models is still lacking. In this work, we study the learning dynamics of linear SSMs to…

Machine Learning · Computer Science 2024-07-11 Jakub Smékal , Jimmy T. H. Smith , Michael Kleinman , Dan Biderman , Scott W. Linderman

In stochastic variational inference, the variational Bayes objective function is optimized using stochastic gradient approximation, where gradients computed on small random subsets of data are used to approximate the true gradient over the…

Methodology · Statistics 2015-10-19 Linda S. L. Tan , David J. Nott

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

We address the tracking problem for a class of uncertain non-affine nonlinear systems with high relative degrees, performing non-repetitive tasks. We propose a rigorously proven, robust adaptive learning control scheme that relies on a…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Shuai Gao , Dong Shen , Abdelhamid Tayebi

A general information transmission model, under independent and identically distributed Gaussian codebook and nearest neighbor decoding rule with processed channel output, is investigated using the performance metric of generalized mutual…

Information Theory · Computer Science 2019-08-23 Wenyi Zhang , Yizhu Wang , Cong Shen , Ning Liang

When intelligent spacecraft or space robots perform tasks in a complex environment, the controllable variables are usually not directly available and have to be inferred from high-dimensional observable variables, such as outputs of neural…

Systems and Control · Electrical Eng. & Systems 2024-12-10 Congxi Zhang , Yongchun Xie

This statistical physics thesis focuses on the study of three kinds of systems which display repulsive interactions: eigenvalues of random matrices, non-crossing random walks and trapped fermions. These systems share many links, which can…

Mathematical Physics · Physics 2021-11-11 Tristan Gautié

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

In this paper, we explore the inclusion of latent random variables into the dynamic hidden state of a recurrent neural network (RNN) by combining elements of the variational autoencoder. We argue that through the use of high-level latent…

Machine Learning · Computer Science 2016-04-08 Junyoung Chung , Kyle Kastner , Laurent Dinh , Kratarth Goel , Aaron Courville , Yoshua Bengio

We study connectivity properties in a probabilistic model for a large mobile ad-hoc network. We consider a large number of participants of the system moving randomly, independently and identically distributed in a large domain, with a…

Probability · Mathematics 2016-06-07 Hanna Döring , Gabriel Faraud , Wolfgang König

Approximate message passing algorithm enjoyed considerable attention in the last decade. In this paper we introduce a variant of the AMP algorithm that takes into account glassy nature of the system under consideration. We coin this…

Disordered Systems and Neural Networks · Physics 2019-02-07 Fabrizio Antenucci , Florent Krzakala , Pierfrancesco Urbani , Lenka Zdeborová

Diffusion models are a class of probabilistic generative models that have been widely used as a prior for image processing tasks like text conditional generation and inpainting. We demonstrate that these models can be adapted to make…

Machine Learning · Computer Science 2023-06-14 Marc Finzi , Anudhyan Boral , Andrew Gordon Wilson , Fei Sha , Leonardo Zepeda-Núñez

In this contribution we deal with the problem of learning an undirected graph which encodes the conditional dependence relationship between variables of a complex system, given a set of observations of this system. This is a very central…

Methodology · Statistics 2019-07-26 Daniela De Canditiis , Armando Guardasole

We consider the general class of time-homogeneous stochastic dynamical systems, both discrete and continuous, and study the problem of learning a representation of the state that faithfully captures its dynamics. This is instrumental to…

Machine Learning · Computer Science 2024-03-15 Vladimir R. Kostic , Pietro Novelli , Riccardo Grazzi , Karim Lounici , Massimiliano Pontil

In this paper, we focus on the matching recovery problem between a pair of correlated Gaussian Wigner matrices with a latent vertex correspondence. We are particularly interested in a robust version of this problem such that our observation…

Machine Learning · Statistics 2025-06-02 Zhangsong Li

Stochastic processes have found numerous applications in science, as they are broadly used to model a variety of natural phenomena. Due to their intrinsic randomness and uncertainty, they are, however, difficult to characterize. Here, we…

We analyze the dynamics of the Learning-Without-Recall model with Gaussian priors in a dynamic social network. Agents seeking to learn the state of the world, the "truth", exchange signals about their current beliefs across a changing…

Optimization and Control · Mathematics 2016-09-21 Chu Wang , Bernard Chazelle

Stability is a fundamental property of dynamical systems, yet to this date it has had little bearing on the practice of recurrent neural networks. In this work, we conduct a thorough investigation of stable recurrent models. Theoretically,…

Machine Learning · Computer Science 2019-03-05 John Miller , Moritz Hardt
‹ Prev 1 8 9 10 Next ›