English
Related papers

Related papers: Almost Uniform Sampling From Neural Networks

200 papers

Time is at a premium for recurrent network dynamics, and particularly so when they are stochastic and correlated: the quality of inference from such dynamics fundamentally depends on how fast the neural circuit generates new samples from…

Neurons and Cognition · Quantitative Biology 2014-04-24 Guillaume Hennequin , Laurence Aitchison , Máté Lengyel

We propose a learning algorithm for local routing policies that needs only a few data samples obtained from a single graph while generalizing to all random graphs in a standard model of wireless networks. We thus solve the all-pairs…

Machine Learning · Computer Science 2023-08-22 Yung-Fu Chen , Sen Lin , Anish Arora

In this paper, we study approximation properties of single hidden layer neural networks with weights varying on finitely many directions and thresholds from an open interval. We obtain a necessary and at the same time sufficient measure…

Machine Learning · Computer Science 2023-04-05 Vugar Ismailov , Ekrem Savas

Performing random walks in networks is a fundamental primitive that has found numerous applications in communication networks such as token management, load balancing, network topology discovery and construction, search, and peer-to-peer…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-01-12 Atish Das Sarma , Anisur Rahaman Molla , Gopal Pandurangan

Random walk-based sampling methods are gaining popularity and importance in characterizing large networks. While powerful, they suffer from the slow mixing problem when the graph is loosely connected, which results in poor estimation…

Social and Information Networks · Computer Science 2017-08-31 Junzhou Zhao , Pinghui Wang , John C. S. Lui , Don Towsley , Xiaohong Guan

We consider the problem of sampling from data defined on the nodes of a weighted graph, where the edge weights capture the data correlation structure. As shown recently, using spectral graph theory one can define a cut-off frequency for the…

Information Theory · Computer Science 2014-11-13 Ilan Shomorony , A. Salman Avestimehr

Boolean formulae compactly encode huge, constrained search spaces. Thus, variability-intensive systems are often encoded with Boolean formulae. The search space of a variability-intensive system is usually too large to explore without…

Logic in Computer Science · Computer Science 2025-03-19 Olivier Zeyen , Maxime Cordy , Martin Gubri , Gilles Perrouin , Mathieu Acher

We suggest a universal map capable to recover a behavior of a wide range of dynamical systems given by ODEs. The map is built as an artificial neural network whose weights encode a modeled system. We assume that ODEs are known and prepare…

Disordered Systems and Neural Networks · Physics 2023-05-02 Pavel V. Kuptsov , Anna V. Kuptsova , Nataliya V. Stankevich

We study the problem of learning a single neuron under standard squared loss in the presence of arbitrary label noise and group-level distributional shifts, for a broad family of covariate distributions. Our goal is to identify a…

Machine Learning · Computer Science 2026-01-27 Guyang Cao , Shuyao Li , Sushrut Karmalkar , Jelena Diakonikolas

We propose efficient algorithms for two key tasks in the analysis of large nonuniform networks: uniform node sampling and cluster detection. Our sampling technique is based on augmenting a simple, but slowly mixing uniform MCMC sampler with…

Disordered Systems and Neural Networks · Physics 2007-05-23 Pekka Orponen , Satu Elisa Schaeffer

We study the shared processor scheduling problem with a single shared processor where a unit time saving (weight) obtained by processing a job on the shared processor depends on the job. A polynomial-time optimization algorithm has been…

Discrete Mathematics · Computer Science 2021-01-19 Dariusz Dereniowski , Wieslaw Kubiak

We consider a maximum entropy edge weight model for shortest path networks that allows for negative weights. Given a graph $G$ and possible weights $\mathcal{W}$ typically consisting of positive and negative values, the model selects edge…

Data Structures and Algorithms · Computer Science 2024-10-31 Lukas Geis , Daniel Allendorf , Thomas Bläsius , Alexander Leonhardt , Ulrich Meyer , Manuel Penschuck , Hung Tran

This paper studies the fastest distributed consensus averaging problem on branches of an arbitrary connected sensor network. In the previous works full knowledge about the sensor network's connectivity topology was required for determining…

Information Theory · Computer Science 2011-06-06 Saber Jafarizadeh , Abbas Jamalipour

Probabilistic artificial neural networks offer intriguing prospects for enabling the uncertainty of artificial intelligence methods to be described explicitly in their function; however, the development of techniques that quantify…

Artificial Intelligence · Computer Science 2023-11-23 James B. Aimone , William Severa , J. Darby Smith

Optimizing deep neural networks (DNNs) often suffers from the ill-conditioned problem. We observe that the scaling-based weight space symmetry property in rectified nonlinear network will cause this negative effect. Therefore, we propose to…

Machine Learning · Computer Science 2017-10-09 Lei Huang , Xianglong Liu , Bo Lang , Bo Li

This article introduces new algorithms for the uniform random generation of labelled planar graphs. Its principles rely on Boltzmann samplers, as recently developed by Duchon, Flajolet, Louchard, and Schaeffer. It combines the Boltzmann…

Combinatorics · Mathematics 2008-12-18 Eric Fusy

The universal approximation theorem, in one of its most general versions, says that if we consider only continuous activation functions $\sigma$, then a standard feedforward neural network with one hidden layer is able to approximate any…

Machine Learning · Computer Science 2020-02-18 Kai Fong Ernest Chong

It is of particular interest to reconstruct or estimate bandlimited graph signals, which are smoothly varying signals defined over graphs, from partial noisy measurements. However, choosing an optimal subset of nodes to sample is NP-hard.…

Signal Processing · Electrical Eng. & Systems 2017-11-21 Xuan Xie , Hui Feng , Junlian Jia , Bo Hu

The paper analyzes theoretically and empirically the performance of likelihood weighting (LW) on a subset of nodes in Bayesian networks. The proposed scheme requires fewer samples to converge due to reduction in sampling variance. The…

Artificial Intelligence · Computer Science 2012-07-02 Bozhena Bidyuk , Rina Dechter

We consider the problem of sampling an edge almost uniformly from an unknown graph, $G = (V, E)$. Access to the graph is provided via queries of the following types: (1) uniform vertex queries, (2) degree queries, and (3) neighbor queries.…

Computational Complexity · Computer Science 2017-06-30 Talya Eden , Will Rosenbaum