English
Related papers

Related papers: Property Testing of Computational Networks

200 papers

Given two testable properties $\mathcal{P}_{1}$ and $\mathcal{P}_{2}$, under what conditions are the union, intersection or set-difference of these two properties also testable? We initiate a systematic study of these basic set-theoretic…

Data Structures and Algorithms · Computer Science 2010-10-26 Victor Chen , Madhu Sudan , Ning Xie

In this paper, we study approximation properties of single hidden layer neural networks with weights varying on finitely many directions and thresholds from an open interval. We obtain a necessary and at the same time sufficient measure…

Machine Learning · Computer Science 2023-04-05 Vugar Ismailov , Ekrem Savas

Radial basis function neural networks (\emph{RBFNN}) are {well-known} for their capability to approximate any continuous function on a closed bounded set with arbitrary precision given enough hidden neurons. In this paper, we introduce the…

Machine Learning · Computer Science 2023-03-10 Murad Tukan , Samson Zhou , Alaa Maalouf , Daniela Rus , Vladimir Braverman , Dan Feldman

We study property testing in directed graphs in the bounded degree model, where we assume that an algorithm may only query the outgoing edges of a vertex, a model proposed by Bender and Ron in 2002. As our first main result, we we present a…

Data Structures and Algorithms · Computer Science 2013-12-03 Frank Hellweg , Christian Sohler

We derive the sampling properties of random networks based on weights whose pairwise products parameterize independent Bernoulli trials. This enables an understanding of many degree-based network models, in which the structure of realized…

Statistics Theory · Mathematics 2013-06-07 Sofia C. Olhede , Patrick J. Wolfe

In this work, we consider the approximation of a large class of bounded functions, with minimal regularity assumptions, by ReLU neural networks. We show that the approximation error can be bounded from above by a quantity proportional to…

Machine Learning · Statistics 2026-02-27 Owen Davis , Gianluca Geraci , Mohammad Motamed

Neural networks are known to be vulnerable to adversarial attacks, which are small, imperceptible perturbations that can significantly alter the network's output. Conversely, there may exist large, meaningful perturbations that do not…

Machine Learning · Computer Science 2023-05-18 Tianqi Cui , Thomas Bertalan , George J. Pappas , Manfred Morari , Ioannis G. Kevrekidis , Mahyar Fazlyab

The behavior of neural networks still remains opaque, and a recently widely noted phenomenon is that networks often achieve similar performance when initialized with different random parameters. This phenomenon has attracted significant…

Machine Learning · Computer Science 2023-11-28 Yiting Chen , Zhanpeng Zhou , Junchi Yan

The field of property testing of probability distributions, or distribution testing, aims to provide fast and (most likely) correct answers to questions pertaining to specific aspects of very large datasets. In this work, we consider a…

Data Structures and Algorithms · Computer Science 2015-04-27 Clément L. Canonne

Network analysis is often focused on characterizing the dependencies between network relations and node-level attributes. Potential relationships are typically explored by modeling the network as a function of the nodal attributes or by…

Methodology · Statistics 2013-06-21 Bailey K. Fosdick , Peter D. Hoff

Neural networks are nowadays highly successful despite strong hardness results. The existing hardness results focus on the network architecture, and assume that the network's weights are arbitrary. A natural approach to settle the…

Machine Learning · Computer Science 2020-10-15 Amit Daniely , Gal Vardi

The paper briefy reviews several recent results on hierarchical architectures for learning from examples, that may formally explain the conditions under which Deep Convolutional Neural Networks perform much better in function approximation…

Machine Learning · Computer Science 2016-08-12 Hrushikesh Mhaskar , Tomaso Poggio

We initiate the systematic study of QMA algorithms in the setting of property testing, to which we refer as QMA proofs of proximity (QMAPs). These are quantum query algorithms that receive explicit access to a sublinear-size untrusted proof…

Quantum Physics · Physics 2022-10-17 Marcel Dall'Agnol , Tom Gur , Subhayan Roy Moulik , Justin Thaler

We study the expressivity of deep neural networks. Measuring a network's complexity by its number of connections or by its number of neurons, we consider the class of functions for which the error of best approximation with networks of a…

Functional Analysis · Mathematics 2020-07-20 Rémi Gribonval , Gitta Kutyniok , Morten Nielsen , Felix Voigtlaender

Weight thresholding is a simple technique that aims at reducing the number of edges in weighted networks that are otherwise too dense for the application of standard graph theoretical methods. We show that the group structure of real…

Physics and Society · Physics 2018-10-17 Xiaoran Yan , Lucas G. S. Jeub , Alessandro Flammini , Filippo Radicchi , Santo Fortunato

Neural networks are very successful tools in for example advanced classification. From a statistical point of view, fitting a neural network may be seen as a kind of regression, where we seek a function from the input space to a space of…

Machine Learning · Statistics 2021-07-06 Anton Johansson , Niklas Engsner , Claes Strannegård , Petter Mostad

The resiliency of a network is its ability to remain \emph{effectively} functioning also when any of its nodes or links fails. However, to reduce operational and set-up costs, a network should be small in size, and this conflicts with the…

Data Structures and Algorithms · Computer Science 2016-11-07 Davide Bilò , Luciano Gualà , Stefano Leucci , Guido Proietti

The online manipulation-resilient testing model, proposed by Kalemaj, Raskhodnikova and Varma (ITCS 2022 and Theory of Computing 2023), studies property testing in situations where access to the input degrades continuously and…

Data Structures and Algorithms · Computer Science 2023-11-29 Omri Ben-Eliezer , Esty Kelman , Uri Meir , Sofya Raskhodnikova

We present several new examples of speed-ups obtainable by quantum algorithms in the context of property testing. First, motivated by sampling algorithms, we consider probability distributions given in the form of an oracle $f:[n]\to[m]$.…

Quantum Physics · Physics 2010-05-13 Sourav Chakraborty , Eldar Fischer , Arie Matsliah , Ronald de Wolf

Neural networks with random weights appear in a variety of machine learning applications, most prominently as the initialization of many deep learning algorithms and as a computationally cheap alternative to fully learned neural networks.…

Machine Learning · Computer Science 2022-11-29 Sjoerd Dirksen , Martin Genzel , Laurent Jacques , Alexander Stollenwerk