English
Related papers

Related papers: Storage capacity in symmetric binary perceptrons

200 papers

The storage capacity of an incremental learning algorithm for the parity machine, the Tilinglike Learning Algorithm, is analytically determined in the limit of a large number of hidden perceptrons. Different learning rules for the simple…

Disordered Systems and Neural Networks · Physics 2009-10-31 Arnaud Buhot , Mirta B. Gordon

The encoder and decoder for lossy data compression of binary memoryless sources are developed on the basis of a specific-type nonmonotonic perceptron. Statistical mechanical analysis indicates that the potential ability of the…

Information Theory · Computer Science 2009-11-11 Tadaaki Hosaka , Yoshiyuki Kabashima

We study the random binary symmetric perceptron problem, focusing on the behavior of rare high-margin solutions. While most solutions are isolated, we demonstrate that these rare solutions are part of clusters of extensive entropy,…

Probability · Mathematics 2024-07-22 Damien Barbier , Ahmed El Alaoui , Florent Krzakala , Lenka Zdeborová

We consider robust combinatorial optimization problems where the decision maker can react to a scenario by choosing from a finite set of $k$ solutions. This approach is appropriate for decision problems under uncertainty where the…

Optimization and Control · Mathematics 2019-03-28 André Chassein , Marc Goerigk , Jannis Kurtz , Michael Poss

We consider constellations of disks which are unions of disjoint hyperbolic disks in the unit disk with fixed radii and unfixed centers. We study the problem of maximizing the conformal capacity of a constellation with a fixed number of…

Complex Variables · Mathematics 2025-03-25 Harri Hakula , Mohamed M. S. Nasser , Matti Vuorinen

The past decade has seen notable advances in our understanding of structured error-correcting codes, particularly binary Reed--Muller (RM) codes. While initial breakthroughs were for erasure channels based on symmetry, extending these…

Information Theory · Computer Science 2025-04-23 Henry D. Pfister , Galen Reeves

The general stable quantum memory unit is a hybrid consisting of a classical digit with a quantum digit (qudit) assigned to each classical state. The shape of the memory is the vector of sizes of these qudits, which may differ. We determine…

Quantum Physics · Physics 2019-09-16 Greg Kuperberg

This paper presents a proximal bundle variant, namely, the relaxed proximal bundle (RPB) method, for solving convex nonsmooth composite optimization problems. Like other proximal bundle variants, RPB solves a sequence of prox bundle…

Optimization and Control · Mathematics 2021-06-09 Jiaming Liang , Renato D. C. Monteiro

This paper addresses the capacitated periodic review inventory control problem, focusing on a retailer managing multiple products with limited shared resources, such as storage or inbound labor at a facility. Specifically, this paper is…

Systems and Control · Electrical Eng. & Systems 2024-10-07 Carson Eisenach , Udaya Ghai , Dhruv Madeka , Kari Torkkola , Dean Foster , Sham Kakade

We investigate near the point of glass transition the expansion of the free energy corresponding to the generalized Sherrington--Kirkpatrick model with arbitrary diagonal operators U standing instead of Ising spins. We focus on the case…

Statistical Mechanics · Physics 2013-03-07 E. E. Tareyeva , T. I. Schelkacheva , N. M. Chtchelkatchev

The multistage robust unit commitment (UC) is of paramount importance for achieving reliable operations considering the uncertainty of renewable realizations. The typical affine decision rule method and the robust feasible region method may…

Optimization and Control · Mathematics 2023-03-07 Yu Lan , Qiaozhu Zhai , Xiaoming Liu , Xiaohong Guan

We investigate the VC-dimension of the perceptron and simple two-layer networks like the committee- and the parity-machine with weights restricted to values $\pm1$. For binary inputs, the VC-dimension is determined by atypical pattern sets,…

Condensed Matter · Physics 2009-10-28 S. Mertens , A. Engel

The unextendible orthogonal matrices (UPBs) can be used for various problems in quantum information. We provide an algorithm to check if two UPBs are non-equivalent to each other. We give a method to construct UPBs and we apply this method…

Quantum Physics · Physics 2024-02-20 Caohan Cheng , Lin Chen

This note consists of two largely independent parts. In the first part we give conditions on the kernel $k: \Omega \times \Omega \rightarrow \mathbb{R}$ of a reproducing kernel Hilbert space $H$ continuously embedded via the identity…

Functional Analysis · Mathematics 2022-06-16 Marcin Wnuk

The unbounded knapsack problem with bounded weights is a variant of the well-studied variant of the traditional binary knapsack problem; key changes being the relaxation of the binary constraint and allowing the unit weights of each item to…

Data Structures and Algorithms · Computer Science 2021-09-29 Michael Beyer , Steven Mills

We demonstrate that the fraction of pattern sets that can be stored in single- and hidden-layer perceptrons exhibits finite size scaling. This feature allows to estimate the critical storage capacity \alpha_c from simulations of relatively…

Disordered Systems and Neural Networks · Physics 2009-10-28 Walter Nadler , Wolfgang Fink

In this paper, the following problem in the hyperbolic space $\mathbb{B}^N$ will be considered \begin{equation*} -\Delta_{\mathbb{B}^N} u=f(x,u), \mathrm{in} \ \mathbb{B}^N.\eqno{(1)} \end{equation*} where, $\Delta_{\mathbb{B}^N}$ denotes…

Analysis of PDEs · Mathematics 2022-12-02 Fei Fang , Zhong Tan , Huiru Xiong

We perform the replica symmetry breaking (RSB) in the vicinity of the point of instability of the replica symmetric solution in the model of axial quadrupolar glass. It is shown that the solution with the first stage RSB is stable against…

Disordered Systems and Neural Networks · Physics 2007-05-23 N. V. Gribova , E. E. Tareyeva

In robust combinatorial optimization, we would like to find a solution that performs well under all realizations of an uncertainty set of possible parameter values. How we model this uncertainty set has a decisive influence on the…

Optimization and Control · Mathematics 2024-04-30 Marc Goerigk , Mohammad Khosravi

This note is concerned with a diluted version of the perceptron model. We establish a replica symmetric formula at high temperature, which is achieved by studying the asymptotic behavior of a given spin magnetization. Our main task will be…

Probability · Mathematics 2007-05-23 David Marquez-Carreras , Carles Rovira , Samy Tindel