English
Related papers

Related papers: Typical kernel size and number of sparse random ma…

200 papers

We study the computational complexity of a very basic problem, namely that of finding solutions to a very large set of random linear equations in a finite Galois Field modulo q. Using tools from statistical mechanics we are able to identify…

Statistical Mechanics · Physics 2009-11-07 A. Braunstein , M. Leone , F. Ricci-Tersenghi , R. Zecchina

Random feature methods have been successful in various machine learning tasks, are easy to compute, and come with theoretical accuracy bounds. They serve as an alternative approach to standard neural networks since they can represent…

Machine Learning · Statistics 2026-01-21 Abolfazl Hashemi , Hayden Schaeffer , Robert Shi , Ufuk Topcu , Giang Tran , Rachel Ward

Graph operations or products play an important role in complex networks. In this paper, we study the properties of $q$-subdivision graphs, which have been applied to model complex networks. For a simple connected graph $G$, its…

Combinatorics · Mathematics 2020-02-25 Yibo Zeng , Zhongzhi Zhang

This paper develops several average-case reduction techniques to show new hardness results for three central high-dimensional statistics problems, implying a statistical-computational gap induced by robustness, a detection-recovery gap and…

Computational Complexity · Computer Science 2020-05-20 Matthew Brennan , Guy Bresler

This paper introduces a novel approach to probabilistic deep learning, kernel density matrices, which provide a simpler yet effective mechanism for representing joint probability distributions of both continuous and discrete random…

Machine Learning · Computer Science 2024-05-01 Fabio A. González , Raúl Ramos-Pollán , Joseph A. Gallego-Mejia

We consider general Exponential Random Graph Models (ERGMs) where the sufficient statistics are functions of homomorphism counts for a fixed collection of simple graphs $F_k$. Whereas previous work has shown a degeneracy phenomenon in dense…

Probability · Mathematics 2024-04-04 Nicholas A. Cook , Amir Dembo

Gaussian particles provide a flexible framework for modelling and simulating three-dimensional star-shaped random sets. In our framework, the radial function of the particle arises from a kernel smoothing, and is associated with an…

A general, {\em rectangular} kernel matrix may be defined as $K_{ij} = \kappa(x_i,y_j)$ where $\kappa(x,y)$ is a kernel function and where $X=\{x_i\}_{i=1}^m$ and $Y=\{y_i\}_{i=1}^n$ are two sets of points. In this paper, we seek a low-rank…

Numerical Analysis · Mathematics 2023-06-30 Difeng Cai , Edmond Chow , Yuanzhe Xi

Classical probability distributions on sets of sequences can be modeled using quantum states. Here, we do so with a quantum state that is pure and entangled. Because it is entangled, the reduced densities that describe subsystems also carry…

Quantum Physics · Physics 2020-12-10 Tai-Danae Bradley , E. Miles Stoudenmire , John Terilla

Solving the generalized eigenvalue problem is a useful method for finding energy eigenstates of large quantum systems. It uses projection onto a set of basis states which are typically not orthogonal. One needs to invert a matrix whose…

Nuclear Theory · Physics 2023-04-05 Caleb Hicks , Dean Lee

Grokking occurs when a model achieves high training accuracy but generalization to unseen test points happens long after that. This phenomenon was initially observed on a class of algebraic problems, such as learning modular arithmetic…

Machine Learning · Statistics 2026-04-02 Marcel Tomàs Bernal , Neil Rohit Mallinar , Mikhail Belkin

This paper addresses the problem of identifying a very small subset of data points that belong to a significantly larger massive dataset (i.e., Big Data). The small number of selected data points must adequately represent and faithfully…

Computer Vision and Pattern Recognition · Computer Science 2015-03-12 Chinh Dang , Hayder Radha

Quantum kernels offer a valid procedure for learning quantum phase transitions on quantum processing devices, yet issues on the scalability of the learning strategy in connection with the symmetry of the critical model have not been…

Quantum Physics · Physics 2026-03-20 Aaqib Ali , Giovanni Scala , Cosmo Lupo , Antonio Mandarino

The purpose of this short note is to establish a connection between a one-dimensional random walk in a random sparse environment and the random pinning model. We show that the grand canonical partition function of the pinning model…

Probability · Mathematics 2025-11-20 Julien Poisat

We consider the problem of clustering a sample of probability distributions from a random distribution on $\mathbb R^p$. Our proposed partitioning method makes use of a symmetric, positive-definite kernel $k$ and its associated reproducing…

Machine Learning · Statistics 2025-09-23 Amparo Baíllo , Jose R. Berrendero , Martín Sánchez-Signorini

Structurally random matrices (SRMs) are a practical alternative to fully random matrices (FRMs) when generating compressive sensing measurements because of their computational efficiency and their universality with respect to the sparsifing…

Information Theory · Computer Science 2015-07-27 Raziel Haimi-Cohen , Yenming Mark Lai

Generalized inverses play a fundamental role in numerical linear algebra, particularly when matrices are rectangular, singular, or rank deficient. Even when the input matrix is sparse, generalized inverses such as the M-P pseudoinverse are…

Optimization and Control · Mathematics 2026-05-27 Ananias Machado , Marcia Fampa , Jon Lee

Gaussian Radial Basis Function (RBF) Kernels are the most-often-employed kernels in artificial intelligence and machine learning routines for providing optimally-best results in contrast to their respective counter-parts. However, a little…

Machine Learning · Computer Science 2023-12-19 Himanshu Singh

Let $f$ be the $\mathbb{F}_q$-linear map over $\mathbb{F}_{q^{2n}}$ defined by $x\mapsto x+ax^{q^s}+bx^{q^{n+s}}$ with $\gcd(n,s)=1$. It is known that the kernel of $f$ has dimension at most $2$, as proved by Csajb\'ok et al. in "A new…

Combinatorics · Mathematics 2020-04-23 Olga Polverino , Giovanni Zini , Ferdinando Zullo

The generalized Rosenzweig-Porter model with real (GOE) off-diagonal entries arguably constitutes the simplest random matrix ensemble displaying a phase with fractal eigenstates, which we characterize here by using replica methods. We first…

Disordered Systems and Neural Networks · Physics 2023-05-15 Davide Venturelli , Leticia F. Cugliandolo , Grégory Schehr , Marco Tarzia