English
Related papers

Related papers: Typical kernel size and number of sparse random ma…

200 papers

We investigate the effects of finite size corrections on the overlap probabilities in the Generalized Random Energy Model (GREM) in two situations where replica symmetry is broken in the thermodynamic limit. Our calculations do not use…

Disordered Systems and Neural Networks · Physics 2018-02-14 Bernard Derrida , Peter Mottishaw

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

This paper deals with the speed of convergence of the learning curve in a Gaussian process regression framework. The learning curve describes the average generalization error of the Gaussian process used for the regression. More…

Statistics Theory · Mathematics 2013-01-14 Loic Le Gratiet , Josselin Garnier

A generalization of the random geometric graph (RGG) model is proposed by considering a set of points uniformly and independently distributed on a rectangle of unit area instead of on a unit square [0,1]^2. The topological properties of the…

Physics and Society · Physics 2015-05-20 Ernesto Estrada , Matthew Sheerin

Kernel ridge regression (KRR) is a popular class of machine learning models that has become an important tool for understanding deep learning. Much of the focus thus far has been on studying the proportional asymptotic regime, $n \asymp d$,…

Machine Learning · Statistics 2025-10-07 Parthe Pandit , Zhichao Wang , Yizhe Zhu

The fast computation of large kernel sums is a challenging task, which arises as a subproblem in any kernel method. We approach the problem by slicing, which relies on random projections to one-dimensional subspaces and fast Fourier…

Numerical Analysis · Mathematics 2025-02-25 Johannes Hertrich , Tim Jahn , Michael Quellmalz

In an era of unprecedented deluge of (mostly unstructured) data, graphs are proving more and more useful, across the sciences, as a flexible abstraction to capture complex relationships between complex objects. One of the main challenges…

Disordered Systems and Neural Networks · Physics 2016-10-17 Alaa Saade

We consider an ensemble of $2\times 2$ normal matrices with complex entries representing operators in the quantum mechanics of 2 - level parity-time reversal (PT) symmetric systems. The randomness of the ensemble is endowed by obtaining…

Mathematical Physics · Physics 2025-01-14 Stalin Abraham , A. Bhagwat , Sudhir Ranjan Jain

We develop the finite-size scaling (FSS) theory at quantum transitions, considering generic boundary conditions, such as open and periodic boundary conditions, and also the corrections to the leading FSS behaviors. Using…

Statistical Mechanics · Physics 2014-03-26 Massimo Campostrini , Andrea Pelissetto , Ettore Vicari

Graphons have traditionally served as limit objects for dense graph sequences, with the cut distance serving as the metric for convergence. However, sparse graph sequences converge to the trivial graphon under the conventional definition of…

Signal Processing · Electrical Eng. & Systems 2023-09-12 Xingchao Jian , Feng Ji , Wee Peng Tay

In this work, we investigate quantum phase transition (QPT) in a generic family of spin chains using the ground-state energy, the energy gap, and the geometric measure of entanglement (GE). In many of prior works, GE per site was used.…

Quantum Physics · Physics 2019-09-10 Aydin Deger , Tzu-Chieh Wei

In this paper we consider the space of those probability distributions which maximize the $q$-R\'enyi entropy. These distributions have the same parameter space for every $q$, and in the $q=1$ case these are the normal distributions. Some…

Probability · Mathematics 2017-08-24 Attila Andai

This work deals with uncertainty quantification for a generic input distribution to some resource-intensive simulation, e.g., requiring the solution of a partial differential equation. While efficient numerical methods exist to compute…

Numerical Analysis · Mathematics 2025-06-16 Oliver G. Ernst , Hanno Gottschalk , Toni Kowalewitz , Patrick Krüger

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

We propose a sparse algebra for samplet compressed kernel matrices, to enable efficient scattered data analysis. We show the compression of kernel matrices by means of samplets produces optimally sparse matrices in a certain S-format. It…

Numerical Analysis · Mathematics 2023-05-05 H. Harbrecht , M. Multerer , O. Schenk , Ch. Schwab

Partitioning sparse matrices and graphs is a common and important problem in many scientific and graph analytics applications. In this work, we are concerned with a spatial partitioning called rectilinear partitioning (also known as…

Data Structures and Algorithms · Computer Science 2020-01-01 Abdurrahman Yaşar , Ümit V. Çatalyürek

In real word applications, data generating process for training a machine learning model often differs from what the model encounters in the test stage. Understanding how and whether machine learning models generalize under such…

Machine Learning · Statistics 2022-02-08 Abdulkadir Canatar , Blake Bordelon , Cengiz Pehlevan

We propose and analyze a novel framework for learning sparse representations, based on two statistical techniques: kernel smoothing and marginal regression. The proposed approach provides a flexible framework for incorporating feature…

Machine Learning · Statistics 2012-10-04 Krishnakumar Balasubramanian , Kai Yu , Guy Lebanon

A simple non-Hermitean random matrix (RM) model is used to study the Glasgow method of finite-density lattice QCD. The zeros of the RM partition function are evaluated through an averaging procedure, involving the zeros of the RM…

High Energy Physics - Lattice · Physics 2008-11-26 Miklos-Adam Halasz

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson