English
Related papers

Related papers: Learning with Spectral Kernels and Heavy-Tailed Da…

200 papers

Kernel methods are powerful machine learning techniques which implement generic non-linear functions to solve complex tasks in a simple way. They Have a solid mathematical background and exhibit excellent performance in practice. However,…

Machine Learning · Computer Science 2021-01-27 J. Emmanuel Johnson , Valero Laparra , Adrián Pérez-Suay , Miguel D. Mahecha , Gustau Camps-Valls

The dominant approaches to text representation in natural language rely on learning embeddings on massive corpora which have convenient properties such as compositionality and distance preservation. In this paper, we develop a novel method…

The high dimensionality of hyperspectral imaging forces unique challenges in scope, size and processing requirements. Motivated by the potential for an in-the-field cell sorting detector, we examine a $\textit{Synechocystis sp.}$ PCC 6803…

Neural and Evolutionary Computing · Computer Science 2017-10-30 William M. Severa , Jerilyn A. Timlin , Suraj Kholwadwala , Conrad D. James , James B. Aimone

We consider a discriminative learning (regression) problem, whereby the regression function is a convex combination of k linear classifiers. Existing approaches are based on the EM algorithm, or similar techniques, without provable…

Machine Learning · Computer Science 2014-08-01 Yuekai Sun , Stratis Ioannidis , Andrea Montanari

Real-world datasets are inherently heterogeneous, yet how per-class structural differences and sampling imbalance shape the training dynamics of diffusion models-and potentially exacerbate disparities-remains poorly understood. While models…

Machine Learning · Statistics 2026-05-08 Flavio Nicoletti , Chenxiao Ma , Enrico Ventura , Luca Saglietti , Stefano Sarao Mannelli

Deep learning-based segmentation techniques have shown remarkable performance in brain segmentation, yet their success hinges on the availability of extensive labeled training data. Acquiring such vast datasets, however, poses a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jihoon Cho , Suhyun Ahn , Beomju Kim , Hyungjoon Bae , Xiaofeng Liu , Fangxu Xing , Kyungeun Lee , Georges Elfakhri , Van Wedeen , Jonghye Woo , Jinah Park

Metric and kernel learning are important in several machine learning applications. However, most existing metric learning algorithms are limited to learning metrics over low-dimensional data, while existing kernel learning algorithms are…

Machine Learning · Computer Science 2009-11-02 Prateek Jain , Brian Kulis , Jason V. Davis , Inderjit S. Dhillon

We provide quantitative bounds measuring the $L^2$ difference in function space between the trajectory of a finite-width network trained on finitely many samples from the idealized kernel dynamics of infinite width and infinite data. An…

Machine Learning · Statistics 2022-10-18 Benjamin Bowman , Guido Montufar

Approaches based on deep neural networks have achieved striking performance when testing data and training data share similar distribution, but can significantly fail otherwise. Therefore, eliminating the impact of distribution shifts…

Machine Learning · Computer Science 2021-04-19 Xingxuan Zhang , Peng Cui , Renzhe Xu , Linjun Zhou , Yue He , Zheyan Shen

In modern multilabel classification problems, each data instance belongs to a small number of classes from a large set of classes. In other words, these problems involve learning very sparse binary label vectors. Moreover, in large-scale…

Machine Learning · Computer Science 2020-11-03 Shashanka Ubaru , Sanjeeb Dash , Arya Mazumdar , Oktay Gunluk

Hyperspectral Image (HSI) classification is an important issue in remote sensing field with extensive applications in earth science. In recent years, a large number of deep learning-based HSI classification methods have been proposed.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ning Chen , Jun Yue , Leyuan Fang , Shaobo Xia

We study the multiple manifold problem, a binary classification task modeled on applications in machine vision, in which a deep fully-connected neural network is trained to separate two low-dimensional submanifolds of the unit sphere. We…

Machine Learning · Statistics 2021-05-07 Sam Buchanan , Dar Gilboa , John Wright

We provide a methodology for learning sparse statistical models that use as features all possible multiplicative interactions among an underlying atomic set of features. While the resulting optimization problems are exponentially sized, our…

Machine Learning · Computer Science 2020-02-11 Hristo Paskov , Alex Paskov , Robert West

We propose a spectral clustering algorithm for analyzing the dependence structure of multivariate extremes. More specifically, we focus on the asymptotic dependence of multivariate extremes characterized by the angular or spectral measure…

Machine Learning · Statistics 2023-08-02 Marco Avella Medina , Richard A. Davis , Gennady Samorodnitsky

Diffusion models have emerged as powerful generative frameworks with widespread applications across machine learning and artificial intelligence systems. While current research has predominantly focused on linear diffusions, these…

Machine Learning · Statistics 2025-10-06 Kulunu Dharmakeerthi , Yousef El-Laham , Henry H. Wong , Vamsi K. Potluru , Changhong He , Taosong He

Graph convolutional networks are a new promising learning approach to deal with data on irregular domains. They are predestined to overcome certain limitations of conventional grid-based architectures and will enable efficient handling of…

Computer Vision and Pattern Recognition · Computer Science 2018-09-17 Lasse Hansen , Jasper Diesel , Mattias P. Heinrich

We propose a greedy strategy to spectrally train a deep network for multi-class classification. Each layer is defined as a composition of linear weights with the feature map of a Gaussian kernel acting as the activation function. At each…

Machine Learning · Computer Science 2020-11-11 Chieh Wu , Aria Masoomi , Arthur Gretton , Jennifer Dy

We establish the limiting spectral distribution of Kendall's correlation matrices in the moderate high-dimensional regime where the dimension grows slower than the sample size. Our framework allows observations to be independent but not…

Statistics Theory · Mathematics 2026-03-10 Raunak Shevade , Monika Bhattacharjee

Kernel density estimation is a key component of a wide variety of algorithms in machine learning, Bayesian inference, stochastic dynamics and signal processing. However, the unsupervised density estimation technique requires tuning a…

Machine Learning · Computer Science 2025-12-17 Sunia Tanweer , Firas A. Khasawneh

Binary image based classification and retrieval of documents of an intellectual nature is a very challenging problem. Variations in the binary image generation mechanisms which are subject to the document artisan designer including drawing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Juan Castorena , Manish Bhattarai , Diane Oyen