English
Related papers

Related papers: Interpretable Kernel Representation Learning at Sc…

200 papers

In recent years, the spectral analysis of appropriately defined kernel matrices has emerged as a principled way to extract the low-dimensional structure often prevalent in high-dimensional data. Here we provide an introduction to spectral…

Machine Learning · Statistics 2010-04-20 Mohamed-Ali Belabbas , Patrick J. Wolfe

Scalable kernel methods, including kernel ridge regression, often rely on low-rank matrix approximations using the Nystrom method, which involves selecting landmark points from large data sets. The existing approaches to selecting landmarks…

Machine Learning · Computer Science 2020-09-22 Farhad Pourkamali-Anaraki , Mohammad Amin Hariri-Ardebili , Lydia Morawiec

Steerable convolutional neural networks (CNNs) provide a general framework for building neural networks equivariant to translations and transformations of an origin-preserving group $G$, such as reflections and rotations. They rely on…

Machine Learning · Computer Science 2023-10-30 Maksim Zhdanov , Nico Hoffmann , Gabriele Cesa

Models often need to be constrained to a certain size for them to be considered interpretable. For example, a decision tree of depth 5 is much easier to understand than one of depth 50. Limiting model size, however, often reduces accuracy.…

Machine Learning · Computer Science 2020-07-02 Abhishek Ghose , Balaraman Ravindran

Distributed representations provide a vector space that captures meaningful relationships between data instances. The distributed nature of these representations, however, entangles together multiple attributes or concepts of data instances…

Machine Learning · Computer Science 2023-12-04 Somnath Basu Roy Chowdhury , Nicholas Monath , Avinava Dubey , Amr Ahmed , Snigdha Chaturvedi

This paper presents a kernel-based framework for physics-informed nonlinear system identification. The key contribution is a structured methodology that extends kernel-based techniques to seamlessly embed partially known physics-based…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Cesare Donati , Martina Mammarella , Giuseppe C. Calafiore , Fabrizio Dabbene , Constantino Lagoa , Carlo Novara

Over the last decade, kernel methods for nonlinear processing have successfully been used in the machine learning community. The primary mathematical tool employed in these methods is the notion of the Reproducing Kernel Hilbert Space.…

Machine Learning · Computer Science 2017-04-26 Pantelis Bouboulis , Sergios Theodoridis

Quantum kernel methods leverage a kernel function computed by embedding input information into the Hilbert space of a quantum system. However, large Hilbert spaces can hinder generalization capability, and the scalability of quantum kernels…

Quantum Physics · Physics 2024-04-16 Rodrigo Martínez-Peña , Miguel C. Soriano , Roberta Zambrini

Neural Processes (NPs) are a rapidly evolving class of models designed to directly model the posterior predictive distribution of stochastic processes. Originally developed as a scalable alternative to Gaussian Processes (GPs), which are…

Machine Learning · Computer Science 2026-04-20 Daniel Jenson , Jhonathan Navott , Mengyan Zhang , Makkunda Sharma , Elizaveta Semenova , Seth Flaxman

Adaptive algorithms based on kernel structures have been a topic of significant research over the past few years. The main advantage is that they form a family of universal approximators, offering an elegant solution to problems with…

Machine Learning · Computer Science 2017-08-29 R. C. de Lamare , André Flores

This paper presents a kernel-based discriminative learning framework on probability measures. Rather than relying on large collections of vectorial training examples, our framework learns using a collection of probability distributions that…

Machine Learning · Statistics 2013-01-15 Krikamol Muandet , Kenji Fukumizu , Francesco Dinuzzo , Bernhard Schölkopf

State-of-the-art clustering algorithms use heuristics to partition the feature space and provide little insight into the rationale for cluster membership, limiting their interpretability. In healthcare applications, the latter poses a…

Machine Learning · Statistics 2018-12-04 Dimitris Bertsimas , Agni Orfanoudaki , Holly Wiberg

Understanding how the brain encodes stimuli has been a fundamental problem in computational neuroscience. Insights into this problem have led to the design and development of artificial neural networks that learn representations by…

Neurons and Cognition · Quantitative Biology 2025-12-04 Shubham Choudhary , Paul Masset , Demba Ba

Kernel methods, particularly kernel ridge regression (KRR), are time-proven, powerful nonparametric regression techniques known for their rich capacity, analytical simplicity, and computational tractability. The analysis of their predictive…

Statistics Theory · Mathematics 2025-09-23 Xin Bing , Xin He , Chao Wang

Modern clustering approaches often trade interpretability for performance, particularly in deep learning-based methods. We present Generative Kernel Spectral Clustering (GenKSC), a novel model combining kernel spectral clustering with…

Machine Learning · Computer Science 2025-04-25 David Winant , Sonny Achten , Johan A. K. Suykens

The compositionality and sparsity of high-throughput sequencing data poses a challenge for regression and classification. However, in microbiome research in particular, conditional modeling is an essential tool to investigate relationships…

Machine Learning · Statistics 2023-07-19 Shimeng Huang , Elisabeth Ailer , Niki Kilbertus , Niklas Pfister

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

In this article, a novel approach to learning a complex function which can be written as the system of linear equations is introduced. This learning is grounded upon the observation that solving the system of linear equations by a…

Machine Learning · Computer Science 2018-10-23 Kar-Ann Toh

Tree kernels have demonstrated their ability to deal with hierarchical data, as the intrinsic tree structure often plays a discriminative role. While such kernels have been successfully applied to various domains such as nature language…

Computer Vision and Pattern Recognition · Computer Science 2016-04-08 Yanwei Cui , Laetitia Chapel , Sébastien Lefèvre

Kernel regression is a popular non-parametric fitting technique. It aims at learning a function which estimates the targets for test inputs as precise as possible. Generally, the function value for a test input is estimated by a weighted…

Machine Learning · Computer Science 2017-12-27 Rongqing Huang , Shiliang Sun