English
Related papers

Related papers: Learning with Algebraic Invariances, and the Invar…

200 papers

This paper introduces a novel statistical regression framework that allows the incorporation of consistency constraints. A linear and nonlinear (kernel-based) formulation are introduced, and both imply closed-form analytical solutions. The…

Methodology · Statistics 2020-12-10 Emiliano Díaz , Adrián Pérez-Suay , Valero Laparra , Gustau Camps-Valls

With the advent of kernel methods, automating the task of specifying a suitable kernel has become increasingly important. In this context, the Multiple Kernel Learning (MKL) problem of finding a combination of pre-specified base kernels…

Machine Learning · Computer Science 2012-07-03 Abhishek Kumar , Alexandru Niculescu-Mizil , Koray Kavukcuoglu , Hal Daume

Many machine learning problems can be formulated as predicting labels for a pair of objects. Problems of that kind are often referred to as pairwise learning, dyadic prediction or network inference problems. During the last decade kernel…

Machine Learning · Statistics 2018-03-06 Michiel Stock , Tapio Pahikkala , Antti Airola , Bernard De Baets , Willem Waegeman

Kernel-based subspace clustering, which addresses the nonlinear structures in data, is an evolving area of research. Despite noteworthy progressions, prevailing methodologies predominantly grapple with limitations relating to (i) the…

Machine Learning · Computer Science 2025-01-22 Kunpeng Xu , Lifei Chen , Shengrui Wang

In this paper, the framework of kernel machines with two layers is introduced, generalizing classical kernel methods. The new learning methodology provide a formal connection between computational architectures with multiple layers and the…

Machine Learning · Computer Science 2010-01-18 Francesco Dinuzzo

We consider the problem of operator-valued kernel learning and investigate the possibility of going beyond the well-known separable kernels. Borrowing tools and concepts from the field of quantum computing, such as partial trace and…

Machine Learning · Computer Science 2021-01-18 Riikka Huusari , Hachem Kadri

This paper introduces a kernel discrepancy-based framework for rerandomization to enhance the precision of causal inference in controlled experiments. We demonstrate that the kernel discrepancy is the key part of the variance upper bound…

Methodology · Statistics 2025-11-05 Yiou Li , Lulu Kang

Recent theoretical studies illustrated that kernel ridgeless regression can guarantee good generalization ability without an explicit regularization. In this paper, we investigate the statistical properties of ridgeless regression with…

Machine Learning · Computer Science 2023-08-30 Jian Li , Yong Liu , Yingying Zhang

Reliable training of generative adversarial networks (GANs) typically require massive datasets in order to model complicated distributions. However, in several applications, training samples obey invariances that are \textit{a priori}…

Kernel-based learning algorithms are widely used in machine learning for problems that make use of the similarity between object pairs. Such algorithms first embed all data points into an alternative space, where the inner product between…

Machine Learning · Statistics 2017-09-21 Amir-Hossein Karimi

In this paper we aim at increasing the descriptive power of the covariance matrix, limited in capturing linear mutual dependencies between variables only. We present a rigorous and principled mathematical pipeline to recover the kernel…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Jacopo Cavazza , Andrea Zunino , Marco San Biagio , Vittorio Murino

We introduce a machine-learning approach for identifying hidden structural features of open quantum dynamics under restricted experimental access. Unlike most existing data-driven methods which focus on detection or prediction of dynamical…

Quantum Physics · Physics 2026-04-02 Alexander Teretenkov , Sergey Kuznetsov , Alexander Pechen

Physics-informed machine learning combines the expressiveness of data-based approaches with the interpretability of physical models. In this context, we consider a general regression problem where the empirical risk is regularized by a…

Artificial Intelligence · Computer Science 2025-07-15 Nathan Doumèche , Francis Bach , Gérard Biau , Claire Boyer

Measurements of systems taken along a continuous functional dimension, such as time or space, are ubiquitous in many fields, from the physical and biological sciences to economics and engineering.Such measurements can be viewed as…

The ability to generalize under distributional shifts is essential to reliable machine learning, while models optimized with empirical risk minimization usually fail on non-$i.i.d$ testing data. Recently, invariant learning methods for…

Machine Learning · Computer Science 2021-10-26 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

In this paper, we study the spectrum and the eigenvectors of radial kernels for mixtures of distributions in $\mathbb{R}^n$. Our approach focuses on high dimensions and relies solely on the concentration properties of the components in the…

Machine Learning · Statistics 2020-01-07 David Cohen-Steiner , Alba Chiara de Vitis

We study kernel quadrature rules with convex weights. Our approach combines the spectral properties of the kernel with recombination results about point measures. This results in effective algorithms that construct convex quadrature rules…

Numerical Analysis · Mathematics 2022-10-12 Satoshi Hayakawa , Harald Oberhauser , Terry Lyons

The present survey results from the will to reconcile two approaches to quantum probabilities: one rather physical and coming directly from quantum mechanics, the other more algebraic. The second leading idea is to provide a unified picture…

Mathematical Physics · Physics 2022-10-18 Raphael Chetrite , Frederic Patras

Kernel methods are fundamental tools in machine learning that allow detection of non-linear dependencies between data without explicitly constructing feature vectors in high dimensional spaces. A major disadvantage of kernel methods is…

Data Structures and Algorithms · Computer Science 2020-12-23 Thomas D. Ahle , Michael Kapralov , Jakob B. T. Knudsen , Rasmus Pagh , Ameya Velingker , David Woodruff , Amir Zandieh

Non-linear kernel methods can be approximated by fast linear ones using suitable explicit feature maps allowing their application to large scale problems. We investigate how convolution kernels for structured data are composed from base…

Machine Learning · Computer Science 2019-11-26 Nils M. Kriege , Marion Neumann , Christopher Morris , Kristian Kersting , Petra Mutzel