English
Related papers

Related papers: Scalable Matrix-valued Kernel Learning for High-di…

200 papers

Multivariate regression model is a natural generalization of the classical univari- ate regression model for fitting multiple responses. In this paper, we propose a high- dimensional multivariate conditional regression model for…

Machine Learning · Statistics 2016-11-26 Junhui Wang

Inferring the connectivity of neural circuits from incomplete observations is a fundamental challenge in neuroscience. We present a covariance-based method for estimating the weight matrix of a recurrent neural network from sparse, partial…

Quantitative Methods · Quantitative Biology 2026-03-20 Quilee Simeon

We present a nonlinear regression framework based on tensor algebra tailored to high dimensional contexts where data is scarce. We exploit algebraic properties of a partial tensor product, namely the m-tensor product, to leverage structured…

Computational Engineering, Finance, and Science · Computer Science 2026-02-10 Rémi Cloarec , Sebastian Rodriguez , Xavier Kestelyn , Francisco Chinesta

In kernel methods, temporal information on the data is commonly included by using time-delayed embeddings as inputs. Recently, an alternative formulation was proposed by defining a gamma-filter explicitly in a reproducing kernel Hilbert…

Machine Learning · Statistics 2017-06-13 Steven Van Vaerenbergh , Simone Scardapane , Ignacio Santamaria

In this paper, we propose a multi-kernel classifier learning algorithm to optimize a given nonlinear and nonsmoonth multivariate classifier performance measure. Moreover, to solve the problem of kernel function selection and kernel…

Machine Learning · Computer Science 2015-08-26 Jingbin Wang , Haoxiang Wang , Yihua Zhou , Nancy McDonald

We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive…

Statistics Theory · Mathematics 2012-11-13 Ming Yuan , T. Tony Cai

This paper introduces an efficient multi-linear nonparametric (kernel-based) approximation framework for data regression and imputation, and its application to dynamic magnetic-resonance imaging (dMRI). Data features are assumed to reside…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Duc Thien Nguyen , Konstantinos Slavakis

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

We study Sparse Multiple Kernel Learning (SMKL), which is the problem of selecting a sparse convex combination of prespecified kernels for support vector binary classification. Unlike prevailing l1 regularized approaches that approximate a…

Machine Learning · Statistics 2025-12-03 Dimitris Bertsimas , Caio de Prospero Iglesias , Nicholas A. G. Johnson

This paper proposes a novel kernel approach to linear dimension reduction for supervised learning. The purpose of the dimension reduction is to find directions in the input space to explain the output as effectively as possible. The…

Machine Learning · Statistics 2011-09-05 Kenji Fukumizu , Chenlei Leng

In this paper we consider the problems of supervised classification and regression in the case where attributes and labels are functions: a data is represented by a set of functions, and the label is also a function. We focus on the use of…

Machine Learning · Computer Science 2016-11-03 Hachem Kadri , Emmanuel Duflos , Philippe Preux , Stéphane Canu , Alain Rakotomamonjy , Julien Audiffren

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

Quantum kernel methods are a promising branch of quantum machine learning, yet their effectiveness on diverse, high-dimensional, real-world data remains unverified. Current research has largely been limited to low-dimensional or synthetic…

Machine Learning · Computer Science 2026-02-19 Jiang Yuhan , Matthew Otten

Kernel approximation methods create explicit, low-dimensional kernel feature maps to deal with the high computational and memory complexity of standard techniques. This work studies a supervised kernel learning methodology to optimize such…

Machine Learning · Computer Science 2020-02-17 Mert Al , Zejiang Hou , Sun-Yuan Kung

Gaussian processes (GPs) stand as crucial tools in machine learning and signal processing, with their effectiveness hinging on kernel design and hyper-parameter optimization. This paper presents a novel GP linear multiple kernel (LMK) and a…

Machine Learning · Computer Science 2025-01-17 Richard Cornelius Suwandi , Zhidi Lin , Feng Yin , Zhiguo Wang , Sergios Theodoridis

High-dimensional sparse data present computational and statistical challenges for supervised learning. We propose compact linear sketches for reducing the dimensionality of the input, followed by a single layer neural network. We show that…

Machine Learning · Computer Science 2016-04-21 Amit Daniely , Nevena Lazic , Yoram Singer , Kunal Talwar

In this paper we consider the problem of approximating vector-valued functions over a domain $\Omega$. For this purpose, we use matrix-valued reproducing kernels, which can be related to Reproducing kernel Hilbert spaces of vectorial…

Numerical Analysis · Mathematics 2019-01-11 Dominik Wittwar , Gabriele Santin , Bernard Haasdonk

In this article, we propose a general nonlinear sufficient dimension reduction (SDR) framework when both the predictor and response lie in some general metric spaces. We construct reproducing kernel Hilbert spaces whose kernels are fully…

Statistics Theory · Mathematics 2022-06-24 Joni Virta , Kuang-Yao Lee , Lexin Li

In this paper, sparsification techniques aided online prediction algorithms in a reproducing kernel Hilbert space are studied for nonstationary time series. The online prediction algorithms as usual consist of the selection of kernel…

Signal Processing · Electrical Eng. & Systems 2022-05-13 Jinhua Guo , Hao Chen , Jingxin Zhang , Sheng Chen

We propose and analyze a novel framework for learning sparse representations, based on two statistical techniques: kernel smoothing and marginal regression. The proposed approach provides a flexible framework for incorporating feature…

Machine Learning · Statistics 2012-10-04 Krishnakumar Balasubramanian , Kai Yu , Guy Lebanon
‹ Prev 1 3 4 5 6 7 10 Next ›