English
Related papers

Related papers: Kernel Sum of Squares for Data Adapted Kernel Lear…

200 papers

Kernel methods provide an elegant and principled approach to nonparametric learning, but so far could hardly be used in large scale problems, since na\"ive implementations scale poorly with data size. Recent advances have shown the benefits…

Machine Learning · Computer Science 2020-11-30 Giacomo Meanti , Luigi Carratino , Lorenzo Rosasco , Alessandro Rudi

We consider the challenge of black-box optimization within hybrid discrete-continuous and variable-length spaces, a problem that arises in various applications, such as decision tree learning and symbolic regression. We propose DisCo-DSO…

Machine Learning · Computer Science 2024-12-17 Jacob F. Pettit , Chak Shing Lee , Jiachen Yang , Alex Ho , Daniel Faissol , Brenden Petersen , Mikel Landajuela

A novel combination of two widely-used clustering algorithms is proposed here for the detection and reduction of high data density regions. The Density Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm is used for the…

Computational Physics · Physics 2023-07-19 Bart J. J. Kremers , Aaron Ho , Jonathan Citrin , Karel L. van de Plassche

Built upon the decision tree (DT) classification and regression idea, the subspace learning machine (SLM) has been recently proposed to offer higher performance in general classification and regression tasks. Its performance improvement is…

Machine Learning · Computer Science 2022-08-16 Hongyu Fu , Yijing Yang , Yuhuai Liu , Joseph Lin , Ethan Harrison , Vinod K. Mishra , C. -C. Jay Kuo

Training of Artificial Neural Networks is a complex task of great importance in supervised learning problems. Evolutionary Algorithms are widely used as global optimization techniques and these approaches have been used for Artificial…

Neural and Evolutionary Computing · Computer Science 2021-07-06 Danielle Silva , Teresa Ludermir

This paper describes a study of comparison of global and one-dimensional local optimization methods to operating system scheduler tuning. The operating system scheduler we use is the Linux 2.6.23 Completely Fair Scheduler (CFS) running in…

Operating Systems · Computer Science 2010-12-21 George Anderson , Tshilidzi Marwala , Fulufhelo Vincent Nelwamondo

With the rapid development of quantum computers, quantum algorithms have been studied extensively. However, quantum algorithms tackling statistical problems are still lacking. In this paper, we propose a novel non-oracular quantum adaptive…

Methodology · Statistics 2021-07-20 Wenxuan Zhong , Yuan Ke , Ye Wang , Yongkai Chen , Jinyang Chen , Ping Ma

This article presents a three-step framework for learning and solving partial differential equations (PDEs) using kernel methods. Given a training set consisting of pairs of noisy PDE solutions and source/boundary terms on a mesh, kernel…

Machine Learning · Statistics 2023-04-03 Da Long , Nicole Mrvaljevic , Shandian Zhe , Bamdad Hosseini

This study addresses the problem of convolutional kernel learning in univariate, multivariate, and multidimensional time series data, which is crucial for interpreting temporal patterns in time series and supporting downstream machine…

Machine Learning · Computer Science 2025-04-17 Xinyu Chen , HanQin Cai , Fuqiang Liu , Jinhua Zhao

Neural networks have been widely used as predictive models to fit data distribution, and they could be implemented through learning a collection of samples. In many applications, however, the given dataset may contain noisy samples or…

Neural and Evolutionary Computing · Computer Science 2017-05-30 Dianhui Wang , Ming Li

Quantum computing, with its potential to enhance various machine learning tasks, allows significant advancements in kernel calculation and model precision. Utilizing the one-class Support Vector Machine alongside a quantum kernel, known for…

In this chapter, we utilize dynamical systems to analyze several aspects of machine learning algorithms. As an expository contribution we demonstrate how to re-formulate a wide variety of challenges from deep neural networks, (stochastic)…

Dynamical Systems · Mathematics 2025-07-08 Dennis Chemnitz , Maximilian Engel , Christian Kuehn , Sara-Viola Kuntz

Kernel approximation methods create explicit, low-dimensional kernel feature maps to deal with the high computational and memory complexity of standard techniques. This work studies a supervised kernel learning methodology to optimize such…

Machine Learning · Computer Science 2020-02-17 Mert Al , Zejiang Hou , Sun-Yuan Kung

Local optimization of adsorption systems inherently involves different scales: within the substrate, within the molecule, and between molecule and substrate. In this work, we show how the explicit modeling of the different character of the…

This chapter deals with kernel methods as a special class of techniques for surrogate modeling. Kernel methods have proven to be efficient in machine learning, pattern recognition and signal analysis due to their flexibility, excellent…

Numerical Analysis · Mathematics 2022-10-31 Gabriele Santin , Bernard Haasdonk

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

Hamiltonian dynamics describe a wide range of physical systems. As such, data-driven simulations of Hamiltonian systems are important for many scientific and engineering problems. In this work, we propose kernel-based methods for…

Numerical Analysis · Mathematics 2025-09-23 Yasamin Jalalian , Mostafa Samir , Boumediene Hamzi , Peyman Tavallali , Houman Owhadi

Kernel methods play a critical role in many machine learning algorithms. They are useful in manifold learning, classification, clustering and other data analysis tasks. Setting the kernel's scale parameter, also referred to as the kernel's…

Machine Learning · Computer Science 2019-06-06 Ofir Lindenbaum , Moshe Salhov , Arie Yeredor , Amir Averbuch

This paper introduces a novel framework for dynamic classification in high dimensional spaces, addressing the evolving nature of class distributions over time or other index variables. Traditional discriminant analysis techniques are…

Methodology · Statistics 2025-02-18 Wenbo Ouyang , Ruiyang Wu , Ning Hao , Hao Helen Zhang

This paper proposes a novel kernel-based optimization scheme to handle tasks in the analysis, e.g., signal spectral estimation and single-channel source separation of 1D non-stationary oscillatory data. The key insight of our optimization…

Machine Learning · Statistics 2022-12-12 Jieren Xu , Yitong Li , Haizhao Yang , David Dunson , Ingrid Daubechies