English
Related papers

Related papers: Learning Bounds for Greedy Approximation with Expl…

200 papers

Depth measures are powerful tools for defining level sets in emerging, non--standard, and complex random objects such as high-dimensional multivariate data, functional data, and random graphs. Despite their favorable theoretical properties,…

In this paper, a novel framework of sparse kernel learning for Support Vector Data Description (SVDD) based anomaly detection is presented. In this work, optimal sparse feature selection for anomaly detection is first modeled as a Mixed…

Machine Learning · Computer Science 2015-06-09 Zhimin Peng , Prudhvi Gurram , Heesung Kwon , Wotao Yin

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

Machine learning and deep learning have been used extensively to classify physical surfaces through images and time-series contact data. However, these methods rely on human expertise and entail the time-consuming processes of data and…

Machine Learning · Computer Science 2023-08-10 Behnam Khojasteh , Friedrich Solowjow , Sebastian Trimpe , Katherine J. Kuchenbecker

We derive new bounds for the condition number of kernel matrices, which we then use to enhance existing non-asymptotic test error bounds for kernel ridgeless regression (KRR) in the over-parameterized regime for a fixed input dimension. For…

Machine Learning · Computer Science 2024-05-31 Tin Sum Cheng , Aurelien Lucchi , Anastasis Kratsios , David Belius

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

We address the problem of algorithmic fairness: ensuring that sensitive variables do not unfairly influence the outcome of a classifier. We present an approach based on empirical risk minimization, which incorporates a fairness constraint…

Machine Learning · Statistics 2020-02-03 Michele Donini , Luca Oneto , Shai Ben-David , John Shawe-Taylor , Massimiliano Pontil

This paper introduces an efficient multi-linear nonparametric (kernel-based) approximation framework for data regression and imputation, and its application to dynamic magnetic-resonance imaging (dMRI). Data features are assumed to reside…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Duc Thien Nguyen , Konstantinos Slavakis

In this paper, we propose a data-adaptive non-parametric kernel learning framework in margin based kernel methods. In model formulation, given an initial kernel matrix, a data-adaptive matrix with two constraints is imposed in an entry-wise…

Machine Learning · Computer Science 2020-10-16 Fanghui Liu , Xiaolin Huang , Chen Gong , Jie Yang , Li Li

``Composable core-sets'' are an efficient framework for solving optimization problems in massive data models. In this work, we consider efficient construction of composable core-sets for the determinant maximization problem. This can also…

Data Structures and Algorithms · Computer Science 2019-07-09 Piotr Indyk , Sepideh Mahabadi , Shayan Oveis Gharan , Alireza Rezaei

Likelihood based-learning of graphical models faces challenges of computational-complexity and robustness to model mis-specification. This paper studies methods that fit parameters directly to maximize a measure of the accuracy of predicted…

Machine Learning · Computer Science 2014-07-04 Justin Domke

We consider the optimal coverage problem where a multi-agent network is deployed in an environment with obstacles to maximize a joint event detection probability. The objective function of this problem is non-convex and no global optimum is…

Optimization and Control · Mathematics 2017-08-15 Xinmiao Sun , Christos G. Cassandras , Xiangyu Meng

A wide range of machine learning applications such as privacy-preserving learning, algorithmic fairness, and domain adaptation/generalization among others, involve learning invariant representations of the data that aim to achieve two…

Machine Learning · Computer Science 2022-11-24 Han Zhao , Chen Dan , Bryon Aragam , Tommi S. Jaakkola , Geoffrey J. Gordon , Pradeep Ravikumar

Model misspecification can create significant challenges for the implementation of probabilistic models, and this has led to development of a range of robust methods which directly account for this issue. However, whether these more…

Machine Learning · Statistics 2025-04-22 Oscar Key , Arthur Gretton , François-Xavier Briol , Tamara Fernandez

We connect high-dimensional subset selection and submodular maximization. Our results extend the work of Das and Kempe (2011) from the setting of linear regression to arbitrary objective functions. For greedy feature selection, this…

Machine Learning · Statistics 2017-10-13 Ethan R. Elenberg , Rajiv Khanna , Alexandros G. Dimakis , Sahand Negahban

This work provides performance guarantees for the greedy solution of experimental design problems. In particular, it focuses on A- and E-optimal designs, for which typical guarantees do not apply since the mean-square error and the maximum…

Machine Learning · Computer Science 2018-02-01 Luiz F. O. Chamon , Alejandro Ribeiro

Recent non-linear feature selection approaches employing greedy optimisation of Centred Kernel Target Alignment(KTA) exhibit strong results in terms of generalisation accuracy and sparsity. However, they are computationally prohibitive for…

Machine Learning · Computer Science 2014-02-19 Dimitrios Athanasakis , John Shawe-Taylor , Delmiro Fernandez-Reyes

A method for analyzing the feature map for the kernel-based quantum classifier is developed; that is, we give a general formula for computing a lower bound of the exact training accuracy, which helps us to see whether the selected feature…

Quantum Physics · Physics 2020-08-18 Yudai Suzuki , Hiroshi Yano , Qi Gao , Shumpei Uno , Tomoki Tanaka , Manato Akiyama , Naoki Yamamoto

We analyse the performance of several iterative algorithms for the quantisation of a probability measure $\mu$, based on the minimisation of a Maximum Mean Discrepancy (MMD). Our analysis includes kernel herding, greedy MMD minimisation and…

Machine Learning · Statistics 2022-04-29 Luc Pronzato

We provide theoretical bounds on the worst case performance of the greedy algorithm in seeking to maximize a normalized, monotone, but not necessarily submodular objective function under a simple partition matroid constraint. We also…

Systems and Control · Electrical Eng. & Systems 2022-10-19 Benjamin Biggs , James McMahon , Philip Baldoni , Daniel J. Stilwell