English
Related papers

Related papers: Spectrum-Revealing Cholesky Factorization for Kern…

200 papers

Kernel methods are versatile tools for function approximation and surrogate modeling. In particular, greedy techniques offer computational efficiency and reliability through inherent sparsity and provable convergence. Inspired by the…

Numerical Analysis · Mathematics 2026-03-09 Marian Klink , Tobias Ehring , Robin Herkert , Robin Lautenschlager , Dominik Göddeke , Bernard Haasdonk

In the iterative solution of dense linear systems from boundary integral equations or systems involving kernel matrices, the main challenges are the expensive matrix-vector multiplication and the storage cost which are usually tackled by…

Numerical Analysis · Mathematics 2018-11-13 Xin Xing , Edmond Chow

Clustering analysis by nonnegative low-rank approximations has achieved remarkable progress in the past decade. However, most approximation approaches in this direction are still restricted to matrix factorization. We propose a new low-rank…

Machine Learning · Computer Science 2012-06-22 Zhirong Yang , Erkki Oja

Hashing method maps similar data to binary hashcodes with smaller hamming distance, and it has received a broad attention due to its low storage cost and fast retrieval speed. However, the existing limitations make the present algorithms…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Shifeng Zhang , Jianmin Li , Jinma Guo , Bo Zhang

Through one decade's development, the kernel-based regularization method (KRM) has become a complement to the classical maximum likelihood/prediction error method and an emerging new system identification paradigm. One recent example is its…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Xiaozhu Fang , Tianshi Chen

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

Scalable QR factorization algorithms for solving least squares and eigenvalue problems are critical given the increasing parallelism within modern machines. We introduce a more general parallelization of the CholeskyQR2 algorithm and show…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-18 Edward Hutter , Edgar Solomonik

Nowadays, low-rank approximations of matrices are an important component of many methods in science and engineering. Traditionally, low-rank approximations are considered in unitary invariant norms, however, recently element-wise…

Numerical Analysis · Mathematics 2026-05-15 Stanislav Morozov , Dmitry Zheltkov , Alexander Osinsky

We solve a weakly supervised regression problem. Under "weakly" we understand that for some training points the labels are known, for some unknown, and for others uncertain due to the presence of random noise or other reasons such as lack…

Machine Learning · Computer Science 2021-04-15 Vladimir Berikov , Alexander Litvinenko

We consider the problem of learning low-dimensional representations for large-scale Markov chains. We formulate the task of representation learning as that of mapping the state space of the model to a low-dimensional state space, called the…

Machine Learning · Computer Science 2020-04-09 Mahsa Ghasemi , Abolfazl Hashemi , Haris Vikalo , Ufuk Topcu

Identifying discrete patterns in binary data is an important dimensionality reduction tool in machine learning and data mining. In this paper, we consider the problem of low-rank binary matrix factorisation (BMF) under Boolean arithmetic.…

Optimization and Control · Mathematics 2021-08-05 Reka A. Kovacs , Oktay Gunluk , Raphael A. Hauser

There is currently a huge effort to understand the potential and limitations of variational quantum machine learning (QML) based on the optimization of parameterized quantum circuits. Recent proposals toward dequantizing variational QML…

Quantum Physics · Physics 2025-04-01 Ryan Sweke , Seongwook Shin , Elies Gil-Fuster

The overfitting is one of the cursing subjects in the deep learning field. To solve this challenge, many approaches were proposed to regularize the learning models. They add some hyper-parameters to the model to extend the generalization;…

Machine Learning · Computer Science 2020-05-06 Mohammad Mahdi Bejani , Mehdi Ghatee

We provide a framework for the sparse approximation of multilinear problems and show that several problems in uncertainty quantification fit within this framework. In these problems, the value of a multilinear map has to be approximated…

Numerical Analysis · Mathematics 2018-07-17 Fabio Nobile , Raul Tempone , Soeren Wolfers

Incomplete factorizations have long been popular general-purpose algebraic preconditioners for solving large sparse linear systems of equations. Guaranteeing the factorization is breakdown free while computing a high quality preconditioner…

Numerical Analysis · Mathematics 2025-02-04 Jennifer Scott , Miroslav Tůma

We propose a clustering-based generalized low rank approximation method, which takes advantage of appealing features from both the generalized low rank approximation of matrices (GLRAM) and cluster analysis. It exploits a more general form…

Optimization and Control · Mathematics 2025-02-21 Yujun Zhu , Jie Zhu , Hizba Arshad , Zhongming Wang , Ju Ming

Kernel methods play a critical role in many machine learning algorithms. They are useful in manifold learning, classification, clustering and other data analysis tasks. Setting the kernel's scale parameter, also referred to as the kernel's…

Machine Learning · Computer Science 2019-06-06 Ofir Lindenbaum , Moshe Salhov , Arie Yeredor , Amir Averbuch

As a promising step, the performance of data analysis and feature learning are able to be improved if certain pattern matching mechanism is available. One of the feasible solutions can refer to the importance estimation of instances, and…

Machine Learning · Computer Science 2020-11-17 Miao Cheng , Xinge You

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce…

Machine Learning · Computer Science 2011-12-21 Arash Afkanpour , Csaba Szepesvari , Michael Bowling