English
Related papers

Related papers: An adaptive residual sub-sampling algorithm for ke…

200 papers

A new extremely simple ensemble-based model with the uniformly generated axis-parallel hyper-rectangles as base models (HRBM) is proposed. Two types of HRBMs are studied: closed rectangles and corners. The main idea behind HRBM is to…

Machine Learning · Computer Science 2023-03-16 Andrei V. Konstantinov , Lev V. Utkin

We report a study of the original image reconstruction algorithm based on the time-of-flight maximum likelihood expectation maximisation (TOF MLEM), developed for the total-body (TB) Jagiellonian PET (J-PET) scanners. The method is…

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

Machine Learning · Computer Science 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

Given a publicly available pool of machine learning models constructed for various tasks, when a user plans to build a model for her own machine learning application, is it possible to build upon models in the pool such that the previous…

Machine Learning · Computer Science 2020-01-22 Xi-Zhu Wu , Wenkai Xu , Song Liu , Zhi-Hua Zhou

Reproducing Kernel Hilbert Space (RKHS) embedding of probability distributions has proved to be an effective approach, via MMD (maximum mean discrepancy), for nonparametric hypothesis testing problems involving distributions defined over…

Statistics Theory · Mathematics 2025-10-17 Soumya Mukherjee , Bharath K. Sriperumbudur

The interpolative decomposition (ID) aims to construct a low-rank approximation formed by a basis consisting of row/column skeletons in the original matrix and a corresponding interpolation matrix. This work explores fast and accurate ID…

Numerical Analysis · Mathematics 2024-12-23 Yijun Dong , Chao Chen , Per-Gunnar Martinsson , Katherine Pearce

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile method to estimate rare events probabilities. It is an iterative procedure on an interacting particle system, where at each step, the $k$ less well-adapted…

Probability · Mathematics 2014-05-07 Charles-Edouard Bréhier , Tony Lelievre , Mathias Rousset

We study the model-based reward-free reinforcement learning with linear function approximation for episodic Markov decision processes (MDPs). In this setting, the agent works in two phases. In the exploration phase, the agent interacts with…

Machine Learning · Computer Science 2022-01-03 Weitong Zhang , Dongruo Zhou , Quanquan Gu

Image resampling is a basic technique that is widely employed in daily applications, such as camera photo editing. Recent deep neural networks (DNNs) have made impressive progress in performance by introducing learned data priors. Still,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiacheng Li , Chang Chen , Fenglong Song , Youliang Yan , Zhiwei Xiong

Kernel methods are widespread in machine learning; however, they are limited by the quadratic complexity of the construction, application, and storage of kernel matrices. Low-rank matrix approximation algorithms are widely used to address…

Machine Learning · Statistics 2021-05-05 Ruoxi Wang , Yingzhou Li , Michael W. Mahoney , Eric Darve

We present Neural Splines, a technique for 3D surface reconstruction that is based on random feature kernels arising from infinitely-wide shallow ReLU networks. Our method achieves state-of-the-art results, outperforming recent neural…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Francis Williams , Matthew Trager , Joan Bruna , Denis Zorin

This paper reviews standard oversampling strategies as performed in the Multiscale Finite Element Method (MsFEM). Common to those approaches is that the oversampling is performed in the full space restricted to a patch but including coarse…

Numerical Analysis · Mathematics 2014-04-16 Patrick Henning , Daniel Peterseim

In this paper we describe a parallel implicit method based on radial basis functions (RBF) for surface reconstruction. The applicability of RBF methods is hindered by its computational demand, that requires the solution of linear systems of…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-05-23 Salvatore Cuomo , Ardelio Gallettiy , Giulio Giuntay , Alfredo Staracey

We present a robust multiple manifolds structure learning (RMMSL) scheme to robustly estimate data structures under the multiple low intrinsic dimensional manifolds assumption. In the local learning stage, RMMSL efficiently estimates local…

Machine Learning · Computer Science 2012-06-22 Dian Gong , Xuemei Zhao , Gerard Medioni

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

Random stepped frequency (RSF) radar, which transmits random-frequency pulses, can suppress the range ambiguity, improve convert detection, and possess excellent electronic counter-countermeasures (ECCM) ability [1]. In this paper, we apply…

Signal Processing · Electrical Eng. & Systems 2018-08-30 Tianyao Huang , Yimin Liu , Huadong Meng , Xiqin Wang

In this paper, we develop an iterative scheme to construct multiscale basis functions within the framework of the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for the mixed formulation. The…

Numerical Analysis · Mathematics 2020-12-04 Siu Wun Cheung , Eric Chung , Yalchin Efendiev , Wing Tat Leung , Sai-Mang Pun

In this paper we develop the Greedy Recombination Interpolation Method (GRIM) for finding sparse approximations of functions initially given as linear combinations of some (large) number of simpler functions. In a similar spirit to the…

Numerical Analysis · Mathematics 2024-03-11 Terry Lyons , Andrew D. McLeod

Reinforcement learning is the method of choice to train models in sampling-based setups with binary outcome feedback, such as navigation, code generation, and mathematical problem solving. In such settings, models implicitly induce a…