English
Related papers

Related papers: Random Sampling High Dimensional Model Representat…

200 papers

In this paper, we study random subsampling of Gaussian process regression, one of the simplest approximation baselines, from a theoretical perspective. Although subsampling discards a large part of training data, we show provable guarantees…

Machine Learning · Statistics 2019-01-29 Kohei Hayashi , Masaaki Imaizumi , Yuichi Yoshida

Earlier versions proposed Graded Projection Recursion (GPR) as a deterministic packed-recursion framework for model-honest near-quadratic dense matrix multiplication. This revised version withdraws the exact dense matrix multiplication…

Computational Complexity · Computer Science 2026-05-12 Jeffrey Uhlmann

Gaussian Processes (GPs) are flexible, nonparametric Bayesian models widely used for regression and classification because of their ability to capture complex data patterns and quantify predictive uncertainty. However, the O(n^3)…

Machine Learning · Computer Science 2026-01-14 Hua Huang , Tianshi Xu , Yuanzhe Xi , Edmond Chow

Hypercomplex signal processing (HSP) offers powerful tools for analyzing and processing multidimensional signals by explicitly exploiting inter-dimensional correlations through Clifford algebra. In recent years, hypercomplex formulations of…

Signal Processing · Electrical Eng. & Systems 2026-03-02 Kumar Vijay Mishra , Henry Arguello , Brian M. Sadler

The probability density function (PDF) plays a central role in statistical and machine learning modeling. Real-world data often deviates from Gaussian assumptions, exhibiting skewness and exponential decay. To evaluate how well different…

Computation · Statistics 2025-12-05 Shantanu Sarkar , Mousumi Sinha , Dexter Cahoy

In the field of 3D dynamic scene reconstruction, how to balance model convergence rate and rendering quality has long been a critical challenge that urgently needs to be addressed, particularly in high-precision modeling of scenes with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Nengbo Lu , Minghua Pan , Shaohua Sun , Yizhou Liang

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

Learning powerful feature representations for image retrieval has always been a challenging task in the field of remote sensing. Traditional methods focus on extracting low-level hand-crafted features which are not only time-consuming but…

Computer Vision and Pattern Recognition · Computer Science 2017-05-22 Weixun Zhou , Shawn Newsam , Congmin Li , Zhenfeng Shao

Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations.…

Methodology · Statistics 2026-03-10 Adam Gorm Hoffmann , Claus Thorn Ekstrøm , Andreas Kryger Jensen

Remote sensing image super-resolution (SR) is a crucial task to restore high-resolution (HR) images from low-resolution (LR) observations. Recently, the Denoising Diffusion Probabilistic Model (DDPM) has shown promising performance in image…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Jialu Sui , Xianping Ma , Xiaokang Zhang , Man-On Pun

Gaussian process regression (GPR) is a popular nonparametric Bayesian method that provides predictive uncertainty estimates and is widely used in safety-critical applications. While prior research has introduced various uncertainty bounds,…

Machine Learning · Computer Science 2025-12-05 Junyi Liu , Stanley Kok

Support vector regression (SVR) has been widely used to reduce the high computational cost of computer simulation. SVR assumes the input parameters have equal sample sizes, but unequal sample sizes are often encountered in engineering…

Signal Processing · Electrical Eng. & Systems 2021-11-09 Maolin Shi , Wei Sun , Xueguan Song , Hongyou Li

This paper proposes an efficient general alternating-direction implicit (GADI) framework for solving large sparse linear systems. The convergence property of the GADI framework is discussed. Most of the existing ADI methods can be viewed as…

Numerical Analysis · Mathematics 2022-05-04 Kai Jiang , Xuehong Su , Juan Zhang

Gaussian process (GP) is a Bayesian model which provides several advantages for regression tasks in machine learning such as reliable quantitation of uncertainty and improved interpretability. Their adoption has been precluded by their…

Machine Learning · Computer Science 2023-06-26 Jonathan Parkinson , Wei Wang

Gaussian Process Regression (GPR) is a nonparametric supervised learning method, widely valued for its ability to quantify uncertainty. Despite its advantages and broad applications, classical GPR implementations face significant…

Quantum Physics · Physics 2025-03-25 Junpeng Hu , Jinglai Li , Lei Zhang , Shi Jin

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be…

Chemical Physics · Physics 2025-12-03 Rohit Goswami , Hannes Jónsson

This paper explores robust recovery of a superposition of $R$ distinct complex exponential functions from a few random Gaussian projections. We assume that the signal of interest is of $2N-1$ dimensional and $R<<2N-1$. This framework covers…

Information Theory · Computer Science 2015-03-11 Jian-Feng Cai , Xiaobo Qu , Weiyu Xu , Gui-Bo Ye

High dimensional data has introduced challenges that are difficult to address when attempting to implement classical approaches of statistical process control. This has made it a topic of interest for research due in recent years. However,…

Applications · Statistics 2019-04-23 Mohammad Nabhan , Yajun Mei , Jianjun Shi

Hyper-spectral data can be analyzed to recover physical properties at large planetary scales. This involves resolving inverse problems which can be addressed within machine learning, with the advantage that, once a relationship between…

Applications · Statistics 2015-12-31 Antoine Deleforge , Florence Forbes , Sileye Ba , Radu Horaud

In this article the package High-dimensional Metrics (\texttt{hdm}) is introduced. It is a collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on…

Methodology · Statistics 2017-09-28 Victor Chernozhukov , Chris Hansen , Martin Spindler