English
Related papers

Related papers: Discovering Active Subspaces for High-Dimensional …

200 papers

High-dimensional time series datasets are becoming increasingly common in many areas of biological and social sciences. Some important applications include gene regulatory network reconstruction using time course gene expression data, brain…

Methodology · Statistics 2021-08-02 Sumanta Basu , David S. Matteson

Ridge functions have recently emerged as a powerful set of ideas for subspace-based dimension reduction. In this paper we begin by drawing parallels between ridge subspaces, sufficient dimension reduction and active subspaces, contrasting…

Methodology · Statistics 2019-01-04 Pranay Seshadri , Shaowu Yuchi , Geoffrey T. Parks

We present a novel method that integrates subspace modeling with an adaptive generative image prior for high-dimensional MR image reconstruction. The subspace model imposes an explicit low-dimensional representation of the high-dimensional…

Image and Video Processing · Electrical Eng. & Systems 2023-06-19 Ruiyang Zhao , Xi Peng , Varun A. Kelkar , Mark A. Anastasio , Fan Lam

In many inference problems, the evaluation of complex and costly models is often required. In this context, Bayesian methods have become very popular in several fields over the last years, in order to obtain parameter inversion, model…

Computational Engineering, Finance, and Science · Computer Science 2021-07-21 Luca Martino , Víctor Elvira , Javier López-Santiago , Gustau Camps-Valls

High-dimensional linear regression model is the most popular statistical model for high-dimensional data, but it is quite a challenging task to achieve a sparse set of regression coefficients. In this paper, we propose a simple heuristic…

Machine Learning · Computer Science 2022-11-29 Xue Yu , Yifan Sun , Haijun Zhou

Driven by increased complexity of dynamical systems, the solution of system of differential equations through numerical simulation in optimization problems has become computationally expensive. This paper provides a smart data driven…

Optimization and Control · Mathematics 2021-08-25 Kainat Khowaja , Mykhaylo Shcherbatyy , Wolfgang Karl Härdle

Bayesian inference for neural networks, or Bayesian deep learning, has the potential to provide well-calibrated predictions with quantified uncertainty and robustness. However, the main hurdle for Bayesian deep learning is its computational…

Machine Learning · Statistics 2023-09-07 Sanket Jantre , Nathan M. Urban , Xiaoning Qian , Byung-Jun Yoon

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of…

Machine Learning · Statistics 2021-09-24 Zheng Zhao , Muhammad Emzir , Simo Särkkä

Continuous-time trajectory representations are a powerful tool that can be used to address several issues in many practical simultaneous localization and mapping (SLAM) scenarios, like continuously collected measurements distorted by robot…

Robotics · Computer Science 2017-05-18 Jing Dong , Byron Boots , Frank Dellaert

Recently, there has been a growing interest in mixed-categorical metamodels based on Gaussian Process (GP) for Bayesian optimization. In this context, different approaches can be used to build the mixed-categorical GP. Many of these…

Optimization and Control · Mathematics 2024-05-14 Paul Saves , Youssef Diouane , Nathalie Bartoli , Thierry Lefebvre , Joseph Morlier

Nonstationary Gaussian processes (GPs) are essential for modeling complex, locally heterogeneous spatial data. A common modeling approach is the spatial deformation method that warps the domain to recover isotropy. However, this static…

Machine Learning · Computer Science 2026-05-01 Minghao Gu , Weizhi Lin , Qiang Huang

We present new large-scale algorithms for fitting a subgradient regularized multivariate convex regression function to $n$ samples in $d$ dimensions -- a key problem in shape constrained nonparametric regression with applications in…

Optimization and Control · Mathematics 2023-12-06 Wenyu Chen , Rahul Mazumder

Bayesian optimization (BO) is a powerful paradigm for efficient optimization of black-box objective functions. High-dimensional BO presents a particular challenge, in part because the curse of dimensionality makes it difficult to define --…

Machine Learning · Computer Science 2021-06-11 David Eriksson , Martin Jankowiak

Recent advances in data collection technologies have led to the emergence of massive spatial datasets, with measurements obtained at millions of spatial locations. Geostatistical models typically employ Gaussian processes (GPs) to capture…

Methodology · Statistics 2026-05-18 Nicholas Rios , Ben Seiyon Lee

We investigate the ability to reconstruct and derive spatial structure from sparsely sampled 3D piezoresponse force microcopy data, captured using the band-excitation (BE) technique, via Gaussian Process (GP) methods. Even for weakly…

Scalable surrogate models enable efficient emulation of computer models (or simulators), particularly when dealing with large ensembles of runs. While Gaussian process (GP) models are commonly employed for emulation, they face limitations…

Methodology · Statistics 2025-10-07 Grant Hutchings , Derek Bingham , Kellin Rumsey , Earl Lawrence

Inference for spatial generalized linear mixed models (SGLMMs) for high-dimensional non-Gaussian spatial data is computationally intensive. The computational challenge is due to the high-dimensional random effects and because Markov chain…

Computation · Statistics 2018-10-09 Yawen Guan , Murali Haran

Many real-world situations allow for the acquisition of additional relevant information when making an assessment with limited or uncertain data. However, traditional ML approaches either require all features to be acquired beforehand or…

Machine Learning · Computer Science 2021-02-12 Yang Li , Junier B. Oliva

Importance sampling (IS) is a powerful Monte Carlo methodology for the approximation of intractable integrals, very often involving a target probability density function. The performance of IS heavily depends on the appropriate selection of…

Computation · Statistics 2023-06-22 Víctor Elvira , Emilie Chouzenoux , Ömer Deniz Akyildiz , Luca Martino

In many real-world applications data exhibits non-stationarity, i.e., its distribution changes over time. One approach to handling non-stationarity is to remove or minimize it before attempting to analyze the data. In the context of brain…

Machine Learning · Computer Science 2016-05-26 Inbal Horev , Florian Yger , Masashi Sugiyama