English
Related papers

Related papers: Multi-Resolution Functional ANOVA for Large-Scale,…

200 papers

We propose a new approach to the problem of high-dimensional multivariate ANOVA via bootstrapping max statistics that involve the differences of sample mean vectors. The proposed method proceeds via the construction of simultaneous…

Methodology · Statistics 2021-04-20 Zhenhua Lin , Miles E. Lopes , Hans-Georg Müller

Gaussian Graphical Models (GGMs) are widely used in high-dimensional data analysis to synthesize the interaction between variables. In many applications, such as genomics or image analysis, graphical models rely on sparsity and clustering…

Machine Learning · Statistics 2026-03-25 Do Edmond Sanou , Christophe Ambroise , Geneviève Robin

We propose a new modeling framework for highly-multivariate spatial processes that synthesizes ideas from recent multiscale and spectral approaches with graphical models. The basis graphical lasso writes a univariate Gaussian process as a…

Methodology · Statistics 2024-07-08 Mitchell Krock , William Kleiber , Dorit Hammerling , Stephen Becker

Debiasing group graphical lasso estimates enables statistical inference when multiple Gaussian graphical models share a common sparsity pattern. We analyze the estimation properties of group graphical lasso, establishing convergence rates…

Statistics Theory · Mathematics 2025-10-07 Sayan Ranjan Bhowal , Debashis Paul , Gopal K Basak , Samarjit Das

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

Computer models are used as a way to explore complex physical systems. Stationary Gaussian process emulators, with their accompanying uncertainty quantification, are popular surrogates for computer models. However, many computer models are…

Methodology · Statistics 2024-11-25 Faezeh Yazdi , Derek Bingham , Daniel Williamson

Functional ANOVA (FANOVA) is a widely used variance-based sensitivity analysis tool. However, studies on functional-output FANOVA remain relatively scarce, especially for black-box computer experiments, which often involve complex and…

Methodology · Statistics 2025-06-17 Yu Tan , Yongxiang Li , Xiaowu Dai , Kwok-Leung Tsui

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

Engineers widely use Gaussian process regression framework to construct surrogate models aimed to replace computationally expensive physical models while exploring design space. Thanks to Gaussian process properties we can use both samples…

Machine Learning · Statistics 2017-07-14 Evgeny Burnaev , Alexey Zaytsev

We develop tools to do valid post-selective inference for a family of model selection procedures, including choosing a model via cross-validated Lasso. The tools apply universally when the following random vectors are jointly asymptotically…

Methodology · Statistics 2018-02-13 Jelena Markovic , Lucy Xia , Jonathan Taylor

Due to their flexibility, Gaussian processes (GPs) have been widely used in nonparametric function estimation. A prior information about the underlying function is often available. For instance, the physical system (computer model output)…

Methodology · Statistics 2017-11-21 Hassan Maatouk

Multitask learning can be effective when features useful in one task are also useful for other tasks, and the group lasso is a standard method for selecting a common subset of features. In this paper, we are interested in a less restrictive…

Machine Learning · Computer Science 2013-11-25 Nikhil Rao , Christopher Cox , Robert Nowak , Timothy Rogers

This paper proposes a new class of real-time optimization schemes to overcome system-model mismatch of uncertain processes. This work's novelty lies in integrating derivative-free optimization schemes and multi-fidelity Gaussian processes…

Machine Learning · Computer Science 2021-11-11 Panagiotis Petsagkourakis , Benoit Chachuat , Ehecatl Antonio del Rio-Chanona

The state-of-the-art linked Gaussian process offers a way to build analytical emulators for systems of computer models. We generalize the closed form expressions for the linked Gaussian process under the squared exponential kernel to a…

Methodology · Statistics 2021-02-09 Deyu Ming , Serge Guillas

Gaussian process emulators of computationally expensive computer codes provide fast statistical approximations to model physical processes. The training of these surrogates depends on the set of design points chosen to run the simulator.…

Computation · Statistics 2016-08-16 A. Garbuno-Inigo , F. A. DiazDelaO , K. M. Zuev

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is…

Neural and Evolutionary Computing · Computer Science 2020-05-22 Xiaobiao Huang , Minghao Song , Zhe Zhang

In additive models with many nonparametric components, a number of regularized estimators have been proposed and proven to attain various error bounds under different combinations of sparsity and fixed smoothness conditions. Some of these…

Statistics Theory · Mathematics 2020-11-16 Yisha Yao , Cun-Hui Zhang

Gaussian processes are a powerful framework for uncertainty-aware function approximation and sequential decision-making. Unfortunately, their classical formulation does not scale gracefully to large amounts of data and modern hardware for…

Machine Learning · Computer Science 2025-07-10 Jihao Andreas Lin

Gaussian processes are a widely embraced technique for regression and classification due to their good prediction accuracy, analytical tractability and built-in capabilities for uncertainty quantification. However, they suffer from the…

Optimization and Control · Mathematics 2024-02-07 Mickael Binois , Victor Picheny

Multi-fidelity methods are prominently used when cheaply-obtained, but possibly biased and noisy, observations must be effectively combined with limited or expensive true data in order to construct reliable models. This arises in both…

Machine Learning · Statistics 2019-03-19 Kurt Cutajar , Mark Pullin , Andreas Damianou , Neil Lawrence , Javier González