English
Related papers

Related papers: A flexible class of priors for orthonormal matrice…

200 papers

We introduce linear regression using physics-based basis functions optimized through the geometry of an inner product space. This method addresses the challenge of surrogate modeling with high-dimensional input, as the physics-based basis…

Data Analysis, Statistics and Probability · Physics 2024-11-26 Ziqi Wang

We develop singular value shrinkage priors for the mean matrix parameters in the matrix-variate normal model with known covariance matrices. Our priors are superharmonic and put more weight on matrices with smaller singular values. They are…

Statistics Theory · Mathematics 2021-04-05 Takeru Matsuda , Fumiyasu Komaki

The aim of this paper is to model an ordinal response variable in terms of vector-valued functional data included on a vector-valued RKHS. In particular, we focus on the vector-valued RKHS obtained when a geometrical object (body) is…

Applications · Statistics 2018-07-13 Sonia Barahona , Pablo Centella , Ximo Gual-Arnau , Maria Victoria Ibáñez , Amelia Simó

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

Methodology · Statistics 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

Parameter-dependent models arise in many contexts such as uncertainty quantification, sensitivity analysis, inverse problems or optimization. Parametric or uncertainty analyses usually require the evaluation of an output of a model for many…

Numerical Analysis · Mathematics 2018-10-22 Anthony Nouy

Hierarchical beta process has found interesting applications in recent years. In this paper we present a modified hierarchical beta process prior with applications to hierarchical modeling of multiple data sources. The novel use of the…

Machine Learning · Computer Science 2012-10-19 Sunil Kumar Gupta , Dinh Q. Phung , Svetha Venkatesh

Adapting pre-trained foundation models for various downstream tasks has been prevalent in artificial intelligence. Due to the vast number of tasks and high costs, adjusting all parameters becomes unfeasible. To mitigate this, several…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Chongjie Si , Xuehui Wang , Xue Yang , Zhengqin Xu , Qingyun Li , Jifeng Dai , Yu Qiao , Xiaokang Yang , Wei Shen

In Bayesian statistics, the choice of prior distribution is often debatable, especially if prior knowledge is limited or data are scarce. In imprecise probability, sets of priors are used to accurately model and reflect prior knowledge.…

Methodology · Statistics 2016-10-25 Gero Walter , Frank P. A. Coolen

Multi-group covariance estimation for matrix-variate data with small within group sample sizes is a key part of many data analysis tasks in modern applications. To obtain accurate group-specific covariance estimates, shrinkage estimation…

Methodology · Statistics 2024-03-08 Elizabeth Bersson , Peter D. Hoff

We propose a novel approach to estimating the precision matrix of multivariate Gaussian data that relies on decomposing them into a low-rank and a diagonal component. Such decompositions are very popular for modeling large covariance…

Methodology · Statistics 2022-08-18 Noirrit Kiran Chandra , Peter Mueller , Abhra Sarkar

In this paper we consider an orthonormal basis, generated by a tensor product of Fourier basis functions, half period cosine basis functions, and the Chebyshev basis functions. We deal with the approximation problem in high dimensions…

Numerical Analysis · Mathematics 2024-04-26 Daniel Potts , Pascal Schröter

Functional data analysis, which models data as realizations of random functions over a continuum, has emerged as a useful tool for time series data. Often, the goal is to infer the dynamic connections (or time-varying conditional…

Methodology · Statistics 2024-12-10 Chunshan Liu , Daniel R. Kowal , James Doss-Gollin , Marina Vannucci

Many modern datasets, from areas such as neuroimaging and geostatistics, come in the form of a random sample of tensor-valued data which can be understood as noisy observations of a smooth multidimensional random function. Most of the…

Methodology · Statistics 2023-09-18 William Consagra , Arun Venkataraman , Xing Qiu

We propose a Bayesian approach using improper priors for hierarchical linear mixed models with flexible random effects and residual error distributions. The error distribution is modelled using scale mixtures of normals, which can capture…

Methodology · Statistics 2018-02-06 F. J. Rubio , M. F. J. Steel

Recently, there has been significant progress in understanding the convergence and generalization properties of gradient-based methods for training overparameterized learning models. However, many aspects including the role of small random…

Machine Learning · Computer Science 2023-07-04 Mahdi Soltanolkotabi , Dominik Stöger , Changzhi Xie

Considering the context of functional data analysis, we developed and applied a new Bayesian approach via Gibbs sampler to select basis functions for a finite representation of functional data. The proposed methodology uses Bernoulli latent…

Methodology · Statistics 2023-02-13 Pedro Henrique T. O. Sousa , Camila P. E. de Souza , Ronaldo Dias

We consider the problem of minimizing an objective function that depends on an orthonormal matrix. This situation is encountered when looking for common principal components, for example, and the Flury method is a popular approach. However,…

Computation · Statistics 2017-10-09 Ryan P. Browne , Paul D. McNicholas

We study private matrix analysis in the sliding window model where only the last $W$ updates to matrices are considered useful for analysis. We give first efficient $o(W)$ space differentially private algorithms for spectral approximation,…

Machine Learning · Computer Science 2020-09-08 Jalaj Upadhyay , Sarvagya Upadhyay

Bayesian inference provides a principled probabilistic framework for quantifying uncertainty by updating beliefs based on prior knowledge and observed data through Bayes' theorem. In Bayesian deep learning, neural network weights are…

Machine Learning · Computer Science 2024-10-22 Yijie Zhang

Ensemble weather predictions require statistical post-processing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters…

Machine Learning · Statistics 2019-04-01 Stephan Rasp , Sebastian Lerch