English
Related papers

Related papers: The Kernel Interaction Trick: Fast Bayesian Discov…

200 papers

Networks can describe the structure of a wide variety of complex systems by specifying which pairs of entities in the system are connected. While such pairwise representations are flexible, they are not necessarily appropriate when the…

Social and Information Networks · Computer Science 2022-01-17 Jean-Gabriel Young , Giovanni Petri , Tiago P. Peixoto

Empirical observation of high dimensional phenomena, such as the double descent behaviour, has attracted a lot of interest in understanding classical techniques such as kernel methods, and their implications to explain generalization…

Interest in multioutput kernel methods is increasing, whether under the guise of multitask learning, multisensor networks or structured output data. From the Gaussian process perspective a multioutput Mercer kernel is a covariance function…

Machine Learning · Statistics 2009-12-18 Mauricio A. Álvarez , David Luengo , Michalis K. Titsias , Neil D. Lawrence

To date, testing interactions in high dimensions has been a challenging task. Existing methods often have issues with sensitivity to modeling assumptions and heavily asymptotic nominal p-values. To help alleviate these issues, we propose a…

Machine Learning · Statistics 2012-06-29 Noah Simon , Robert Tibshirani

A novel approach of accurately reconstructing storage ring's linear optics from turn-by-turn (TbT) data containing measurement error is introduced. This approach adopts a Bayesian inference based on the Markov Chain Monte-Carlo (MCMC)…

Accelerator Physics · Physics 2019-07-01 Yue Hao , Yongjun Li , Michael Balcewicz , Leo Neufcourt , Weixing Cheng

While existing mathematical descriptions can accurately account for phenomena at microscopic scales (e.g. molecular dynamics), these are often high-dimensional, stochastic and their applicability over macroscopic time scales of physical…

Machine Learning · Statistics 2016-09-08 P. S. Koutsourelakis , Elias Bilionis

A daunting challenge faced by modern biological sciences is finding an efficient and computationally feasible approach to deal with the curse of high dimensionality. The problem becomes even more severe when the research focus is on…

Methodology · Statistics 2013-04-16 Hung Hung , Yu-Tin Lin , Pengwen Chen , Chen-Chien Wang , Su-Yun Huang , Jung-Ying Tzeng

Finding the model that best describes a high-dimensional dataset is a daunting task, even more so if one aims to consider all possible high-order patterns of the data, going beyond pairwise models. For binary data, we show that this task…

Artificial Intelligence · Computer Science 2024-08-28 Clélia de Mulatier , Matteo Marsili

A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small…

Methodology · Statistics 2013-09-24 Zuofeng Shang , Ping Li

Training and inference in Gaussian processes (GPs) require solving linear systems with $n\times n$ kernel matrices. To address the prohibitive $\mathcal{O}(n^3)$ time complexity, recent work has employed fast iterative methods, like…

Machine Learning · Computer Science 2024-03-12 Kaiwen Wu , Jonathan Wenger , Haydn Jones , Geoff Pleiss , Jacob R. Gardner

This paper presents a two-phase method for learning interaction kernels of stochastic many-particle systems. After transforming stochastic trajectories of every particle into the particle density function by the kernel density estimation…

Computational Physics · Physics 2025-01-03 Yangxuan Shi , Wuyue Yang , Liu Hong

Gaussian processes are powerful models for probabilistic machine learning, but are limited in application by their $O(N^3)$ inference complexity. We propose a method for deriving parametric families of kernel functions with compact spatial…

Machine Learning · Computer Science 2020-06-09 Jarred Barber

We establish a scalable manifold learning method and theory, motivated by the problem of estimating fMRI activation manifolds in the Human Connectome Project (HCP). Our primary contribution is the development of an efficient estimation…

Methodology · Statistics 2025-09-16 Junhui He , Guoxuan Ma , Jian Kang , Ying Yang

Identifying dynamical system (DS) is a vital task in science and engineering. Traditional methods require numerous calls to the DS solver, rendering likelihood-based or least-squares inference frameworks impractical. For efficient parameter…

Computation · Statistics 2024-09-19 Ying Zhou , Jinglai Li , Xiang Zhou , Hongqiao Wang

Rhythmic phenomena, which are ubiquitous in biological systems, are typically modelled as systems of coupled limit cycle oscillators. Recently, there has been an increased interest in understanding the impact of higher-order interactions on…

Chaotic Dynamics · Physics 2026-03-19 Weiwei Su , Shigefumi Hata , Hiroshi Kori , Hiroya Nakao , Ryota Kobayashi

Implicit stochastic models, where the data-generation distribution is intractable but sampling is possible, are ubiquitous in the natural sciences. The models typically have free parameters that need to be inferred from data collected in…

Machine Learning · Statistics 2020-08-17 Steven Kleinegesse , Michael U. Gutmann

Hierarchical data with multiple observations per group is ubiquitous in empirical sciences and is often analyzed using mixed-effects regression. In such models, Bayesian inference gives an estimate of uncertainty but is analytically…

Machine Learning · Computer Science 2026-02-05 Alex Kipnis , Marcel Binz , Eric Schulz

Conjoint experiments have become central to survey research in political science and related fields because they allow researchers to study preferences across multiple attributes simultaneously. Beyond estimating main effects, scholars…

Methodology · Statistics 2025-10-03 Steven Wang , Isys Johnson , Jessica Grogan , Lalit Jain , Atri Rudra , Kyle Hunt , Kenneth Joseph

Both experimental and computational methods for the exploration of structure, functionality, and properties of materials often necessitate the search across broad parameter spaces to discover optimal experimental conditions and regions of…

Computational Physics · Physics 2021-08-31 Maxim Ziatdinov , Ayana Ghosh , Sergei V. Kalinin

Sparsity has become a key concept for solving of high-dimensional inverse problems using variational regularization techniques. Recently, using similar sparsity-constraints in the Bayesian framework for inverse problems by encoding them in…

Numerical Analysis · Mathematics 2014-11-18 Felix Lucka