English
Related papers

Related papers: Spectral Methods for Nonparametric Models

200 papers

Multi-dimensional Hawkes process (MHP) is a class of self and mutually exciting point processes that find wide range of applications -- from prediction of earthquakes to modelling of order books in high frequency trading. This paper makes…

Machine Learning · Statistics 2020-06-05 Sobin Joseph , Lekhapriya Dheeraj Kashyap , Shashi Jain

Spectral methods have greatly advanced the estimation of latent variable models, generating a sequence of novel and efficient algorithms with strong theoretical guarantees. However, current spectral algorithms are largely restricted to…

Machine Learning · Computer Science 2013-12-10 Le Song , Animashree Anandkumar , Bo Dai , Bo Xie

Recent advances in topic models have explored complicated structured distributions to represent topic correlation. For example, the pachinko allocation model (PAM) captures arbitrary, nested, and possibly sparse correlations between topics…

Information Retrieval · Computer Science 2012-06-26 Wei Li , David Blei , Andrew McCallum

Spike-and-slab and horseshoe regression are arguably the most popular Bayesian variable selection approaches for linear regression models. However, their performance can deteriorate if outliers and heteroskedasticity are present in the…

Methodology · Statistics 2022-10-20 Alberto Cabezas , Marco Battiston , Christopher Nemeth

This paper proposes a Hilbert space embedding for Dirichlet Process mixture models via a stick-breaking construction of Sethuraman. Although Bayesian nonparametrics offers a powerful approach to construct a prior that avoids the need to…

Machine Learning · Statistics 2012-10-17 Krikamol Muandet

We introduce the Poisson Hierarchical Indian Buffet Process (PHIBP), a new class of species sampling models designed to address the challenges of complex, sparse count data by facilitating information sharing across and within groups. Our…

Machine Learning · Statistics 2025-08-26 Lancelot F. James , Juho Lee , Abhinav Pandey

The spectral bundle method proposed by Helmberg and Rendl is well established for solving large-scale semidefinite programs (SDP) thanks to its low per iteration computational complexity and strong practical performance. In this paper, we…

Optimization and Control · Mathematics 2022-11-08 Lijun Ding , Benjamin Grimmer

Many high-dimensional data sets suffer from hidden confounding which affects both the predictors and the response of interest. In such situations, standard regression methods or algorithms lead to biased estimates. This paper substantially…

Methodology · Statistics 2024-12-17 Cyrill Scheidegger , Zijian Guo , Peter Bühlmann

Latent feature models are a powerful tool for modeling data with globally-shared features. Nonparametric exchangeable models such as the Indian Buffet Process offer modeling flexibility by letting the number of latent features be unbounded.…

Methodology · Statistics 2015-08-27 Finale Doshi-Velez , Sinead A. Williamson

Accurately predicting infrared (IR) spectra in computational chemistry using ab initio methods remains a challenge. Current approaches often rely on an empirical approach or on tedious anharmonic calculations, mainly adapted to semi-rigid…

Chemical Physics · Physics 2024-09-05 Saleh Abdul Al , Abdul-Rahman Allouche

Feature allocation models are popular models used in different applications such as unsupervised learning or network modeling. In particular, the Indian buffet process is a flexible and simple one-parameter feature allocation model where…

Machine Learning · Statistics 2020-03-31 Giuseppe Di Benedetto , François Caron , Yee Whye Teh

Time-varying mixture densities occur in many scenarios, for example, the distributions of keywords that appear in publications may evolve from year to year, video frame features associated with multiple targets may evolve in a sequence. Any…

Machine Learning · Statistics 2016-04-19 Cheng Luo , Yang Xiang , Richard Yi Da Xu

The Dirichlet process mixture (DPM) is a ubiquitous, flexible Bayesian nonparametric statistical model. However, full probabilistic inference in this model is analytically intractable, so that computationally intensive techniques such as…

Machine Learning · Statistics 2014-11-05 Yordan P. Raykov , Alexis Boukouvalas , Max A. Little

Deep generative models (DGMs) have brought about a major breakthrough, as well as renewed interest, in generative latent variable models. However, DGMs do not allow for performing data-driven inference of the number of latent features…

Machine Learning · Computer Science 2018-04-03 Sotirios P. Chatzis

Latent feature models are attractive for image modeling, since images generally contain multiple objects. However, many latent feature models ignore that objects can appear at different locations or require pre-segmentation of images. While…

Computer Vision and Pattern Recognition · Computer Science 2012-07-03 Ke Zhai , Yuening Hu , Sinead Williamson , Jordan Boyd-Graber

Latent feature models are widely used to decompose data into a small number of components. Bayesian nonparametric variants of these models, which use the Indian buffet process (IBP) as a prior over latent features, allow the number of…

Machine Learning · Statistics 2012-09-11 Samuel J. Gershman , Peter I. Frazier , David M. Blei

The spectral bundle method developed by Helmberg and Rendl is well-established for solving large-scale semidefinite programs (SDPs) in the dual form, especially when the SDPs admit $\textit{low-rank primal solutions}$. Under mild regularity…

Optimization and Control · Mathematics 2026-02-05 Feng-Yi Liao , Lijun Ding , Yang Zheng

The purpose of this work is to describe a unified, and indeed simple, mechanism for non-parametric Bayesian analysis, construction and generative sampling of a large class of latent feature models which one can describe as generalized…

Statistics Theory · Mathematics 2014-12-23 Lancelot F. James

Nonlinear spectral problems arise across a range of fields, including mechanical vibrations, fluid-solid interactions, and photonic crystals. Discretizing infinite-dimensional nonlinear spectral problems often introduces significant…

Numerical Analysis · Mathematics 2025-04-25 Matthew J. Colbrook , Catherine Drysdale

In this paper, we propose the unfitted spectral element method for solving elliptic interface and corresponding eigenvalue problems. The novelty of the proposed method lies in its combination of the spectral accuracy of the spectral element…

Numerical Analysis · Mathematics 2024-03-27 Nicolas Gonzalez , Hailong Guo , Xu Yang