English
Related papers

Related papers: Discoveries far from the Lamppost with Matrix Elem…

200 papers

A central goal in experimental high energy physics is to detect new physics signals that are not explained by known physics. In this paper, we aim to search for new signals that appear as deviations from known Standard Model physics in…

Applications · Statistics 2022-12-14 Purvasha Chakravarti , Mikael Kuusela , Jing Lei , Larry Wasserman

Rankings, especially those in search and recommendation systems, often determine how people access information and how information is exposed to people. Therefore, how to balance the relevance and fairness of information exposure is…

Information Retrieval · Computer Science 2021-02-22 Tao Yang , Qingyao Ai

We give the first algorithm for Matrix Completion whose running time and sample complexity is polynomial in the rank of the unknown target matrix, linear in the dimension of the matrix, and logarithmic in the condition number of the matrix.…

Machine Learning · Computer Science 2014-07-16 Moritz Hardt , Mary Wootters

The problem of having to reconstruct the decay rates and corresponding amplitudes of the single-exponential components of a noisy multi-exponential signal is common in many other areas of physics and engineering besides lattice field…

High Energy Physics - Lattice · Physics 2023-07-10 Georg M. von Hippel

Complex phenomena can be better understood when broken down into a limited number of simpler "components". Linear statistical methods such as the principal component analysis and its variants are widely used across various fields of applied…

Data Analysis, Statistics and Probability · Physics 2025-01-13 Iacopo Tirelli , Miguel Alfonso Mendez , Andrea Ianiro , Stefano Discetti

Presented here is a matrix inversion method utilizing quantum searching algorithm. In this method, huge Hilbert space as a whole spanned by myriad of eigen states is searched and evaluated efficiently by sequential reduction in dimension…

Quantum Physics · Physics 2007-05-23 Atsushi Miyauchi

Maximum Likelihood Estimation (MLE) is the bread and butter of system inference for stochastic systems. In some generality, MLE will converge to the correct model in the infinite data limit. In the context of physical approaches to system…

Machine Learning · Statistics 2020-03-11 Junghyo Jo , Danh-Tai Hoang , Vipul Periwal

An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but…

Information Retrieval · Computer Science 2023-02-21 Xiaojie Sun , Lulu Yu , Yiting Wang , Keping Bi , Jiafeng Guo

Imbalanced data sets containing much more background than signal instances are very common in particle physics, and will also be characteristic for the upcoming analyses of LHC data. Following up the work presented at ACAT 2008, we use the…

Data Analysis, Statistics and Probability · Physics 2011-08-11 Markward Britsch , Nikolai Gagunashvili , Michael Schmelling

We provide estimation methods for nonseparable panel models based on low-rank factor structure approximations. The factor structures are estimated by matrix-completion methods to deal with the computational challenges of principal component…

Econometrics · Economics 2021-03-05 Iván Fernández-Val , Hugo Freeman , Martin Weidner

A missing energy discovery is possible at the LHC with the first 100 pb-1 of understood data. We present a realistic strategy to rapidly narrow the list of candidate theories at, or close to, the moment of discovery. The strategy is based…

High Energy Physics - Phenomenology · Physics 2008-11-26 Jay Hubisz , Joseph Lykken , Maurizio Pierini , Maria Spiropulu

We consider the problem of reconstructing a signal from multi-layered (possibly) non-linear measurements. Using non-rigorous but standard methods from statistical physics we present the Multi-Layer Approximate Message Passing (ML-AMP)…

Information Theory · Computer Science 2020-01-22 Andre Manoel , Florent Krzakala , Marc Mézard , Lenka Zdeborová

This article describes posterior maximization for topic models, identifying computational and conceptual gains from inference under a non-standard parametrization. We then show that fitted parameters can be used as the basis for a novel…

Applications · Statistics 2011-12-30 Matthew A. Taddy

Probabilistic generative models provide a flexible and systematic framework for learning the underlying geometry of data. However, model selection in this setting is challenging, particularly when selecting for ill-defined qualities such as…

Machine Learning · Computer Science 2022-10-05 Chester Holtz , Gal Mishne , Alexander Cloninger

In this paper, we study the general problem of optimizing a convex function $F(L)$ over the set of $p \times p$ matrices, subject to rank constraints on $L$. However, existing first-order methods for solving such problems either are too…

Machine Learning · Statistics 2017-12-12 Mohammadreza Soltani , Chinmay Hegde

Matrix completion is often applied to data with entries missing not at random (MNAR). For example, consider a recommendation system where users tend to only reveal ratings for items they like. In this case, a matrix completion method that…

Machine Learning · Statistics 2019-10-30 Wei Ma , George H. Chen

We present a novel approach to identify potential dispersed signals of new physics in the slew of published LHC results. It employs a random walk algorithm to introduce sets of new particles, dubbed "proto-models", which are tested against…

High Energy Physics - Phenomenology · Physics 2021-05-20 Sabine Kraml , Andre Lessa , Wolfgang Waltenberger

This paper presents a simplified likelihood framework designed to facilitate the reuse, reinterpretation and combination of LHC experimental results. The framework is based on the same underlying structure as the widely used HistFactory…

High Energy Physics - Experiment · Physics 2023-05-18 Nicolas Berger

This paper studies inference in linear models with a high-dimensional parameter matrix that can be well-approximated by a ``spiked low-rank matrix.'' A spiked low-rank matrix has rank that grows slowly compared to its dimensions and nonzero…

Statistics Theory · Mathematics 2023-01-04 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu

The network data has attracted considerable attention in modern statistics. In research on complex network data, one key issue is finding its underlying connection structure given a network sample. The methods that have been proposed in…

Methodology · Statistics 2024-08-09 Kang Fu , Jianwei Hu , Seydou Keita