English
Related papers

Related papers: Zero-Truncated Poisson Regression for Sparse Multi…

200 papers

Tensor completion refers to the task of estimating the missing data from an incomplete measurement or observation, which is a core problem frequently arising from the areas of big data analysis, computer vision, and network engineering. Due…

Machine Learning · Computer Science 2021-05-21 Chenjian Pan , Chen Ling , Hongjin He , Liqun Qi , Yanwei Xu

We consider high dimensional sparse regression, and develop strategies able to deal with arbitrary -- possibly, severe or coordinated -- errors in the covariance matrix $X$. These may come from corrupted data, persistent experimental…

Machine Learning · Statistics 2013-01-15 Yudong Chen , Constantine Caramanis , Shie Mannor

Corrupted data sets containing noisy or missing observations are prevalent in various contemporary applications such as economics, finance and bioinformatics. Despite the recent methodological and algorithmic advances in high-dimensional…

Methodology · Statistics 2020-05-12 J. Wu , Z. Zheng , Y. Li , Y. Zhang

In high-dimensional linear models, the sparsity assumption is typically made, stating that most of the parameters are equal to zero. Under the sparsity assumption, estimation and, recently, inference have been well studied. However, in…

Methodology · Statistics 2019-07-09 Yinchu Zhu , Jelena Bradic

In clinical and epidemiological research doubly truncated data often appear. This is the case, for instance, when the data registry is formed by interval sampling. Double truncation generally induces a sampling bias on the target variable,…

Methodology · Statistics 2023-01-11 Jacobo de Uña-Álvarez

In many applications such as medical imaging, the measurement data represent counts of photons hitting a detector. Such counts in low-photon settings are often modeled using a Poisson distribution. However, this model assumes that the mean…

Image and Video Processing · Electrical Eng. & Systems 2024-08-30 Yu Lu , Kevin Bui , Roummel F. Marcia

[ABRIDGED] The Cash statistic, also known as the C stat, is commonly used for the analysis of low-count Poisson data, including data with null counts for certain values of the independent variable. The use of this statistic is especially…

Methodology · Statistics 2020-09-18 Massimiliano Bonamente , David Spence

The finite sensitivity of instruments or detection methods means that data sets in many areas of astronomy, for example cosmological or exoplanet surveys, are necessarily systematically incomplete. Such data sets, where the population being…

Instrumentation and Methods for Astrophysics · Physics 2020-10-14 Adam B. Mantz

One aspect of Poisson approximation is that the support of the random variable of interest is often finite while the support of the Poisson distribution is not. In this paper we will remedy this by examining truncated negative binomial (of…

Probability · Mathematics 2017-05-02 H. L. Gan

Large-scale datasets with count outcome variables are widely present in various applications, and the Poisson regression model is among the most popular models for handling count outcomes. This paper considers the high-dimensional sparse…

Methodology · Statistics 2024-10-29 Prabrisha Rakshit , Zijian Guo

This paper proposes a sparse regression strategy for discovery of ordinary differential equations from incomplete and noisy data. Inference is performed over both equation parameters and state variables using a statistically motivated…

Dynamical Systems · Mathematics 2026-02-18 Teddy Meissner , Karl Glasner

Multiway data often naturally occurs in a tensorial format which can be approximately represented by a low-rank tensor decomposition. This is useful because complexity can be significantly reduced and the treatment of large-scale data sets…

Machine Learning · Computer Science 2021-08-10 Clara Menzen , Manon Kok , Kim Batselier

Computing partition functions, the normalizing constants of probability distributions, is often hard. Variants of importance sampling give unbiased estimates of a normalizer Z, however, unbiased estimates of the reciprocal 1/Z are harder to…

Machine Learning · Statistics 2017-03-14 Colin Wei , Iain Murray

This paper presents a strategy for analyzing zero-truncated recurrent events data. Motivated by a pediatric mental health care (PMHC) program, we are particularly concerned with how the event occurrence depends on the occurrences in the…

Methodology · Statistics 2025-08-01 Anqi A. Chen , X. Joan Hu , Rhonda J. Rosychuk , Leilei Zeng

Count data are ubiquitous in ecology and the Poisson generalized linear model (GLM) is commonly used to model the association between counts and explanatory variables of interest. When fitting this model to the data, one typically proceeds…

Methodology · Statistics 2020-07-14 Harlan Campbell

The success of the compressed sensing paradigm has shown that a substantial reduction in sampling and storage complexity can be achieved in certain linear and non-adaptive estimation problems. It is therefore an advisable strategy for…

Information Theory · Computer Science 2014-08-27 Peter Jung , Philipp Walk

In this paper, we present a method for factor analysis of discrete data. This is accomplished by fitting a dependent Poisson model with a factor structure. To be able to analyze ordinal data, we also consider a truncated Poisson…

Methodology · Statistics 2019-03-13 Rolf Larsson

Tensor completion is a core machine learning algorithm used in recommender systems and other domains with missing data. While the matrix case is well-understood, theoretical results for tensor problems are limited, particularly when the…

Machine Learning · Statistics 2023-06-13 Kameron Decker Harris , Oscar López , Angus Read , Yizhe Zhu

We propose a new approach for estimating the parameters of a probability distribution. It consists on combining two new methods of estimation. The first is based on the definition of a new distance measuring the difference between…

Methodology · Statistics 2008-12-30 Ahmed Guellil , Tewfik Kernane

Autoencoders are a prominent model in many empirical branches of machine learning and lossy data compression. However, basic theoretical questions remain unanswered even in a shallow two-layer setting. In particular, to what degree does a…

Machine Learning · Computer Science 2024-02-08 Kevin Kögler , Alexander Shevchenko , Hamed Hassani , Marco Mondelli