English
Related papers

Related papers: Reduced Rank Regression for Mixed Predictor and Re…

200 papers

Time series of counts occurring in various applications are often overdispersed, meaning their variance is much larger than the mean. This paper proposes a novel variable selection approach for processing such data. Our approach consists in…

Methodology · Statistics 2023-07-04 Marina Gomtsyan

Stacking regressions is an ensemble technique that forms linear combinations of different regression estimators to enhance predictive accuracy. The conventional approach uses cross-validation data to generate predictions from the…

Machine Learning · Statistics 2024-10-10 Xin Chen , Jason M. Klusowski , Yan Shuo Tan

We propose a versatile joint regression framework for count responses. The method is implemented in the R add-on package GJRM and allows for modelling linear and non-linear dependence through the use of several copulae. Moreover, the…

Applications · Statistics 2019-08-22 Hendrik van der Wurp , Andreas Groll , Thomas Kneib , Giampiero Marra , Rosalba Radice

Mixed Membership Models (MMMs) are a popular family of latent structure models for complex multivariate data. Instead of forcing each subject to belong to a single cluster, MMMs incorporate a vector of subject-specific weights…

Methodology · Statistics 2023-02-16 Yuqi Gu , Elena A. Erosheva , Gongjun Xu , David B. Dunson

In spatial statistics, a common method for prediction over a Gaussian random field (GRF) is maximum likelihood estimation combined with kriging. For massive data sets, kriging is computationally intensive, both in terms of CPU time and…

Methodology · Statistics 2018-09-28 Karl T. Pazdernik , Ranjan Maitra , Douglas Nychka , Stephen Sain

We introduce a method that uses low-rank approximations of cross-correlation matrices in mixed continuous and categorical Gaussian Process models. This new method -- called Low-Rank Correlation (LRC) -- offers the ability to flexibly adapt…

Machine Learning · Statistics 2020-10-07 Dominik Kirchhoff , Sonja Kuhnt

We consider a finite mixture of regressions (FMR) model for high-dimensional inhomogeneous data where the number of covariates may be much larger than sample size. We propose an l1-penalized maximum likelihood estimator in an appropriate…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann , Sara van de Geer

Mendelian randomization (MR) is a popular instrumental variable (IV) approach, in which one or several genetic markers serve as IVs that can sometimes be leveraged to recover valid inferences about a given exposure-outcome causal…

Methodology · Statistics 2021-08-10 Eric J. Tchetgen Tchetgen , BaoLuo Sun , Stefan Walter

Multi-modal distributions are commonly used to model clustered data in statistical learning tasks. In this paper, we consider the Mixed Linear Regression (MLR) problem. We propose an optimal transport-based framework for MLR problems,…

Machine Learning · Statistics 2021-06-17 Theo Diamandis , Yonina C. Eldar , Alireza Fallah , Farzan Farnia , Asuman Ozdaglar

Two different approaches to analysis of data from diagnostic biomarker studies are commonly employed. Logistic regression is used to fit models for probability of disease given marker values, while ROC curves and risk distributions are used…

Applications · Statistics 2013-12-02 Ying Huang , Margaret S. Pepe , Ziding Feng

This PhD Thesis presents an investigation into the analysis of financial returns using mixture models, focusing on mixtures of generalized normal distributions (MGND) and their extensions. The study addresses several critical issues…

Statistical Finance · Quantitative Finance 2024-11-20 Pierdomenico Duttilo

Generalization is one of the most important issues in machine learning problems. In this study, we consider generalization in restricted Boltzmann machines (RBMs). We propose an RBM with multivalued hidden variables, which is a simple…

Machine Learning · Statistics 2020-01-09 Yuuki Yokoyama , Tomu Katsumata , Muneki Yasuda

Hyper-parameter optimization remains as the core issue of Gaussian process (GP) for machine learning nowadays. The benchmark method using maximum likelihood (ML) estimation and gradient descent (GD) is impractical for processing big data…

Machine Learning · Statistics 2019-06-10 Linning Xu , Feng Yin , Jiawei Zhang , Zhi-Quan Luo , Shuguang Cui

Reranking is attracting incremental attention in the recommender systems, which rearranges the input ranking list into the final rank-ing list to better meet user demands. Most existing methods greedily rerank candidates through the rating…

Information Retrieval · Computer Science 2021-04-08 Yufei Feng , Binbin Hu , Yu Gong , Fei Sun , Qingwen Liu , Wenwu Ou

This paper investigates estimation and inference for average treatment effects in completely randomized experiments when researchers observe potentially many covariates. Within Neyman's (1923) design-based framework, allowing the number of…

Econometrics · Economics 2025-11-20 Harold D Chiang , Yukitoshi Matsushita , Taisuke Otsu

Due to the high variance of policy gradients, on-policy optimization algorithms are plagued with low sample efficiency. In this work, we propose Augment-Reinforce-Merge (ARM) policy gradient estimator as an unbiased low-variance alternative…

Machine Learning · Computer Science 2019-03-14 Yunhao Tang , Mingzhang Yin , Mingyuan Zhou

Optimization problems involving mixed variables (i.e., variables of numerical and categorical nature) can be challenging to solve, especially in the presence of mixed-variable constraints. Moreover, when the objective function is the result…

Optimization and Control · Mathematics 2024-12-12 Mengjia Zhu , Alberto Bemporad

Multiple randomization designs (MRDs) are a class of experimental designs used to handle interference in two-sided marketplaces. We investigate regression adjustment strategies for estimating total, spillover, and direct effects in MRDs. We…

Methodology · Statistics 2026-03-23 Timothy Sudijono , Lihua Lei , Lorenzo Masoero , Suhas Vijaykumar , Guido Imbens , James McQueen

Low-rank regularization (LRR) has been widely applied in various machine learning tasks, but the associated optimization is challenging. Directly optimizing the rank function under constraints is NP-hard in general. To overcome this…

Machine Learning · Computer Science 2025-05-22 Naiqi Li , Yuqiu Xie , Peiyuan Liu , Tao Dai , Yong Jiang , Shu-Tao Xia

ReParameterization (RP) Policy Gradient Methods (PGMs) have been widely adopted for continuous control tasks in robotics and computer graphics. However, recent studies have revealed that, when applied to long-term reinforcement learning…

Machine Learning · Computer Science 2023-11-01 Shenao Zhang , Boyi Liu , Zhaoran Wang , Tuo Zhao