English
Related papers

Related papers: ppmlhdfe: Fast Poisson Estimation with High-Dimens…

200 papers

A novel estimation approach for a general class of semi-parametric multivariate time series models is introduced where the conditional mean is modeled through parametric functions. The focus of the estimation is the conditional mean…

Methodology · Statistics 2025-07-21 Mirko Armillotta

Partial Least Squares (PLS) regression emerged as an alternative to ordinary least squares for addressing multicollinearity in a wide range of scientific applications. As multidimensional tensor data is becoming more widespread, tensor…

Methodology · Statistics 2024-10-11 Kwangmoon Park , Sündüz Keleş

Consider estimation of average treatment effects with multi-valued treatments using augmented inverse probability weighted (IPW) estimators, depending on outcome regression and propensity score models in high-dimensional settings. These…

Methodology · Statistics 2022-01-25 Wenfu Xu , Zhiqiang Tan

Reinforcement Learning from Human Feedback (RLHF) is key to aligning Large Language Models (LLMs), typically paired with the Proximal Policy Optimization (PPO) algorithm. While PPO is a powerful method designed for general reinforcement…

Machine Learning · Computer Science 2024-05-17 Ziniu Li , Tian Xu , Yushun Zhang , Zhihang Lin , Yang Yu , Ruoyu Sun , Zhi-Quan Luo

The deep-learning-based least squares method has shown successful results in solving high-dimensional non-linear partial differential equations (PDEs). However, this method usually converges slowly. To speed up the convergence of this…

Numerical Analysis · Mathematics 2025-07-10 Wenhan Gao , Chunmei Wang

Various probabilistic time series forecasting models have sprung up and shown remarkably good performance. However, the choice of model highly relies on the characteristics of the input time series and the fixed distribution that the model…

Machine Learning · Computer Science 2023-09-01 Yunyi Zhou , Zhixuan Chu , Yijia Ruan , Ge Jin , Yuchen Huang , Sheng Li

Popular Hough Transform-based object detection approaches usually construct an appearance codebook by clustering local image features. However, how to choose appropriate values for the parameters used in the clustering step remains an open…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Jianyu Tang , Hanzi Wang , Yan Yan

Recent advances in causal inference have seen the development of methods which make use of the predictive power of machine learning algorithms. In this paper, we develop novel double machine learning (DML) procedures for panel data in which…

Econometrics · Economics 2025-01-03 Paul S. Clarke , Annalivia Polselli

Parameter-Efficient Fine-Tuning (PEFT) methods have gained significant popularity for adapting pre-trained Large Language Models (LLMs) to downstream tasks, primarily due to their potential to significantly reduce memory and computational…

Computation and Language · Computer Science 2024-11-06 Kai Yao , Penglei Gao , Lichun Li , Yuan Zhao , Xiaofeng Wang , Wei Wang , Jianke Zhu

Christoffel polynomials are classical tools from approximation theory. They can be used to estimate the (compact) support of a measure $\mu$ on $\mathbb{R}^d$ based on its low-degree moments. Recently, they have been applied to problems in…

Statistics Theory · Mathematics 2026-04-21 Jean-Bernard Lasserre , Lucas Slot

This paper introduces a novel framework for estimation and inference in penalized M-estimators applied to robust high-dimensional linear regression models. Traditional methods for high-dimensional statistical inference, which predominantly…

Methodology · Statistics 2025-04-15 Dian Zheng , Lingzhou Xue

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

This paper presents a communication efficient distributed algorithm, $\mathcal{CIRFE}$ of the \emph{consensus}+\emph{innovations} type, to estimate a high-dimensional parameter in a multi-agent network, in which each agent is interested in…

Optimization and Control · Mathematics 2018-10-17 Anit Kumar Sahu , Dusan Jakovetic , Soummya Kar

Identification of heterogeneous treatment effects (HTEs) has been increasingly popular and critical in various penalized strategy decisions using the A/B testing approach, especially in the scenario of a consecutive online collection of…

Methodology · Statistics 2024-09-25 Zhiqing Fang , Shuyan Chen , Xin Liu

Bayesian highest posterior density (HPD) intervals can be estimated directly from simulations via empirical shortest intervals. Unfortunately, these can be noisy (that is, have a high Monte Carlo error). We derive an optimal weighting…

Computation · Statistics 2013-02-11 Ying Liu , Andrew Gelman , Tian Zheng

Persistent Homology (PH) allows tracking homology features like loops, holes and their higher-dimensional analogs, along with a single-parameter family of nested spaces. Currently, computing descriptors for complex data characterized by…

Computational Geometry · Computer Science 2020-10-19 Sara Scaramuccia , Federico Iuricich , Leila De Floriani , Claudia Landi

Purpose: To introduce a fast and improved direct reconstruction method for multi-shot diffusion weighted (msDW) scans for high-resolution studies. Methods:Multi-shot EPI methods can enable higher spatial resolution for diffusion MRI…

Medical Physics · Physics 2019-06-26 Merry Mani , Hemant Kumar Aggarwal , Vincent Magnotta , Mathews Jacob

In practice, there often exist unobserved variables, also termed hidden variables, associated with both the response and covariates. Existing works in the literature mostly focus on linear regression with hidden variables. However, when the…

Methodology · Statistics 2025-09-03 Inbeom Lee , Yang Ning

Discrete Hahn polynomials (DHPs) and their moments are considered to be one of the efficient orthogonal moments and they are applied in various scientific areas such as image processing and feature extraction. Commonly, DHPs are used as…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Basheera M. Mahmmod , Sadiq H. Abdulhussain , Tomáš Suk , Abir Hussain

In this paper, we focus on distributed estimation and support recovery for high-dimensional linear quantile regression. Quantile regression is a popular alternative tool to the least squares regression for robustness against outliers and…

Machine Learning · Statistics 2024-06-04 Caixing Wang , Ziliang Shen