English
Related papers

Related papers: Conditional Density Estimation with Dimensionality…

200 papers

We develop Bayesian models for density regression with emphasis on discrete outcomes. The problem of density regression is approached by considering methods for multivariate density estimation of mixed scale variables, and obtaining…

Methodology · Statistics 2019-08-14 Georgios Papageorgiou

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

Machine Learning · Statistics 2026-05-08 Yu Wang , Arnab Ganguly

Regression discontinuity design (RDD) is widely adopted for causal inference under intervention determined by a continuous variable. While one is interested in treatment effect heterogeneity by subgroups in many applications, RDD typically…

Methodology · Statistics 2024-11-11 Shonosuke Sugasawa , Takuya Ishihara , Daisuke Kurisu

Conditional multidimensional scaling seeks for a low-dimensional configuration from pairwise dissimilarities, in the presence of other known features. By taking advantage of available data of the known features, conditional multidimensional…

Machine Learning · Statistics 2025-09-23 Anh Tuan Bui

Learning data representations under uncertainty is an important task that emerges in numerous scientific computing and data analysis applications. However, uncertainty quantification techniques are computationally intensive and become…

Machine Learning · Computer Science 2025-08-06 Paz Fink Shustin , Shashanka Ubaru , Małgorzata J. Zimoń , Songtao Lu , Vasileios Kalantzis , Lior Horesh , Haim Avron

In this paper, we focus on distributed estimation and support recovery for high-dimensional linear quantile regression. Quantile regression is a popular alternative tool to the least squares regression for robustness against outliers and…

Machine Learning · Statistics 2024-06-04 Caixing Wang , Ziliang Shen

Challenges with data in the big-data era include (i) the dimension $p$ is often larger than the sample size $n$ (ii) outliers or contaminated points are frequently hidden and more difficult to detect. Challenge (i) renders most conventional…

Machine Learning · Statistics 2023-09-06 Yijun Zuo

Regression problems are traditionally analyzed via univariate characteristics like the regression function, scale function and marginal density of regression errors. These characteristics are useful and informative whenever the association…

Statistics Theory · Mathematics 2008-12-18 Sam Efromovich

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

Many regularization schemes for high-dimensional regression have been put forward. Most require the choice of a tuning parameter, using model selection criteria or cross-validation schemes. We show that a simple non-negative or…

Methodology · Statistics 2012-02-07 Nicolai Meinshausen

A prominent family of methods for learning data distributions relies on density ratio estimation (DRE), where a model is trained to $\textit{classify}$ between data samples and samples from some reference distribution. DRE-based models can…

Machine Learning · Computer Science 2024-11-01 Shahar Yadin , Noam Elata , Tomer Michaeli

This paper considers the problem of detecting a high dimensional signal (not necessarily sparse) based on compressed measurements with physical layer secrecy guarantees. First, we propose a collaborative compressive detection (CCD)…

Applications · Statistics 2015-02-19 Bhavya Kailkhura , Thakshila Wimalajeewa , Pramod K. Varshney

As a crucial component of most modern deep recommender systems, feature embedding maps high-dimensional sparse user/item features into low-dimensional dense embeddings. However, these embeddings are usually assigned a unified dimension,…

Information Retrieval · Computer Science 2022-04-18 Liang Qu , Yonghong Ye , Ningzhi Tang , Lixin Zhang , Yuhui Shi , Hongzhi Yin

We study constrained reinforcement learning (CRL) from a novel perspective by setting constraints directly on state density functions, rather than the value functions considered by previous works. State density has a clear physical and…

Machine Learning · Computer Science 2021-06-25 Zengyi Qin , Yuxiao Chen , Chuchu Fan

In order to identify important variables that are involved in making optimal treatment decision, Lu et al. (2013) proposed a penalized least squared regression framework for a fixed number of predictors, which is robust against the…

Machine Learning · Statistics 2015-10-16 Chengchun Shi , Rui Song , Wenbin Lu

The purpose of this thesis is to develop new theories on high-dimensional structured signal recovery under a rather weak assumption on the measurements that only a finite number of moments exists. High-dimensional recovery has been one of…

Statistics Theory · Mathematics 2020-03-06 Xiaohan Wei

Compared to the conditional mean as a simple point estimator, the conditional density function is more informative to describe the distributions with multi-modality, asymmetry or heteroskedasticity. In this paper, we propose a novel…

Methodology · Statistics 2020-10-22 Yiping Guo , Howard D. Bondell

Many statistical estimators for high-dimensional linear regression are M-estimators, formed through minimizing a data-dependent square loss function plus a regularizer. This work considers a new class of estimators implicitly defined…

Statistics Theory · Mathematics 2022-02-15 Peng Zhao , Yun Yang , Qiao-Chu He

Dimension reduction is an important tool for analyzing high-dimensional data. The predictor envelope is a method of dimension reduction for regression that assumes certain linear combinations of the predictors are immaterial to the…

Methodology · Statistics 2022-01-07 Paul May , Hossein Moradi Rekabdarkolaee

Most conventional Reinforcement Learning (RL) algorithms aim to optimize decision-making rules in terms of the expected returns. However, especially for risk management purposes, other risk-sensitive criteria such as the value-at-risk or…

Machine Learning · Computer Science 2012-03-19 Tetsuro Morimura , Masashi Sugiyama , Hisashi Kashima , Hirotaka Hachiya , Toshiyuki Tanaka