English
Related papers

Related papers: Partial advantage estimator for proximal policy op…

200 papers

Prediction of a vector of ordered parameters or part of it arises naturally in the context of Small Area Estimation (SAE). For example, one may want to estimate the parameters associated with the top ten areas, the best or worst area, or a…

Methodology · Statistics 2012-10-30 Yaakov Malinovsky , Yosef Rinott

Latent reasoning offers a more efficient alternative to explicit reasoning by compressing intermediate reasoning into continuous representations and substantially shortening reasoning chains. However, existing latent reasoning methods…

Machine Learning · Computer Science 2026-05-01 Jingcheng Deng , Zihao Wei , Liang Pang , Junhong Wu , Shicheng Xu , Zenghao Duan , Huawei Shen

A procedure for asymptotic bias reduction of maximum likelihood estimates of generic estimands is developed. The estimator is realized as a plug-in estimator, where the parameter maximizes the penalized likelihood with a penalty function…

Statistics Theory · Mathematics 2024-03-26 Masayo Y. Hirose , Shuhei Mano

We study the problem of estimating E(g(X)), where g is a real-valued function of d variables and X is a d-dimensional Gaussian vector with a given covariance matrix. We present a new unbiased estimator for E(g(X)) that combines the…

Statistics Theory · Mathematics 2023-04-18 Nabil Kahale

Reinforcement Learning (RL) in partially observable environments poses significant challenges due to the complexity of learning under uncertainty. While additional information, such as that available in simulations, can enhance training,…

Machine Learning · Computer Science 2026-03-16 Yueheng Li , Guangming Xie , Zongqing Lu

This paper investigates the application of probabilistic prediction methodologies in route planning within a road network context. Specifically, we introduce the Conformalized Quantile Regression for Graph Autoencoders (CQR-GAE), which…

Machine Learning · Computer Science 2025-03-14 Lingxuan Tang , Rui Luo , Zhixin Zhou , Nicolo Colombo

Variational Autoencoder (VAE)-based generative models offer flexible representation learning by incorporating meta-priors, general premises considered beneficial for downstream tasks. However, the incorporated meta-priors often involve…

Machine Learning · Computer Science 2023-02-27 Nao Nakagawa , Ren Togo , Takahiro Ogawa , Miki Haseyama

We develop flexible, semiparametric estimators of the average treatment effect (ATE) transported to a new population ("target population") that offer potential efficiency gains. Transport may be of value when the ATE may differ across…

Methodology · Statistics 2024-06-07 Kara E. Rudolph , Nicholas T. Williams , Elizabeth A. Stuart , Ivan Diaz

While backpropagation--reverse-mode automatic differentiation--has been extraordinarily successful in deep learning, it requires two passes (forward and backward) through the neural network and the storage of intermediate activations.…

Machine Learning · Computer Science 2025-11-06 Daniel Wang , Evan Markou , Dylan Campbell

Truncated conditional expectation functions are objects of interest in a wide range of economic applications, including income inequality measurement, financial risk management, and impact evaluation. They typically involve truncating the…

Econometrics · Economics 2021-09-14 Tomasz Olma

We introduce a novel policy learning method that integrates analytical gradients from differentiable environments with the Proximal Policy Optimization (PPO) algorithm. To incorporate analytical gradients into the PPO framework, we…

Machine Learning · Computer Science 2023-12-15 Sanghyun Son , Laura Yu Zheng , Ryan Sullivan , Yi-Ling Qiao , Ming C. Lin

Generalised regression estimation allows one to make use of available auxiliary information in survey sampling. We develop three types of generalised regression estimator when the auxiliary data cannot be matched perfectly to the sample…

Methodology · Statistics 2020-05-20 Li-Chun Zhang

Stochastic variance-reduced gradient (SVRG) is an optimization method originally designed for tackling machine learning problems with a finite sum structure. SVRG was later shown to work for policy evaluation, a problem in reinforcement…

Machine Learning · Computer Science 2020-06-22 Zilun Peng , Ahmed Touati , Pascal Vincent , Doina Precup

Grammatical Evolution (GE) is one of the most popular Genetic Programming (GP) variants, and it has been used with success in several problem domains. Since the original proposal, many enhancements have been proposed to GE in order to…

Neural and Evolutionary Computing · Computer Science 2021-03-16 Jessica Mégane , Nuno Lourenço , Penousal Machado

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

This paper introduces a new biased estimator for the negative binomial regression model that is a generalization of Liu-type estimator proposed for the linear model in [12]. Since the variance of the maximum likelihood estimator (MLE) is…

Methodology · Statistics 2016-04-11 Yasin Asar

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

Methodology · Statistics 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

Accurate value estimates are important for off-policy reinforcement learning. Algorithms based on temporal difference learning typically are prone to an over- or underestimation bias building up over time. In this paper, we propose a…

Machine Learning · Computer Science 2022-10-24 Nicolai Dorka , Tim Welschehold , Joschka Boedecker , Wolfram Burgard

This paper introduces a new version of the smoothly trimmed mean with a more general version of weights, which can be used as an alternative to the classical trimmed mean. We derive its asymptotic variance and to further investigate its…

Statistics Theory · Mathematics 2024-09-10 Elina Kresse , Emils Silins , Janis Valeinis

We use Bayesian model selection paradigms, such as group least absolute shrinkage and selection operator priors, to facilitate generalized additive model selection. Our approach allows for the effects of continuous predictors to be…

Methodology · Statistics 2023-09-29 Virginia X. He , Matt P. Wand