Deep Distributional Learning with Non-crossing Quantile Network
Abstract
In this paper, we introduce a non-crossing quantile (NQ) network for conditional distribution learning. By leveraging non-negative activation functions, the NQ network ensures that the learned distributions remain monotonic, effectively addressing the issue of quantile crossing. Furthermore, the NQ network-based deep distributional learning framework is highly adaptable, applicable to a wide range of applications, from classical non-parametric quantile regression to more advanced tasks such as causal effect estimation and distributional reinforcement learning (RL). We also develop a comprehensive theoretical foundation for the deep NQ estimator and its application to distributional RL, providing an in-depth analysis that demonstrates its effectiveness across these domains. Our experimental results further highlight the robustness and versatility of the NQ network.
Cite
@article{arxiv.2504.08215,
title = {Deep Distributional Learning with Non-crossing Quantile Network},
author = {Guohao Shen and Runpeng Dai and Guojun Wu and Shikai Luo and Chengchun Shi and Hongtu Zhu},
journal= {arXiv preprint arXiv:2504.08215},
year = {2025}
}