English
Related papers

Related papers: Neural Generative Distributional Regression

200 papers

Being able to generate constrained samples is one of the most appealing applications of the deep generators. Conditional generators are one of the successful implementations of such models wherein the created samples are constrained to a…

Image and Video Processing · Electrical Eng. & Systems 2018-05-29 Shabab Bazrafkan , Peter Corcoran

Conditional generative models represent a significant advancement in the field of machine learning, allowing for the controlled synthesis of data by incorporating additional information into the generation process. In this work we introduce…

Machine Learning · Statistics 2024-09-27 Hanwen Huang

We propose the orthogonal random forest, an algorithm that combines Neyman-orthogonality to reduce sensitivity with respect to estimation error of nuisance parameters with generalized random forests (Athey et al., 2017)--a flexible…

Machine Learning · Computer Science 2019-09-27 Miruna Oprescu , Vasilis Syrgkanis , Zhiwei Steven Wu

We consider the problem of estimating the parameters of a $d$-dimensional rectified Gaussian distribution from i.i.d. samples. A rectified Gaussian distribution is defined by passing a standard Gaussian distribution through a one-layer ReLU…

Machine Learning · Computer Science 2019-09-20 Shanshan Wu , Alexandros G. Dimakis , Sujay Sanghavi

Consider a positive random variable of interest Y depending on a covariate X, and a random observation time T independent of Y given X. Assume that the only knowledge available about Y is its current status at time T: \delta = 1_{Y \leq T}.…

Statistics Theory · Mathematics 2013-04-11 Sandra Plancade

We consider discrete-time distributed averaging algorithms over multi-agent networks with measurement noises and time-varying random graph flows. Each agent updates its state by relative states between neighbours with both additive and…

Social and Information Networks · Computer Science 2017-02-14 Tao Li , Jiexiang Wang

Score function estimation is the cornerstone of both training and sampling from diffusion generative models. Despite this fact, the most commonly used estimators are either biased neural network approximations or high variance Monte Carlo…

Recent work has shown that Transformers can perform in-context learning for linear regression under restrictive assumptions, including i.i.d. data, Gaussian noise, and Gaussian regression coefficients. However, real-world data often violate…

Machine Learning · Computer Science 2026-03-20 Hoang T. H. Cao , Hai D. V. Trinh , Tho Quan , Lan V. Truong

In an indirect Gaussian sequence space model lower and upper bounds are derived for the concentration rate of the posterior distribution of the parameter of interest shrinking to the parameter value $\theta^\circ$ that generates the data.…

Statistics Theory · Mathematics 2015-02-03 Jan Johannes , Anna Simoni , Rudolf Schenk

This paper proposes an adaptive neural-compilation framework to address the problem of efficient program learning. Traditional code optimisation strategies used in compilers are based on applying pre-specified set of transformations that…

Artificial Intelligence · Computer Science 2016-05-27 Rudy Bunel , Alban Desmaison , Pushmeet Kohli , Philip H. S. Torr , M. Pawan Kumar

Several dihedral angles prediction methods were developed for protein structure prediction and their other applications. However, distribution of predicted angles would not be similar to that of real angles. To address this we employed…

Biomolecules · Quantitative Biology 2018-03-30 Hyeongki Kim

In this paper, we aim at establishing an approximation theory and a learning theory of distribution regression via a fully connected neural network (FNN). In contrast to the classical regression methods, the input variables of distribution…

Machine Learning · Statistics 2023-07-10 Zhongjie Shi , Zhan Yu , Ding-Xuan Zhou

Graph generation has emerged as a crucial task in machine learning, with significant challenges in generating graphs that accurately reflect specific properties. Existing methods often fall short in efficiently addressing this need as they…

Linear regression is a fundamental and popular statistical method. There are various kinds of linear regression, such as mean regression and quantile regression. In this paper, we propose a new one called distribution regression, which…

Methodology · Statistics 2017-12-27 Xin Chen , Xuejun Ma , Wang Zhou

We present a global optimizer, based on a conditional generative neural network, which can output ensembles of highly efficient topology-optimized metasurfaces operating across a range of parameters. A key feature of the network is that it…

Machine Learning · Computer Science 2019-07-18 Jiaqi Jiang , Jonathan A. Fan

Using a statistical model-based data generation, we develop an experimental setup for the evaluation of neural networks (NNs). The setup helps to benchmark a set of NNs vis-a-vis minimum-mean-square-error (MMSE) performance bounds. This…

Machine Learning · Computer Science 2020-11-19 Sandipan Das , Prakash B. Gohain , Alireza M. Javid , Yonina C. Eldar , Saikat Chatterjee

The aim of this paper is to propose diffusion strategies for distributed estimation over adaptive networks, assuming the presence of spatially correlated measurements distributed according to a Gaussian Markov random field (GMRF) model. The…

Systems and Control · Computer Science 2015-06-22 Paolo Di Lorenzo

Gaussian state space models have been used for decades as generative models of sequential data. They admit an intuitive probabilistic interpretation, have a simple functional form, and enjoy widespread adoption. We introduce a unified…

Machine Learning · Statistics 2016-12-06 Rahul G. Krishnan , Uri Shalit , David Sontag

Conditional density estimation (density regression) estimates the distribution of a response variable y conditional on covariates x. Utilizing a partition model framework, a conditional density estimation method is proposed using logistic…

Methodology · Statistics 2017-03-22 Richard D. Payne , Nilabja Guha , Yu Ding , Bani K. Mallick

This paper studies a distributed state estimation problem for both continuous- and discrete-time linear systems. A simply structured distributed estimator (comprising interconnected local estimators) is first described for estimating the…

Systems and Control · Electrical Eng. & Systems 2023-10-30 Lili Wang , Ji Liu , Brian B. O. Anderson , A. Stephen Morse