English
Related papers

Related papers: Autoregressive Generative Modeling with Noise Cond…

200 papers

The aim of this paper is to study the asymptotic properties of the maximum likelihood estimator (MLE) of the drift coefficient for fractional stochastic heat equation driven by an additive space-time noise. We consider the traditional for…

Probability · Mathematics 2019-04-25 Igor Cialenco , Francisco Delgado-Vences , Hyun-Jung Kim

Simulation-based inference provides a powerful framework for Bayesian inference when the likelihood is analytically intractable or computationally prohibitive. By leveraging machine-learning techniques and neural density estimators, it…

General Relativity and Quantum Cosmology · Physics 2026-01-21 Mattia Emma , Gregory Ashton

We present an efficient algorithm for maximum likelihood estimation (MLE) of exponential family models, with a general parametrization of the energy function that includes neural networks. We exploit the primal-dual view of the MLE with a…

Machine Learning · Computer Science 2020-04-01 Bo Dai , Zhen Liu , Hanjun Dai , Niao He , Arthur Gretton , Le Song , Dale Schuurmans

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

We consider the problem of estimating the parameters of a multivariate Bernoulli process with auto-regressive feedback in the high-dimensional setting where the number of samples available is much less than the number of parameters. This…

Statistics Theory · Mathematics 2019-03-25 Parthe Pandit , Mojtaba Sahraee-Ardakan , Arash A. Amini , Sundeep Rangan , Alyson K. Fletcher

Data augmentation has been widely used to improve deep neural networks in many research fields, such as computer vision. However, less work has been done in the context of text, partially due to its discrete nature and the complexity of…

Computation and Language · Computer Science 2021-01-12 Ping Yu , Ruiyi Zhang , Yang Zhao , Yizhe Zhang , Chunyuan Li , Changyou Chen

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on…

Statistics Theory · Mathematics 2018-12-06 Timothy Carpenter , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

This work studies the properties of the maximum likelihood estimator (MLE) of a non-linear model with Gaussian errors and multidimensional parameter. The observations are collected in a two-stage experimental design and are dependent since…

Statistics Theory · Mathematics 2019-11-01 Nancy Flournoy , Caterina May , Chiara Tommasi

This paper introduces an alternative approach to sampling from autoregressive models. Autoregressive models are typically sampled sequentially, according to the transition dynamics defined by the model. Instead, we propose a sampling…

Machine Learning · Computer Science 2021-12-20 Vivek Jayaram , John Thickstun

Autoregressive image modeling relies on visual tokenizers to compress images into compact latent representations. We design an end-to-end training pipeline that jointly optimizes reconstruction and generation, enabling direct supervision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Wenda Chu , Bingliang Zhang , Jiaqi Han , Yizhuo Li , Linjie Yang , Yisong Yue , Qiushan Guo

AutoRegressive (AR) models have made notable progress in image generation, with Masked AutoRegressive (MAR) models gaining attention for their efficient parallel decoding. However, MAR models have traditionally underperformed when compared…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yi Xin , Le Zhuo , Qi Qin , Siqi Luo , Yuewen Cao , Bin Fu , Yangfan He , Hongsheng Li , Guangtao Zhai , Xiaohong Liu , Peng Gao

Mixture of Experts (MoE) are successful models for modeling heterogeneous data in many statistical learning problems including regression, clustering and classification. Generally fitted by maximum likelihood estimation via the well-known…

Machine Learning · Statistics 2018-10-30 Faicel Chamroukhi , Bao-Tuyen Huynh

Mixed linear regression (MLR) model is among the most exemplary statistical tools for modeling non-linear distributions using a mixture of linear models. When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM)…

Machine Learning · Statistics 2021-05-14 Babak Barazandeh , Ali Ghafelebashi , Meisam Razaviyayn , Ram Sriharsha

Estimating the clutter-plus-noise covariance matrix in high-dimensional STAP is challenging in the presence of Internal Clutter Motion (ICM) and a high noise floor. The problem becomes more difficult in low-sample regimes, where the Sample…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Shashwat Jain , Vikram Krishnamurthy , Muralidhar Rangaswamy , Sandeep Gogineni , Bosung Kang , Sean M. O'Rourke

Conventional methods for computing maximum-likelihood estimators (MLE) often converge slowly in practical situations, leading to a search for simplifying methods that rely on additional assumptions for their validity. In this work, we…

Quantum Physics · Physics 2017-06-28 Jiangwei Shang , Zhengyun Zhang , Hui Khoon Ng

Recently there has been a great deal of interest surrounding the calibration of quantum sensors using machine learning techniques. In this work, we explore the use of regression to infer a machine-learned point estimate of an unknown…

Quantum Physics · Physics 2024-06-19 Samuel P. Nolan , Luca Pezzè , Augusto Smerzi

We develop in this paper a framework of empirical gain maximization (EGM) to address the robust regression problem where heavy-tailed noise or outliers may present in the response variable. The idea of EGM is to approximate the density…

Machine Learning · Computer Science 2021-01-13 Yunlong Feng , Qiang Wu

We propose an end-to-end trainable image compression framework with a multi-scale and context-adaptive entropy model, especially for low bitrate compression. Due to the success of autoregressive priors in probabilistic generative model, the…

Image and Video Processing · Electrical Eng. & Systems 2019-10-18 Jing Zhou , Sihan Wen , Akira Nakagawa , Kimihiko Kazui , Zhiming Tan

Autoregressive models (ARMs) currently hold state-of-the-art performance in likelihood-based modeling of image and audio data. Generally, neural network based ARMs are designed to allow fast inference, but sampling from these models is…

Machine Learning · Computer Science 2020-07-09 Auke Wiggers , Emiel Hoogeboom

In the field of medical image analysis, deep learning models have demonstrated remarkable success in enhancing diagnostic accuracy and efficiency. However, the reliability of these models is heavily dependent on the quality of training…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Maolin Li , Giacomo Tarroni