English
Related papers

Related papers: Enhancing Neural Autoregressive Distribution Estim…

200 papers

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

We consider high-dimensional distribution estimation through autoregressive networks. By combining the concepts of sparsity, mixtures and parameter sharing we obtain a simple model which is fast to train and which achieves state-of-the-art…

Machine Learning · Statistics 2016-04-28 Marc Goessling , Yali Amit

Probabilistic models with discrete latent variables naturally capture datasets composed of discrete classes. However, they are difficult to train efficiently, since backpropagation through discrete variables is generally not possible. We…

Machine Learning · Statistics 2017-04-25 Jason Tyler Rolfe

Recent models for image processing are using the Convolutional neural network (CNN) which requires a pixel per pixel analysis of the input image. This method works well. However, it is time-consuming if we have large images. To increase the…

Machine Learning · Computer Science 2019-12-10 Mohamed Karim Belaid

We aim at constructing a high performance model for defect detection that detects unknown anomalous patterns of an image without anomalous data. To this end, we propose a two-stage framework for building anomaly detectors using normal…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Chun-Liang Li , Kihyuk Sohn , Jinsung Yoon , Tomas Pfister

High resolution images can be acquired using a non-regular sampling sensor which consists of an underlying low resolution sensor that is covered with a non-regular sampling mask. The reconstructed high resolution image is then obtained…

Image and Video Processing · Electrical Eng. & Systems 2022-04-08 Markus Jonscher , Karina Jaskolka , Jürgen Seiler , André Kaup

In this paper we focus on learning optimized partial differential equation (PDE) models for image filtering. In this approach, the grey-scaled images are represented by a vector field of two real-valued functions and the image restoration…

Numerical Analysis · Mathematics 2019-07-12 Sílvia Barbeiro , Diogo Lobo

Image denoising methods must effectively model, implicitly or explicitly, the vast diversity of patterns and textures that occur in natural images. This is challenging, even for modern methods that leverage deep neural networks trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Zhihao Xia , Ayan Chakrabarti

We present an extension to masked autoencoders (MAE) which improves on the representations learnt by the model by explicitly encouraging the learning of higher scene-level features. We do this by: (i) the introduction of a perceptual…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Samyakh Tukra , Frederick Hoffman , Ken Chatfield

Deep neural networks have been widely used in computer vision. There are several well trained deep neural networks for the ImageNet classification challenge, which has played a significant role in image recognition. However, little work has…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Youshan Zhang , Brian D. Davison

Image reconstruction based on indirect, noisy, or incomplete data remains an important yet challenging task. While methods such as compressive sensing have demonstrated high-resolution image recovery in various settings, there remain issues…

Numerical Analysis · Mathematics 2023-03-07 Jan Glaubitz , Anne Gelb , Guohui Song

Microstructural evolution is a key aspect of understanding and exploiting the structure-property-performance relation of materials. Modeling microstructure evolution usually relies on coarse-grained simulations with evolution principles…

Materials Science · Physics 2020-09-01 Kaiqi Yang , Yifan Cao , Youtian Zhang , Ming Tang , Daniel Aberg , Babak Sadigh , Fei Zhou

Convolutional Neural Networks are a well-known staple of modern image classification. However, it can be difficult to assess the quality and robustness of such models. Deep models are known to perform well on a given training and estimation…

Machine Learning · Statistics 2018-02-06 Alexey Chaplygin , Joshua Chacksfield

In a given scene, humans can often easily predict a set of immediate future events that might happen. However, generalized pixel-level anticipation in computer vision systems is difficult because machine learning struggles with the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-28 Jacob Walker , Carl Doersch , Abhinav Gupta , Martial Hebert

Autoregressive models, built based on the Next Token Prediction (NTP) paradigm, show great potential in developing a unified framework that integrates both language and vision tasks. Pioneering works introduce NTP to autoregressive visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yatian Pang , Peng Jin , Shuo Yang , Bin Lin , Bin Zhu , Zhenyu Tang , Liuhan Chen , Francis E. H. Tay , Ser-Nam Lim , Harry Yang , Li Yuan

Despite the remarkable progress in generative modelling, current diffusion models lack a quantitative approach to assess image quality. To address this limitation, we propose to estimate the pixel-wise aleatoric uncertainty during the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Michele De Vita , Vasileios Belagiannis

Autoregressive models capture stochastic processes in which past realizations determine the generative distribution of new data; they arise naturally in a variety of industrial, biomedical, and financial settings. A key challenge when…

Statistics Theory · Mathematics 2020-07-30 Daren Wang , Yi Yu , Alessandro Rinaldo , Rebecca Willett

In this work, we propose \texttt{TimeGrad}, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this end, we use diffusion…

Machine Learning · Computer Science 2021-07-09 Kashif Rasul , Calvin Seward , Ingmar Schuster , Roland Vollgraf

In this work, we develop convolutional neural generative coding (Conv-NGC), a generalization of predictive coding to the case of convolution/deconvolution-based computation. Specifically, we concretely implement a flexible…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Alexander Ororbia , Ankur Mali

Objective measures of image quality generally operate by comparing pixels of a "degraded" image to those of the original. Relative to human observers, these measures are overly sensitive to resampling of texture regions (e.g., replacing one…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Keyan Ding , Kede Ma , Shiqi Wang , Eero P. Simoncelli