English
Related papers

Related papers: Inference-Time Scaling for Visual AutoRegressive m…

200 papers

Existing vector quantization (VQ) based autoregressive models follow a two-stage generation paradigm that first learns a codebook to encode images as discrete codes, and then completes generation based on the learned codebook. However, they…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Mengqi Huang , Zhendong Mao , Zhuowei Chen , Yongdong Zhang

The vector autoregression (VAR) has long proven to be an effective method for modeling the joint dynamics of macroeconomic time series as well as forecasting. A major shortcoming of the VAR that has hindered its applicability is its heavy…

Applications · Statistics 2017-02-28 William Nicholson , David Matteson , Jacob Bien

Inference-time scaling has proven effective in boosting large language model (LLM) performance through increased test-time computation. Yet, its practical application is often hindered by reliance on external verifiers or a lack of…

Computation and Language · Computer Science 2025-06-23 Fei Wang , Xingchen Wan , Ruoxi Sun , Jiefeng Chen , Sercan Ö. Arık

Real-world time series data exhibit non-stationary behavior, regime shifts, and temporally varying noise (heteroscedastic) that degrade the robustness of standard regression models. We introduce the Variability-Aware Recursive Neural…

Machine Learning · Computer Science 2025-10-13 Haroon Gharwi , Kai Shu

Text-guided image editing is an essential task that enables users to modify images through natural language descriptions. Recent advances in diffusion models and rectified flows have significantly improved editing quality, primarily relying…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yufei Wang , Lanqing Guo , Zhihao Li , Jiaxing Huang , Pichao Wang , Bihan Wen , Jian Wang

We study the problem of learning the support of transition matrix between random processes in a Vector Autoregressive (VAR) model from samples when a subset of the processes are latent. It is well known that ignoring the effect of the…

Machine Learning · Computer Science 2017-11-13 Saber Salehkaleybar , Jalal Etesami , Negar Kiyavash , Kun Zhang

Diffusion models show promise for image restoration, but existing methods often struggle with inconsistent fidelity and undesirable artifacts. To address this, we introduce Kernel Density Steering (KDS), a novel inference-time framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuyang Hu , Kangfu Mei , Mojtaba Sahraee-Ardakan , Ulugbek S. Kamilov , Peyman Milanfar , Mauricio Delbracio

Vector quantization (VQ) transforms continuous image features into discrete representations, providing compressed, tokenized inputs for generative models. However, VQ-based frameworks suffer from several issues, such as non-smooth latent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Sicheng Yang , Xing Hu , Qiang Wu , Dawei Yang

The integration of Vector Quantised Variational AutoEncoder (VQ-VAE) with autoregressive models as generation part has yielded high-quality results on image generation. However, the autoregressive models will strictly follow the progressive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Minghui Hu , Yujie Wang , Tat-Jen Cham , Jianfei Yang , P. N. Suganthan

Generative models typically sample outputs independently, and recent inference-time guidance and scaling algorithms focus on improving the quality of individual samples. However, in real-world applications, users are often presented with a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Gaurav Parmar , Or Patashnik , Daniil Ostashev , Kuan-Chieh Wang , Kfir Aberman , Srinivasa Narasimhan , Jun-Yan Zhu

While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruihan Yang , Yibo Yang , Joseph Marino , Stephan Mandt

Motivated by Tucker tensor decomposition, this paper imposes low-rank structures to the column and row spaces of coefficient matrices in a multivariate infinite-order vector autoregression (VAR), which leads to a supervised factor model…

Methodology · Statistics 2023-12-04 Feiqing Huang , Kexin Lu , Guodong Li

Autoregressive models have demonstrated remarkable success in sequential data generation, particularly in NLP, but their extension to continuous-domain image generation presents significant challenges. Recent work, the masked autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Tiankai Hang , Jianmin Bao , Fangyun Wei , Dong Chen

Inference-time scaling offers a versatile paradigm for aligning visual generative models with downstream objectives without parameter updates. However, existing approaches that optimize the high-dimensional initial noise suffer from severe…

Machine Learning · Computer Science 2026-02-04 Jinyan Ye , Zhongjie Duan , Zhiwen Li , Cen Chen , Daoyuan Chen , Yaliang Li , Yingda Chen

Video variational autoencoders (VAEs) used in latent diffusion models typically require a sufficiently large number of latent channels to ensure high-quality video reconstruction. However, recent studies have revealed that an excessive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiarui Guan , Wenshuai Zhao , Zhengtao Zou , Juho Kannala , Arno Solin

Visual Autoregressive (VAR) models enable efficient image generation via next-scale prediction but face escalating computational costs as sequence length grows. Existing static pruning methods degrade performance by permanently removing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Kaixin Zhang , Ruiqing Yang , Yuan Zhang , Shan You , Tao Huang

A semi-parametric, non-linear regression model in the presence of latent variables is introduced. These latent variables can correspond to unmodeled phenomena or unmeasured agents in a complex networked system. This new formulation allows…

Machine Learning · Statistics 2018-06-29 Jonathan Mei , José M. F. Moura

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

Machine Learning · Computer Science 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

We present a refinement framework to boost the performance of pre-trained semi-supervised video object segmentation (VOS) models. Our work is based on scale inconsistency, which is motivated by the observation that existing VOS models…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Hengyi Wang , Changjae Oh

In this paper we propose BVAR-connect, a variational inference approach to a Bayesian multi-subject vector autoregressive (VAR) model for inference on effective brain connectivity based on resting-state functional MRI data. The modeling…

Applications · Statistics 2021-06-18 Jeong Hwan Kook , Kelly A. Vaughn , Dana M. DeMaster , Linda Ewing-Cobbs , Marina Vannucci