中文
相关论文

相关论文: Scale-Wise VAR is Secretly Discrete Diffusion

200 篇论文

Discrete diffusion models are a powerful class of generative models with strong performance across many domains. For efficiency, however, discrete diffusion typically parameterizes the generative (reverse) process with factorized…

机器学习 · 统计学 2026-05-19 Grigory Bartosh , Teodora Pandeva , Sushrut Karmalkar , Javier Zazo

Recommendation systems often rely on implicit feedback, where only positive user-item interactions can be observed. Negative sampling is therefore crucial to provide proper negative training signals. However, existing methods tend to…

信息检索 · 计算机科学 2026-01-06 Na Li , Fanghui Sun , Yan Zou , Yangfu Zhu , Xiatian Zhu , Ying Ma

In this work, we provide a systematic survey of Discrete Diffusion Language Models (dLLMs) and Discrete Diffusion Multimodal Language Models (dMLLMs). Unlike autoregressive (AR) models, dLLMs and dMLLMs adopt a multi-token, parallel…

机器学习 · 计算机科学 2025-09-22 Runpeng Yu , Qi Li , Xinchao Wang

Motivated by discrete diffusion's success in language-vision modeling, we explore its potential for multi-view generation, a task dominated by continuous approaches. We introduce ViewMask-1-to-3, formulating multi-view synthesis as a…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Ruishu Zhu , Zhihao Huang , Jiacheng Sun , Ping Luo , Hongyuan Zhang , Xuelong Li

Visual autoregressive (AR) generation offers a promising path toward unifying vision and language models, yet its performance remains suboptimal against diffusion models. Prior work often attributes this gap to tokenizer limitations and…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Qiyuan He , Yicong Li , Haotian Ye , Jinghao Wang , Xinyao Liao , Pheng-Ann Heng , Stefano Ermon , James Zou , Angela Yao

The objective of transfer learning is to enhance estimation and inference in a target data by leveraging knowledge gained from additional sources. Recent studies have explored transfer learning for independent observations in complex,…

机器学习 · 统计学 2025-04-23 Mingliang Ma Abolfazl Safikhani

Graph generation has been dominated by autoregressive models due to their simplicity and effectiveness, despite their sensitivity to ordering. Yet diffusion models have garnered increasing attention, as they offer comparable performance…

机器学习 · 计算机科学 2024-12-04 Lingxiao Zhao , Xueying Ding , Leman Akoglu

Unsupervised out-of-distribution (OOD) detection aims to identify out-of-domain data by learning only from unlabeled In-Distribution (ID) training samples, which is crucial for developing a safe real-world machine learning system. Current…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Ying Yang , De Cheng , Chaowei Fang , Yubiao Wang , Changzhe Jiao , Lechao Cheng , Nannan Wang

We improve upon the two-stage sparse vector autoregression (sVAR) method in Davis et al. (2016) by proposing an alternative two-stage modified sVAR method which relies on time series graphical lasso to estimate sparse inverse spectral…

统计计算 · 统计学 2021-07-06 Aramayis Dallakyan , Rakheon Kim , Mohsen Pourahmadi

Diffusion models excel at capturing the natural design spaces of images, molecules, DNA, RNA, and protein sequences. However, rather than merely generating designs that are natural, we often aim to optimize downstream reward functions while…

Diffusion models have demonstrated appealing performance in both image and video generation. However, many works discover that they struggle to capture important, high-level relationships that are present in the real world. For example,…

机器学习 · 计算机科学 2025-05-01 Xunpeng Huang , Yujin Han , Difan Zou , Yian Ma , Tong Zhang

While diffusion models dominate the field of visual generation, they are computationally inefficient, applying a uniform computational effort regardless of different complexity. In contrast, autoregressive (AR) models are inherently…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Jian Han , Jinlai Liu , Jiahuan Wang , Bingyue Peng , Zehuan Yuan

Diffusion-based Generative Models (DGMs) have achieved unparalleled performance in synthesizing high-quality visual content, opening up the opportunity to improve image super-resolution (SR) tasks. Recent solutions for these tasks often…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Ruibin Li , Qihua Zhou , Song Guo , Jie Zhang , Jingcai Guo , Xinyang Jiang , Yifei Shen , Zhenhua Han

We present a cascaded diffusion model based on a part-level implicit 3D representation. Our model achieves state-of-the-art generation quality and also enables part-level shape editing and manipulation without any additional training in…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Juil Koo , Seungwoo Yoo , Minh Hieu Nguyen , Minhyuk Sung

High-dimensional vector autoregressive (VAR) models are important tools for the analysis of multivariate time series. This paper focuses on high-dimensional time series and on the different regularized estimation procedures proposed for…

机器学习 · 统计学 2020-06-11 Jonas Krampe , Efstathios Paparoditis

Autoregressive (AR) models remain the standard for natural language generation but still suffer from high latency due to strictly sequential decoding. Recent diffusion-inspired approaches, such as LlaDA and Dream, mitigate this by…

计算与语言 · 计算机科学 2025-10-16 Qinglin Zhu , Yizhen Yao , Runcong Zhao , Yanzheng Xiang , Amrutha Saseendran , Chen Jin , Philip Teare , Bin Liang , Yulan He , Lin Gui

Diffusion language models enable any-order generation and bidirectional conditioning, offering appealing flexibility for tasks such as infilling, rewriting, and self-correction. However, their formulation-predicting one part of a sequence…

计算与语言 · 计算机科学 2026-01-21 Tianqi Du , Lizhe Fang , Weijie Yang , Chenheng Zhang , Zeming Wei , Yifei Wang , Yisen Wang

High-dimensional vector autoregressive (VAR) models have numerous applications in fields such as econometrics, biology, climatology, among others. While prior research has mainly focused on linear VAR models, these approaches can be…

统计理论 · 数学 2025-11-25 Yuefeng Han , Likai Chen , Wei Biao Wu

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Diffusion models have demonstrated exceptional capabilities in image restoration, yet their application to video super-resolution (VSR) faces significant challenges in balancing fidelity with temporal consistency. Our evaluation reveals a…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Xiaohui Li , Yihao Liu , Shuo Cao , Ziyan Chen , Shaobin Zhuang , Xiangyu Chen , Yinan He , Yi Wang , Yu Qiao