English
Related papers

Related papers: Distilling Specialized Orders for Visual Generatio…

200 papers

Industrial anomaly detection (AD) is characterized by an abundance of normal images but a scarcity of anomalous ones. Although numerous few-shot anomaly synthesis methods have been proposed to augment anomalous data for downstream AD tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Haoxiang Rao , Zhao Wang , Chenyang Si , Yan Lyu , Yuanyi Duan , Fang Zhao , Caifeng Shan

Despite the recent success of deep neural networks, there remains a need for effective methods to enhance domain generalization using vision transformers. In this paper, we propose a novel domain generalization technique called Robust…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ankur Singh , Senthilnath Jayavelu

Knowledge distillation conducts an effective model compression method while holding some limitations:(1) the feature based distillation methods only focus on distilling the feature map but are lack of transferring the relation of data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Muzhou Yu , Sia Huat Tan , Kailu Wu , Runpei Dong , Linfeng Zhang , Kaisheng Ma

Analyzing unsteady fluid flows often requires access to the full distribution of possible temporal states, yet conventional PDE solvers are computationally prohibitive and learned time-stepping surrogates quickly accumulate error over long…

Computational Engineering, Finance, and Science · Computer Science 2026-04-14 Mario Lino , Nils Thuerey

Several recent studies have attempted to autoregressively generate continuous speech representations without discrete speech tokens by combining diffusion and autoregressive models, yet they often face challenges with excessive…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-09 Dongya Jia , Zhuo Chen , Jiawei Chen , Chenpeng Du , Jian Wu , Jian Cong , Xiaobin Zhuang , Chumin Li , Zhen Wei , Yuping Wang , Yuxuan Wang

We propose a flexible person generation framework called Dressing in Order (DiOr), which supports 2D pose transfer, virtual try-on, and several fashion editing tasks. The key to DiOr is a novel recurrent generation pipeline to sequentially…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Aiyu Cui , Daniel McKee , Svetlana Lazebnik

Automated machine learning (AutoML) can produce complex model ensembles by stacking, bagging, and boosting many individual models like trees, deep networks, and nearest neighbor estimators. While highly accurate, the resulting predictors…

Machine Learning · Computer Science 2021-11-05 Rasool Fakoor , Jonas Mueller , Nick Erickson , Pratik Chaudhari , Alexander J. Smola

Discrete diffusion models excel at visual synthesis but rely on slow, iterative decoding. Existing single-step distillation methods attempt to bypass this bottleneck, either by training auxiliary score networks that effectively double…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Chaoyang Wang , Yunhai Tong

The recent success of denoising diffusion models has significantly advanced text-to-image generation. While these large-scale pretrained models show excellent performance in general image synthesis, downstream objectives often require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Maorong Wang , Jiafeng Mao , Xueting Wang , Toshihiko Yamasaki

Dataset distillation often prioritizes global semantic proximity when creating small surrogate datasets for original large-scale ones. However, object semantics are inherently hierarchical. For example, the position and appearance of a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Lin Zhao , Xinru Jiang , Xi Xiao , Qihui Fan , Lei Lu , Yanzhi Wang , Xue Lin , Octavia Camps , Pu Zhao , Jianyang Gu

Autoregressive video generators are attractive for streaming, long-horizon, and interactive applications, but distilling strong black-box teachers into causal students remains difficult. The student must learn under its own rollout…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yang Luo , Shengju Qian , Xiaohang Tang , Zirui Zhu , Yong Liu , Xin Wang , Yang You

Conventional wisdom holds that autoregressive models for image generation are typically accompanied by vector-quantized tokens. We observe that while a discrete-valued space can facilitate representing a categorical distribution, it is not…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Tianhong Li , Yonglong Tian , He Li , Mingyang Deng , Kaiming He

While diffusion models dominate the field of visual generation, they are computationally inefficient, applying a uniform computational effort regardless of different complexity. In contrast, autoregressive (AR) models are inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jian Han , Jinlai Liu , Jiahuan Wang , Bingyue Peng , Zehuan Yuan

Blind super-resolution methods based on stable diffusion showcase formidable generative capabilities in reconstructing clear high-resolution images with intricate details from low-resolution inputs. However, their practical applicability is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Rui Xie , Chen Zhao , Kai Zhang , Zhenyu Zhang , Jun Zhou , Jian Yang , Ying Tai

While inference-time scaling through search has revolutionized Large Language Models, translating these gains to image generation has proven difficult. Recent attempts to apply search strategies to continuous diffusion models show limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Erik Riise , Mehmet Onurcan Kaya , Dim P. Papadopoulos

Diffusion models have attained remarkable breakthroughs in the real-world super-resolution (SR) task, albeit at slow inference and high demand on devices. To accelerate inference, recent works like GenDR adopt step distillation to minimize…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yan Wang , Shijie Zhao , Junlin Li , Li Zhang

We propose a generic confidence-based approximation that can be plugged in and simplify the auto-regressive generation process with a proved convergence. We first assume that the priors of future samples can be generated in an independently…

Machine Learning · Computer Science 2019-10-16 YoungJoon Yoo , Sanghyuk Chun , Sangdoo Yun , Jung-Woo Ha , Jaejun Yoo

Existing vision-language models exhibit strong generalization on a variety of visual domains and tasks. However, such models mainly perform zero-shot recognition in a closed-set manner, and thus struggle to handle open-domain visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Yuhang Zang , Hanlin Goh , Josh Susskind , Chen Huang

Layers have become indispensable tools for professional artists, allowing them to build a hierarchical structure that enables independent control over individual visual elements. In this paper, we propose LayeringDiff, a novel pipeline for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Kyoungkook Kang , Gyujin Sim , Geonung Kim , Donguk Kim , Seungho Nam , Sunghyun Cho

We propose OPAL-Net, a novel hierarchical architecture for part-based layout generation of objects from multiple categories using a single unified model. We adopt a coarse-to-fine strategy involving semantically conditioned autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Rishabh Baghel , Ravi Kiran Sarvadevabhatla