English
Related papers

Related papers: GAS: Improving Discretization of Diffusion ODEs vi…

200 papers

Recent advancements in timestep-distilled diffusion models have enabled high-quality image generation that rivals non-distilled multi-step models, but with significantly fewer inference steps. While such models are attractive for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zichen Miao , Zhengyuan Yang , Kevin Lin , Ze Wang , Zicheng Liu , Lijuan Wang , Qiang Qiu

Deep neural networks (DNNs) have risen to prominence as key solutions in numerous AI applications for earth observation (AI4EO). However, their susceptibility to adversarial examples poses a critical challenge, compromising the reliability…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Weikang Yu , Yonghao Xu , Pedram Ghamisi

Dataset Distillation (DD) is an emerging technique that compresses large-scale datasets into significantly smaller synthesized datasets while preserving high test performance and enabling the efficient training of large models. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zheng Zhou , Wenquan Feng , Shuchang Lyu , Guangliang Cheng , Xiaowei Huang , Qi Zhao

In recent years, the rapid development of deep neural networks has brought increased attention to the security and robustness of these models. While existing adversarial attack algorithms have demonstrated success in improving adversarial…

Machine Learning · Computer Science 2025-02-25 Wenyuan Wu , Zheng Liu , Yong Chen , Chao Su , Dezhong Peng , Xu Wang

Methods based on diffusion models (DMs) for solving inverse problems (IPs) have recently achieved remarkable performance. However, DM-based methods typically struggle against outliers, which are common in real-world measurements. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yang Zheng , Jiahua Liu , Tongyao Pang , Wen Li , Zhaoqiang Liu

The diffusion model is capable of generating high-quality data through a probabilistic approach. However, it suffers from the drawback of slow generation speed due to the requirement of a large number of time steps. To address this…

Sound · Computer Science 2024-04-30 Myeongjin Ko , Yong-Hoon Choi

Dataset distillation seeks to synthesize a compact distilled dataset, enabling models trained on it to achieve performance comparable to models trained on the full dataset. Recent methods for large-scale datasets focus on matching global…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xiao Cui , Yulei Qin , Wengang Zhou , Hongsheng Li , Houqiang Li

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

The advent of 3D Gaussian Splatting (3DGS) has advanced 3D scene reconstruction and novel view synthesis. With the growing interest of interactive applications that need immediate feedback, online 3DGS reconstruction in real-time is in high…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yang LI , Jinglu Wang , Lei Chu , Xiao Li , Shiu-hong Kao , Ying-Cong Chen , Yan Lu

The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shelly Golan , Roy Ganz , Michael Elad

In this paper, we propose to use a Conditional Generative Adversarial Network (CGAN) for distilling (i.e. transferring) knowledge from sensor data and enhancing low-resolution target detection. In unconstrained surveillance settings, sensor…

Image and Video Processing · Electrical Eng. & Systems 2018-07-23 Siddharth Roheda , Benjamin S. Riggan , Hamid Krim , Liyi Dai

Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential…

Machine Learning · Computer Science 2026-05-29 Jiayi Fu , Yuxia Wang

Score distillation sampling (SDS), the methodology in which the score from pretrained 2D diffusion models is distilled into 3D representation, has recently brought significant advancements in text-to-3D generation task. However, this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Min-Seop Kwak , Donghoon Ahn , Ines Hyeonsu Kim , Jin-Hwa Kim , Seungryong Kim

Diffusion models excel at producing high-quality samples but naively require hundreds of iterations, prompting multiple attempts to distill the generation process into a faster network. However, many existing approaches suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhengyang Geng , Ashwini Pokle , J. Zico Kolter

We present a unified framework for solving partial differential equations (PDEs) using video-inpainting diffusion transformer models. Unlike existing methods that devise specialized strategies for either forward or inverse problems under…

Machine Learning · Computer Science 2025-06-18 Edward Li , Zichen Wang , Jiahe Huang , Jeong Joon Park

Diffusion distillation provides an effective approach for learning lightweight and few-steps diffusion models with efficient generation. However, evaluating their generalization remains challenging: theoretical metrics are often impractical…

Machine Learning · Computer Science 2026-02-13 Huijie Zhang , Zijian Huang , Siyi Chen , Jinfan Zhou , Zekai Zhang , Peng Wang , Qing Qu

Generative adversarial networks (GANs) are successfully used for image synthesis but are known to face instability during training. In contrast, probabilistic diffusion models (DMs) are stable and generate high-quality images, at the cost…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Edgardo Solano-Carrillo , Angel Bueno Rodriguez , Borja Carrillo-Perez , Yannik Steiniger , Jannis Stoppe

Diffusion-based generative models have become dominant generators of high-fidelity images and videos but remain limited by their computationally expensive inference procedures. Existing acceleration techniques either require extensive model…

Machine Learning · Computer Science 2025-07-22 Jiaqi Han , Haotian Ye , Puheng Li , Minkai Xu , James Zou , Stefano Ermon

With wider application of deep neural networks (DNNs) in various algorithms and frameworks, security threats have become one of the concerns. Adversarial attacks disturb DNN-based image classifiers, in which attackers can intentionally add…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Jinyi Wang , Zhaoyang Lyu , Dahua Lin , Bo Dai , Hongfei Fu

In diffusion models, samples are generated through an iterative refinement process, requiring hundreds of sequential model evaluations. Several recent methods have introduced approximations (fewer discretization steps or distillation) to…

Machine Learning · Computer Science 2024-12-12 Nikil Roashan Selvam , Amil Merchant , Stefano Ermon