English
Related papers

Related papers: GAS: Improving Discretization of Diffusion ODEs vi…

200 papers

Diffusion models are the main driver of progress in image and video synthesis, but suffer from slow inference speed. Distillation methods, like the recently introduced adversarial diffusion distillation (ADD) aim to shift the model from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Axel Sauer , Frederic Boesel , Tim Dockhorn , Andreas Blattmann , Patrick Esser , Robin Rombach

To accelerate diffusion model inference, numerical solvers perform poorly at extremely small steps, while distillation techniques often introduce complexity and instability. This work presents an intermediate strategy, balancing performance…

Machine Learning · Computer Science 2025-12-16 Wenze Liu , Xiangyu Yue

Diffusion model (DM) based adversarial purification (AP) has proven to be a powerful defense method that can remove adversarial perturbations and generate a purified example without threats. In principle, the pre-trained DMs can only ensure…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Guang Lin , Zerui Tao , Jianhai Zhang , Toshihisa Tanaka , Qibin Zhao

3D Gaussian Splatting (3DGS) has achieved excellent rendering quality with fast training and rendering speed. However, its optimization process lacks explicit geometric constraints, leading to suboptimal geometric reconstruction in regions…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Lin-Zhuo Chen , Kangjie Liu , Youtian Lin , Siyu Zhu , Zhihao Li , Xun Cao , Yao Yao

Remarkable achievements have been attained with Generative Adversarial Networks (GANs) in image-to-image translation. However, due to a tremendous amount of parameters, state-of-the-art GANs usually suffer from low efficiency and bulky…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Linfeng Zhang , Xin Chen , Xiaobing Tu , Pengfei Wan , Ning Xu , Kaisheng Ma

Existing customization methods require access to multiple reference examples to align pre-trained diffusion probabilistic models (DPMs) with user-provided concepts. This paper aims to address the challenge of DPM customization when the only…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jiachun Pan , Jun Hao Liew , Vincent Y. F. Tan , Jiashi Feng , Hanshu Yan

Adversarial attacks can mislead neural network classifiers. The defense against adversarial attacks is important for AI safety. Adversarial purification is a family of approaches that defend adversarial attacks with suitable pre-processing.…

Machine Learning · Computer Science 2023-10-31 Boya Zhang , Weijian Luo , Zhihua Zhang

Adversarial attacks significantly threaten the robustness of deep neural networks (DNNs). Despite the multiple defensive methods employed, they are nevertheless vulnerable to poison attacks, where attackers meddle with the initial training…

Machine Learning · Computer Science 2023-03-29 Bakary Badjie , José Cecílio , António Casimiro

Recently, 3D Gaussian Splatting (3DGS) has demonstrated remarkable success in 3D reconstruction and novel view synthesis. However, reconstructing 3D scenes from sparse viewpoints remains highly challenging due to insufficient visual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zhaorui Wang , Yi Gu , Deming Zhou , Renjing Xu

Adversarial distillation in the standard min-max adversarial training framework aims to transfer adversarial robustness from a large, robust teacher network to a compact student. However, existing work often neglects to incorporate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hongsin Lee , Hye Won Chung

The presence of adversarial examples poses a significant threat to deep learning models and their applications. Existing defense methods provide certain resilience against adversarial examples, but often suffer from decreased accuracy and…

Cryptography and Security · Computer Science 2023-11-27 Jiahao Chen , Diqun Yan , Li Dong

Diffusion models have demonstrated exceptional capabilities in generating high-fidelity images but typically suffer from inefficient sampling. Many solver designs and noise scheduling strategies have been proposed to dramatically improve…

Machine Learning · Statistics 2025-10-01 Tianrong Chen , Huangjie Zheng , David Berthelot , Jiatao Gu , Josh Susskind , Shuangfei Zhai

Diffusion probabilistic models (DPMs) are emerging powerful generative models. Despite their high-quality generation performance, DPMs still suffer from their slow sampling as they generally need hundreds or thousands of sequential function…

Machine Learning · Computer Science 2022-10-17 Cheng Lu , Yuhao Zhou , Fan Bao , Jianfei Chen , Chongxuan Li , Jun Zhu

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Current techniques for Out-of-Distribution (OoD) detection predominantly rely on quantifying predictive uncertainty and incorporating model regularization during the training phase, using either real or synthetic OoD samples. However,…

Machine Learning · Computer Science 2023-10-13 Xiaoyang Song , Wenbo Sun , Maher Nouiehed , Raed Al Kontar , Judy Jin

Adversarial Imitation Learning is traditionally framed as a two-player zero-sum game between a learner and an adversarially chosen cost function, and can therefore be thought of as the sequential generalization of a Generative Adversarial…

Machine Learning · Computer Science 2025-03-04 Runzhe Wu , Yiding Chen , Gokul Swamy , Kianté Brantley , Wen Sun

Domain Generalization (DG) aims to resolve distribution shifts between source and target domains, and current DG methods are default to the setting that data from source and target domains share identical categories. Nevertheless, there…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zining Chen , Weiqiu Wang , Zhicheng Zhao , Fei Su , Aidong Men , Hongying Meng

In the realm of Adversarial Distillation (AD), strategic and precise knowledge transfer from an adversarially robust teacher model to a less robust student model is paramount. Our Dynamic Guidance Adversarial Distillation (DGAD) framework…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Hyejin Park , Dongbo Min

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Diffusion models have achieved remarkable success in video generation; however, the high computational cost of the denoising process remains a major bottleneck. Existing approaches have shown promise in reducing the number of diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xiao Liang , Yunzhu Zhang , Linchao Zhu