English
Related papers

Related papers: Scaling Properties of Diffusion Models for Percept…

200 papers

Semantic correspondence, the task of determining relationships between different parts of images, underpins various applications including 3D reconstruction, image-to-image translation, object tracking, and visual place recognition. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Frank Fundel , Johannes Schusterbauer , Vincent Tao Hu , Björn Ommer

Joint machine learning models that allow synthesizing and classifying data often offer uneven performance between those tasks or are unstable to train. In this work, we depart from a set of empirical observations that indicate the…

Machine Learning · Computer Science 2023-04-06 Kamil Deja , Tomasz Trzcinski , Jakub M. Tomczak

Applications of diffusion models for visual tasks have been quite noteworthy. This paper targets making classification models more robust to occlusions for the task of object recognition by proposing a pipeline that utilizes a frozen…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Rupayan Mallick , Sibo Dong , Nataniel Ruiz , Sarah Adel Bargal

Recent progress in 3D scene understanding enables scalable learning of representations across large datasets of diverse scenes. As a consequence, generalization to unseen scenes and objects, rendering novel views from just a single or a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Allan Jabri , Sjoerd van Steenkiste , Emiel Hoogeboom , Mehdi S. M. Sajjadi , Thomas Kipf

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Jonathan Ho , Tim Salimans , Alexey Gritsenko , William Chan , Mohammad Norouzi , David J. Fleet

This paper demonstrates how to use generative models trained for image synthesis as tools for visual data mining. Our insight is that since contemporary generative models learn an accurate representation of their training data, we can use…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Ioannis Siglidis , Aleksander Holynski , Alexei A. Efros , Mathieu Aubry , Shiry Ginosar

The new paradigm of test-time scaling has yielded remarkable breakthroughs in Large Language Models (LLMs) (e.g. reasoning models) and in generative vision models, allowing models to allocate additional computation during inference to…

Machine Learning · Computer Science 2025-08-14 Luca Eyring , Shyamgopal Karthik , Alexey Dosovitskiy , Nataniel Ruiz , Zeynep Akata

Diffusion models, widely used in image generation, rely on iterative refinement to generate images from noise. Understanding this data evolution is important for model development and interpretability, yet challenging due to its…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Vidya Prasad , Hans van Gorp , Christina Humer , Ruud J. G. van Sloun , Anna Vilanova , Nicola Pezzotti

Recent text-to-image diffusion models achieve impressive visual quality through extensive scaling of training data and model parameters, yet they often struggle with complex scenes and fine-grained details. Inspired by the self-reflection…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Le Zhuo , Liangbing Zhao , Sayak Paul , Yue Liao , Renrui Zhang , Yi Xin , Peng Gao , Mohamed Elhoseiny , Hongsheng Li

The study of continuous-time information diffusion has been an important area of research for many applications in recent years. When only the diffusion traces (cascades) are accessible, cascade-based network inference and influence…

Social and Information Networks · Computer Science 2024-05-22 Keke Huang , Ruize Gao , Bogdan Cautis , Xiaokui Xiao

Can continuous diffusion models bring the same performance breakthrough on natural language they did for image generation? To circumvent the discrete nature of text data, we can simply project tokens in a continuous space of embeddings, as…

Diffusion models, which iteratively denoise data samples to synthesize high-quality outputs, have achieved empirical success across domains. However, optimizing these models for downstream tasks often involves nested bilevel structures,…

Machine Learning · Computer Science 2025-08-06 Quan Xiao , Hui Yuan , A F M Saif , Gaowen Liu , Ramana Kompella , Mengdi Wang , Tianyi Chen

Distributed diffusion is a powerful algorithm for multi-task state estimation which enables networked agents to interact with neighbors to process input data and diffuse information across the network. Compared to a centralized approach,…

Multiagent Systems · Computer Science 2020-03-27 Jiani Li , Xenofon Koutsoukos

There has been a longstanding belief that generation can facilitate a true understanding of visual data. In line with this, we revisit generatively pre-training visual representations in light of recent interest in denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Chen Wei , Karttikeya Mangalam , Po-Yao Huang , Yanghao Li , Haoqi Fan , Hu Xu , Huiyu Wang , Cihang Xie , Alan Yuille , Christoph Feichtenhofer

We propose a permutation-based explanation method for image classifiers. Current image-model explanations like activation maps are limited to instance-based explanations in the pixel space, making it difficult to understand global model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Sarah Jabbour , Gregory Kondas , Ella Kazerooni , Michael Sjoding , David Fouhey , Jenna Wiens

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent \textit{multi-step iterations} and \textit{complex backbone networks} lead to…

Recently, perceptual image compression has achieved significant advancements, delivering high visual quality at low bitrates for natural images. However, for screen content, existing methods often produce noticeable artifacts when…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Tongda Xu , Jiahao Li , Bin Li , Yan Wang , Ya-Qin Zhang , Yan Lu

We propose Context Diffusion, a diffusion-based framework that enables image generation models to learn from visual examples presented in context. Recent work tackles such in-context learning for image generation, where a query image is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Ivona Najdenkoska , Animesh Sinha , Abhimanyu Dubey , Dhruv Mahajan , Vignesh Ramanathan , Filip Radenovic

Training diffusion models is always a computation-intensive task. In this paper, we introduce a novel speed-up method for diffusion model training, called, which is based on a closer look at time steps. Our key findings are: i) Time steps…

Machine Learning · Computer Science 2025-03-26 Kai Wang , Mingjia Shi , Yukun Zhou , Zekai Li , Zhihang Yuan , Yuzhang Shang , Xiaojiang Peng , Hanwang Zhang , Yang You

Diffusion models have emerged as powerful tools for 3D medical image generation, yet bridging the gap between standard training objectives and clinical relevance remains a challenge. This paper presents a method to enhance 3D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yueying Tian , Xudong Han , Meng Zhou , Rodrigo Aviles-Espinosa , Rupert Young , Philip Birch