English
Related papers

Related papers: Latent Swap Joint Diffusion for 2D Long-Form Laten…

200 papers

Detection of rare lesions in whole-body CT is fundamentally limited by extreme class imbalance and low target-to-volume ratios, producing precision collapse despite high AUROC. Synthetic augmentation with diffusion models offers promise,…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Yifan Li , Mehrdad Salimitari , Taiyu Zhang , Guang Li , David Dreizin

Enhancing forward-looking sonar images is critical for accurate underwater target detection. Current deep learning methods mainly rely on supervised training with simulated data, but the difficulty in obtaining high-quality real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Zhisheng Zhang , Peng Zhang , Fengxiang Wang , Liangli Ma , Fuchun Sun

Diffusion models have become the dominant tool for high-fidelity image and video generation, yet are critically bottlenecked by their inference speed due to the numerous iterative passes of Diffusion Transformers. To reduce the exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiaqi Han , Juntong Shi , Puheng Li , Haotian Ye , Qiushan Guo , Stefano Ermon

We present SlotAdapt, an object-centric learning method that combines slot attention with pretrained diffusion models by introducing adapters for slot-based conditioning. Our method preserves the generative power of pretrained diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Adil Kaan Akan , Yucel Yemez

We propose LatentSwap, a simple face swapping framework generating a face swap latent code of a given generator. Utilizing randomly sampled latent codes, our framework is light and does not require datasets besides employing the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Changho Choi , Minho Kim , Junhyeok Lee , Hyoung-Kyu Song , Younggeun Kim , Seungryong Kim

Previous raw image-based low-light image enhancement methods predominantly relied on feed-forward neural networks to learn deterministic mappings from low-light to normally-exposed images. However, they failed to capture critical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yufei Wang , Yi Yu , Wenhan Yang , Lanqing Guo , Lap-Pui Chau , Alex C. Kot , Bihan Wen

Diffusion models have achieved remarkable image generation quality surpassing previous generative models. However, a notable limitation of diffusion models, in comparison to GANs, is their difficulty in smoothly interpolating between two…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Kaiwen Zhang , Yifan Zhou , Xudong Xu , Xingang Pan , Bo Dai

Creating novel images by fusing visual cues from multiple sources is a fundamental yet underexplored problem in image-to-image generation, with broad applications in artistic creation, virtual reality and visual media. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zeren Xiong , Yue Yu , Zedong Zhang , Shuo Chen , Jian Yang , Jun Li

We introduce ImmerseDiffusion, an end-to-end generative audio model that produces 3D immersive soundscapes conditioned on the spatial, temporal, and environmental conditions of sound objects. ImmerseDiffusion is trained to generate…

Sound · Computer Science 2025-02-11 Mojtaba Heydari , Mehrez Souden , Bruno Conejo , Joshua Atkins

Existing video frame interpolation (VFI) methods often adopt a frame-centric approach, processing videos as independent short segments (e.g., triplets), which leads to temporal inconsistencies and motion artifacts. To overcome this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xinyu Peng , Han Li , Yuyang Huang , Ziyang Zheng , Yaoming Wang , Xin Chen , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Latent diffusion models have shown promising results in audio generation, making notable advancements over traditional methods. However, their performance, while impressive with short audio clips, faces challenges when extended to longer…

Sound · Computer Science 2024-07-16 Zhenxiong Tan , Xinyin Ma , Gongfan Fang , Xinchao Wang

Foreground segmentation is an essential task in the field of image understanding. Under unsupervised conditions, different images and instances always have variable expressions, which make it difficult to achieve stable segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Xi Li , Huimin Ma , Hongbing Ma , Yidong Wang

Combining information from multi-view images is crucial to improve the performance and robustness of automated methods for disease diagnosis. However, due to the non-alignment characteristics of multi-view images, building correlation and…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Di Liu , Yunhe Gao , Qilong Zhangli , Ligong Han , Xiaoxiao He , Zhaoyang Xia , Song Wen , Qi Chang , Zhennan Yan , Mu Zhou , Dimitris Metaxas

The cross-sensor gap is one of the challenges that have aroused much research interests in Heterogeneous Face Recognition (HFR). Although recent methods have attempted to fill the gap with deep generative networks, most of them suffer from…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Boyan Duan , Chaoyou Fu , Yi Li , Xingguang Song , Ran He

Single-image reflection removal is a highly ill-posed problem, where existing methods struggle to reason about the composition of corrupted regions, causing them to fail at recovery and generalization in the wild. This work reframes an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Mingjia Li , Jin Hu , Hainuo Wang , Qiming Hu , Jiarui Wang , Xiaojie Guo

We introduce a model-agnostic forward diffusion process for time-series forecasting that decomposes signals into spectral components, preserving structured temporal patterns such as seasonality more effectively than standard diffusion.…

Machine Learning · Statistics 2026-02-17 Francisco Caldas , Sahil Kumar , Cláudia Soares

Recent advances in image generation have made diffusion models powerful tools for creating high-quality images. However, their iterative denoising process makes understanding and interpreting their semantic latent spaces more challenging…

Computation and Language · Computer Science 2024-11-06 E. Zhixuan Zeng , Yuhao Chen , Alexander Wong

Spectrum management and resource allocation (RA) problems are challenging and critical in a vast number of research areas such as wireless communications and computer networks. The traditional approaches for solving such problems usually…

Machine Learning · Computer Science 2019-10-15 Ahmed B. Zaky , Joshua Zhexue Huang , KaishunWu , Basem M. ElHalawany

Transformer-based audio self-supervised learning (SSL) models commonly use spectrograms, vision-style Transformers, and masked modeling objectives. However, convolutional patchification with temporal downsampling lowers the effective…

Sound · Computer Science 2026-05-15 Kohei Yamamoto , Kosuke Okusa

Modern ultra-high-resolution image synthesis relies heavily on the robust generative capacity of large-scale pre-trained Latent Diffusion Models (LDMs). While recent representation alignment methods have proven effective by distilling…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Jinjin Zhang , Xiefan Guo , Di Huang