English
Related papers

Related papers: DiffuVolume: Diffusion Model for Volume based Ster…

200 papers

Stereo images are fundamental to numerous applications, including extended reality (XR) devices, autonomous driving, and robotics. Unfortunately, acquiring high-quality stereo images remains challenging due to the precise calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Feng Qiao , Zhexiao Xiong , Eric Xing , Nathan Jacobs

Diffusion probabilistic models have demonstrated an outstanding capability to model natural images and raw audio waveforms through a paired diffusion and reverse processes. The unique property of the reverse process (namely, eliminating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-23 Yen-Ju Lu , Yu Tsao , Shinji Watanabe

Stereo matching has become a key technique for 3D environment perception in intelligent vehicles. For a considerable time, convolutional neural networks (CNNs) have remained the mainstream choice for feature extraction in this domain.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Chuang-Wei Liu , Qijun Chen , Rui Fan

For practical use, diffusion- or flow-based generative models must be aligned with task-specific rewards, such as prompt fidelity or aesthetic preference. That alignment is challenging because the reward is defined for clean output images,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Hyojun Go , Hyungjin Chung , Prune Truong , Goutam Bhat , Li Mi , Zhaochong An , Zixiang Zhao , Dominik Narnhofer , Serge Belongie , Federico Tombari , Konrad Schindler

While supervised stereo matching and monocular depth estimation have advanced significantly with learning-based algorithms, self-supervised methods using stereo images as supervision signals have received relatively less focus and require…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Zihua Liu , Yizhou Li , Songyan Zhang , Masatoshi Okutomi

Despite their groundbreaking performance for many generative modeling tasks, diffusion models have fallen short on discrete data domains such as natural language. Crucially, standard diffusion models rely on the well-established theory of…

Machine Learning · Statistics 2024-06-10 Aaron Lou , Chenlin Meng , Stefano Ermon

We introduce DiffuseST, a low-latency, direct speech-to-speech translation system capable of preserving the input speaker's voice zero-shot while translating from multiple source languages into English. We experiment with the synthesizer…

Diffusion models (DMs) have achieved promising performance in image restoration but haven't been explored for stereo images. The application of DM in stereo image restoration is confronted with a series of challenges. The need to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Huiyun Cao , Yuan Shi , Bin Xia , Xiaoyu Jin , Wenming Yang

The demand for stereo images increases as manufacturers launch more XR devices. To meet this demand, we introduce StereoDiffusion, a method that, unlike traditional inpainting pipelines, is trainning free, remarkably straightforward to use,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Lezhong Wang , Jeppe Revall Frisvad , Mark Bo Jensen , Siavash Arjomand Bigdeli

Generating high-quality labeled image datasets is crucial for training accurate and robust machine learning models in the field of computer vision. However, the process of manually labeling real images is often time-consuming and costly. To…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Michael Shenoda , Edward Kim

Visual synthesis has recently seen significant leaps in performance, largely due to breakthroughs in generative models. Diffusion models have been a key enabler, as they excel in image diversity. However, this comes at the cost of slow…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Johannes Schusterbauer , Ming Gui , Pingchuan Ma , Nick Stracke , Stefan A. Baumann , Vincent Tao Hu , Björn Ommer

Despite Flow Matching and diffusion models having emerged as powerful generative paradigms for continuous variables such as images and videos, their application to high-dimensional discrete data, such as language, is still limited. In this…

Machine Learning · Computer Science 2024-11-06 Itai Gat , Tal Remez , Neta Shaul , Felix Kreuk , Ricky T. Q. Chen , Gabriel Synnaeve , Yossi Adi , Yaron Lipman

Denoising Diffusion Probabilistic Models (DDPMs) have established a new state-of-the-art in generative image synthesis, yet their deployment is hindered by significant computational overhead during inference, often requiring up to 1,000…

Machine Learning · Computer Science 2025-11-25 Srishti Gupta , Yashasvee Taiwade

Text-conditioned image generation models have recently shown immense qualitative success using denoising diffusion processes. However, unlike discriminative vision-and-language models, it is a non-trivial task to subject these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Benno Krojer , Elinor Poole-Dayan , Vikram Voleti , Christopher Pal , Siva Reddy

Text-to-image generation using diffusion models has gained increasing popularity due to their ability to produce high-quality, realistic images based on text prompts. However, efficiently serving these models is challenging due to their…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Sohaib Ahmad , Qizheng Yang , Haoliang Wang , Ramesh K. Sitaraman , Hui Guan

Diffusion models achieve superior performance in image generation tasks. However, it incurs significant computation overheads due to its iterative structure. To address these overheads, we analyze this iterative structure and observe that…

Hardware Architecture · Computer Science 2025-01-22 Sungbin Kim , Hyunwuk Lee , Wonho Cho , Mincheol Park , Won Woo Ro

With the development of deep learning, speech enhancement has been greatly optimized in terms of speech quality. Previous methods typically focus on the discriminative supervised learning or generative modeling, which tends to introduce…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-31 Nan Xu , Zhaolong Huang , Xiaonan Zhi

Dense stereo matching with deep neural networks is of great interest to the research community. Existing stereo matching networks typically use slow and computationally expensive 3D convolutions to improve the performance, which is not…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Zhengyu Huang , Theodore B. Norris , Panqu Wang

Stereo matching is a fundamental building block for many vision and robotics applications. An informative and concise cost volume representation is vital for stereo matching of high accuracy and efficiency. In this paper, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Gangwei Xu , Yun Wang , Junda Cheng , Jinhui Tang , Xin Yang

While Diffusion Generative Models have achieved great success on image generation tasks, how to efficiently and effectively incorporate them into speech generation especially translation tasks remains a non-trivial problem. Specifically,…

Computation and Language · Computer Science 2023-10-27 Yongxin Zhu , Zhujin Gao , Xinyuan Zhou , Zhongyi Ye , Linli Xu