中文
相关论文

相关论文: Diffusion-based Image Translation using Disentangl…

200 篇论文

Disentangling the content and style in the latent space is prevalent in unpaired text style transfer. However, two major issues exist in most of the current neural models. 1) It is difficult to completely strip the style information from…

计算与语言 · 计算机科学 2019-08-21 Ning Dai , Jianze Liang , Xipeng Qiu , Xuanjing Huang

Image deblurring aims to restore the latent sharp images from the corresponding blurred ones. In this paper, we present an unsupervised method for domain-specific single-image deblurring based on disentangled representations. The…

计算机视觉与模式识别 · 计算机科学 2019-08-06 Boyu Lu , Jun-Cheng Chen , Rama Chellappa

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

Diffusion Transformers (DiTs) have achieved remarkable success in diverse and high-quality text-to-image(T2I) generation. However, how text and image latents individually and jointly contribute to the semantics of generated images, remain…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Zitao Shuai , Chenwei Wu , Zhengxu Tang , Bowen Song , Liyue Shen

In image processing, one of the most challenging tasks is to render an image's semantic meaning using a variety of artistic approaches. Existing techniques for arbitrary style transfer (AST) frequently experience mode-collapse,…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Onkar Susladkar , Gayatri Deshmukh , Sparsh Mittal , Parth Shastri

Generative adversarial networks has emerged as a defacto standard for image translation problems. To successfully drive such models, one has to rely on additional networks e.g., discriminators and/or perceptual networks. Training these…

计算机视觉与模式识别 · 计算机科学 2019-08-02 M. Saquib Sarfraz , Constantin Seibold , Haroon Khalid , Rainer Stiefelhagen

Diffusion-based point editing methods have gained significant traction in image editing tasks due to their ability to manipulate image semantics and fine details by applying localized perturbations on the manifold of noise latent. However,…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Haoyang Hu , Masataka Seo , Yen-Wei Chen

Despite the impressive generative capabilities of diffusion models, existing diffusion model-based style transfer methods require inference-stage optimization (e.g. fine-tuning or textual inversion of style) which is time-consuming, or…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Jiwoo Chung , Sangeek Hyun , Jae-Pil Heo

Text-conditioned diffusion models can generate impressive images, but fall short when it comes to fine-grained control. Unlike direct-editing tools like Photoshop, text conditioned models require the artist to perform "prompt engineering,"…

计算机视觉与模式识别 · 计算机科学 2024-04-05 Michelle Shu , Charles Herrmann , Richard Strong Bowen , Forrester Cole , Ramin Zabih

Image Super-Resolution (SR) aims to reconstruct high-resolution images from degraded low-resolution inputs. While diffusion-based SR methods offer powerful generative capabilities, their performance heavily depends on how semantic priors…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Lei Jiang , Xin Liu , Xinze Tong , Zhiliang Li , Jie Liu , Jie Tang , Gangshan Wu

Conditional diffusion models have exhibited superior performance in high-fidelity text-guided visual generation and editing. Nevertheless, prevailing text-guided visual diffusion models primarily focus on incorporating text-visual…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Ling Yang , Zhilong Zhang , Zhaochen Yu , Jingwei Liu , Minkai Xu , Stefano Ermon , Bin Cui

We present a novel method for exemplar-based image translation, called matching interleaved diffusion models (MIDMs). Most existing methods for this task were formulated as GAN-based matching-then-generation framework. However, in this…

计算机视觉与模式识别 · 计算机科学 2023-03-30 Junyoung Seo , Gyuseong Lee , Seokju Cho , Jiyoung Lee , Seungryong Kim

Restoring low-resolution text images presents a significant challenge, as it requires maintaining both the fidelity and stylistic realism of the text in restored images. Existing text image restoration methods often fall short in hard…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Chenglu Pan , Xiaogang Xu , Ganggui Ding , Yunke Zhang , Wenbo Li , Jiarong Xu , Qingbiao Wu

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang

The images produced by diffusion models can attain excellent perceptual quality. However, it is challenging for diffusion models to guarantee distortion, hence the integration of diffusion models and image compression models still needs…

图像与视频处理 · 电气工程与系统科学 2024-05-03 Yiyang Ma , Wenhan Yang , Jiaying Liu

Sign language translation (SLT) is challenging, as it involves converting sign language videos into natural language. Previous studies have prioritized accuracy over diversity. However, diversity is crucial for handling lexical and…

计算机视觉与模式识别 · 计算机科学 2024-11-27 JiHwan Moon , Jihoon Park , Jungeun Kim , Jongseong Bae , Hyeongwoo Jeon , Ha Young Kim

In this work we propose a photorealistic style transfer method for image and video that is based on vision science principles and on a recent mathematical formulation for the deterministic decoupling of sample statistics. The novel aspects…

图像与视频处理 · 电气工程与系统科学 2023-04-11 Trevor D. Canham , Adrián Martín , Marcelo Bertalmío , Javier Portilla

In the new paradigm of semantic communication (SC), the focus is on delivering meanings behind bits by extracting semantic information from raw data. Recent advances in data-to-text models facilitate language-oriented SC, particularly for…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Giordano Cicchetti , Eleonora Grassucci , Jihong Park , Jinho Choi , Sergio Barbarossa , Danilo Comminiello

Diffusion models have demonstrated their ability to generate diverse and high-quality images, sparking considerable interest in their potential for real image editing applications. However, existing diffusion-based approaches for local…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Wenjing Huang , Shikui Tu , Lei Xu

While diffusion models have achieved remarkable progress in style transfer tasks, existing methods typically rely on fine-tuning or optimizing pre-trained models during inference, leading to high computational costs and challenges in…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Bo Huang , Wenlun Xu , Qizhuo Han , Haodong Jing , Ying Li