中文
相关论文

相关论文: Semantics Lead the Way: Harmonizing Semantic and T…

200 篇论文

Diffusion language models offer parallel token generation and inherent bidirectionality, promising more efficient and powerful sequence modeling compared to autoregressive approaches. However, state-of-the-art diffusion models (e.g., Dream…

计算与语言 · 计算机科学 2025-10-10 Zhanqiu Hu , Jian Meng , Yash Akhauri , Mohamed S. Abdelfattah , Jae-sun Seo , Zhiru Zhang , Udit Gupta

Topology optimization enables the automated design of efficient structures by optimally distributing material within a defined domain. However, traditional gradient-based methods often scale poorly with increasing resolution and…

计算工程、金融与科学 · 计算机科学 2025-08-08 Aaron Lutheran , Srijan Das , Alireza Tabarraei

The goal of scene text image super-resolution is to reconstruct high-resolution text-line images from unrecognizable low-resolution inputs. The existing methods relying on the optimization of pixel-level loss tend to yield text edges that…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Baolin Liu , Zongyuan Yang , Pengfei Wang , Junjie Zhou , Ziqi Liu , Ziyi Song , Yan Liu , Yongping Xiong

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

图形学 · 计算机科学 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He

Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkable success in various image generation tasks compared with Generative Adversarial Nets (GANs). Recent work on semantic image synthesis mainly follows the de facto…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Wengang Zhou , Weilun Wang , Jianmin Bao , Dongdong Chen , Dong Chen , Lu Yuan , Houqiang Li

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

The incorporation of Denoising Diffusion Models (DDMs) in the Text-to-Speech (TTS) domain is rising, providing great value in synthesizing high quality speech. Although they exhibit impressive audio quality, the extent of their semantic…

声音 · 计算机科学 2024-06-05 Miri Varshavsky-Hassid , Roy Hirsch , Regev Cohen , Tomer Golany , Daniel Freedman , Ehud Rivlin

The field of neural rendering has witnessed significant progress with advancements in generative models and differentiable rendering techniques. Though 2D diffusion has achieved success, a unified 3D diffusion pipeline remains unsettled.…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Yushi Lan , Fangzhou Hong , Shangchen Zhou , Shuai Yang , Xuyi Meng , Yongwei Chen , Zhaoyang Lyu , Bo Dai , Xingang Pan , Chen Change Loy

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Xiyuan Wang , Muhan Zhang

Text-to-image generation has witnessed significant advancements with the integration of Large Vision-Language Models (LVLMs), yet challenges remain in aligning complex textual descriptions with high-quality, visually coherent images. This…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Emily Johnson , Noah Wilson

Text-to-image generation is a significant domain in modern computer vision and has achieved substantial improvements through the evolution of generative architectures. Among these, there are diffusion-based models that have demonstrated…

We present Stable Video Diffusion - a latent video diffusion model for high-resolution, state-of-the-art text-to-video and image-to-video generation. Recently, latent diffusion models trained for 2D image synthesis have been turned into…

By embedding discrete representations into a continuous latent space, we can leverage continuous-space latent diffusion models to handle generative modeling of discrete data. However, despite their initial success, most latent diffusion…

机器学习 · 计算机科学 2025-04-02 Bac Nguyen , Chieh-Hsin Lai , Yuhta Takida , Naoki Murata , Toshimitsu Uesaka , Stefano Ermon , Yuki Mitsufuji

Denoising Diffusion Models (DDMs) have emerged as a strong competitor to Generative Adversarial Networks (GANs). However, despite their widespread use in image synthesis and editing applications, their latent space is still not as well…

计算机视觉与模式识别 · 计算机科学 2024-05-30 René Haas , Inbar Huberman-Spiegelglas , Rotem Mulayoff , Stella Graßhof , Sami S. Brandt , Tomer Michaeli

Text-to-image diffusion models excel at translating language prompts into photorealistic images by implicitly grounding textual concepts through their cross-modal attention mechanisms. Recent multi-modal diffusion transformers extend this…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Chaehyun Kim , Heeseong Shin , Eunbeen Hong , Heeji Yoon , Anurag Arnab , Paul Hongsuck Seo , Sunghwan Hong , Seungryong Kim

Discrete Diffusion Language Models progressed rapidly as an alternative to autoregressive (AR) models, motivated by their parallel generation abilities. However, for tractability, discrete diffusion models sample from a factorized…

机器学习 · 计算机科学 2026-05-19 Justin Deschenaux , Caglar Gulcehre

Text-to-image generation has witnessed significant progress with the advent of diffusion models. Despite the ability to generate photorealistic images, current text-to-image diffusion models still often struggle to accurately interpret and…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Tsung-Han Wu , Long Lian , Joseph E. Gonzalez , Boyi Li , Trevor Darrell

Diffusion models have exhibited substantial success in text-to-image generation. However, they often encounter challenges when dealing with complex and dense prompts involving multiple objects, attribute binding, and long descriptions. In…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Mushui Liu , Yuhang Ma , Yang Zhen , Jun Dan , Yunlong Yu , Zeng Zhao , Zhipeng Hu , Bai Liu , Changjie Fan

Despite its success in image synthesis, we observe that diffusion probabilistic models (DPMs) often lack contextual reasoning ability to learn the relations among object parts in an image, leading to a slow learning process. To solve this…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Shanghua Gao , Pan Zhou , Ming-Ming Cheng , Shuicheng Yan

Diffusion models have become the mainstream architecture for text-to-image generation, achieving remarkable progress in visual quality and prompt controllability. However, current inference pipelines generally lack interpretable semantic…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Zheqi Lv , Junhao Chen , Qi Tian , Keting Yin , Shengyu Zhang , Fei Wu