中文
相关论文

相关论文: Lost in Translation: Latent Concept Misalignment i…

200 篇论文

Text-to-video diffusion transformers encode semantic information unevenly across model depth, which constrains effective concept erasure. We identify a representational bottleneck, termed concept-layer topological alignment, under which…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yiwei Xie , Ping Liu , Zheng Zhang

Accurate color alignment in text-to-image (T2I) generation is critical for applications such as fashion, product visualization, and interior design, yet current diffusion models struggle with nuanced and compound color terms (e.g., Tiffany…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Sung-Lin Tsai , Bo-Lun Huang , Yu Ting Shen , Cheng Yu Yeo , Chiang Tseng , Bo-Kai Ruan , Wen-Sheng Lien , Hong-Han Shuai

Discrete diffusion models have recently become competitive with autoregressive models for language modeling, even outperforming them on reasoning tasks requiring planning and global coherence, but they require more computation at inference…

机器学习 · 计算机科学 2026-02-04 Andre He , Sean Welleck , Daniel Fried

The rapid evolution of text-to-image diffusion models has opened the door of generative AI, enabling the translation of textual descriptions into visually compelling images with remarkable quality. However, a persistent challenge within…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Zezhong Fan , Xiaohan Li , Chenhao Fang , Topojoy Biswas , Kaushiki Nag , Jianpeng Xu , Kannan Achan

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

In this paper, we address the limitations of existing text-to-image diffusion models in generating demographically fair results when given human-related descriptions. These models often struggle to disentangle the target language context…

计算机视觉与模式识别 · 计算机科学 2024-03-07 Jia Li , Lijie Hu , Jingfeng Zhang , Tianhang Zheng , Hua Zhang , Di Wang

Have you ever imagined what a corgi-alike coffee machine or a tiger-alike rabbit would look like? In this work, we attempt to answer these questions by exploring a new task called semantic mixing, aiming at blending two different semantics…

计算机视觉与模式识别 · 计算机科学 2022-10-31 Jun Hao Liew , Hanshu Yan , Daquan Zhou , Jiashi Feng

Text-to-video diffusion models have enabled high-quality video synthesis, yet often fail to generate temporally coherent and physically plausible motion. A key reason is the models' insufficient understanding of complex motions that natural…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Aritra Bhowmik , Denis Korzhenkov , Cees G. M. Snoek , Amirhossein Habibian , Mohsen Ghafoorian

Masked diffusion language models (MDLMs) have emerged as a promising alternative to dominant autoregressive approaches. Although they achieve competitive performance on several tasks, a substantial gap remains in open-ended text generation.…

计算与语言 · 计算机科学 2026-02-02 Mengyu Ye , Ryosuke Takahashi , Keito Kudo , Jun Suzuki

While explicit Chain-of-Thought (CoT) equips Large Language Models (LLMs) with strong reasoning capabilities, it requires models to verbalize every intermediate step in text tokens, constraining the model thoughts to the discrete vocabulary…

计算与语言 · 计算机科学 2026-02-12 Weihao Liu , Dehai Min , Lu Cheng

Text-to-image diffusion models have made significant advancements in generating high-quality, diverse images from text prompts. However, the inherent limitations of textual signals often prevent these models from fully capturing specific…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Ziqiang Li , Jun Li , Lizhi Xiong , Zhangjie Fu , Zechao Li

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Conditional diffusion models rely on language-to-image alignment methods to steer the generation towards semantically accurate outputs. Despite the success of this architecture, misalignment and hallucinations remain common issues and…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Vasco Ramos , Regev Cohen , Idan Szpektor , Joao Magalhaes

Text-to-image diffusion models achieved a remarkable leap in capabilities over the last few years, enabling high-quality and diverse synthesis of images from a textual prompt. However, even the most advanced models often struggle to…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Eyal Segalis , Dani Valevski , Danny Lumen , Yossi Matias , Yaniv Leviathan

Feed-forward CNNs trained for image transformation problems rely on loss functions that measure the similarity between the generated image and a target image. Most of the common loss functions assume that these images are spatially aligned…

计算机视觉与模式识别 · 计算机科学 2018-07-19 Roey Mechrez , Itamar Talmi , Lihi Zelnik-Manor

Diffusion models have exhibited remarkable capabilities in text-to-image generation. However, their performance in image-to-text generation, specifically image captioning, has lagged behind Auto-Regressive (AR) models, casting doubt on…

人工智能 · 计算机科学 2024-04-17 Yuchi Wang , Shuhuai Ren , Rundong Gao , Linli Yao , Qingyan Guo , Kaikai An , Jianhong Bai , Xu Sun

Text-to-Image models have introduced a remarkable leap in the evolution of machine learning, demonstrating high-quality synthesis of images from a given text-prompt. However, these powerful pretrained models still lack control handles that…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Andrey Voynov , Kfir Aberman , Daniel Cohen-Or

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Diffusion models have become the mainstream architecture for text-to-image generation, achieving remarkable progress in visual quality and prompt controllability. However, current inference pipelines generally lack interpretable semantic…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Zheqi Lv , Junhao Chen , Qi Tian , Keting Yin , Shengyu Zhang , Fei Wu

Multimodal Large Language Models (MLLMs), which couple pre-trained vision encoders and language models, have shown remarkable capabilities. However, their reliance on the ubiquitous Pre-Norm architecture introduces a subtle yet critical…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Bozhou Li , Xinda Xue , Sihan Yang , Yang Shi , Xinlong Chen , Yushuo Guan , Yuanxing Zhang , Wentao Zhang