中文
相关论文

相关论文: Embedding an Ethical Mind: Aligning Text-to-Image …

200 篇论文

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified prompts, leading to suboptimal image-text alignment, aesthetics, and quality. We propose a…

计算与语言 · 计算机科学 2025-10-16 Ruibo Chen , Jiacheng Pan , Heng Huang , Zhenheng Yang

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

Reinforcement Learning with Verifiable Rewards (RLVR) has achieved remarkable success in improving autoregressive models, especially in domains requiring correctness like mathematical reasoning and code generation. However, directly…

Precisely evaluating semantic alignment between text prompts and generated videos remains a challenge in Text-to-Video (T2V) Generation. Existing text-to-video alignment metrics like CLIPScore only generate coarse-grained scores without…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Kaisi Guan , Zhengfeng Lai , Yuchong Sun , Peng Zhang , Wei Liu , Kieran Liu , Meng Cao , Ruihua Song

This paper addresses the societal concerns arising from large-scale text-to-image diffusion models for generating potentially harmful or copyrighted content. Existing models rely heavily on internet-crawled data, wherein problematic…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Sanghyun Kim , Seohyeon Jung , Balhae Kim , Moonseok Choi , Jinwoo Shin , Juho Lee

Recent spatial control methods for text-to-image (T2I) diffusion models have shown compelling results. However, these methods still fail to precisely follow the control conditions and generate the corresponding images, especially when…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Jiaze Wang , Rui Chen , Haowang Cui

Achieving compositional alignment between textual descriptions and generated images - covering objects, attributes, and spatial relationships - remains a core challenge for modern text-to-image (T2I) models. Although diffusion-based…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Hossein Shahabadi , Niki Sepasian , Arash Marioriyad , Ali Sharifi-Zarchi , Mahdieh Soleymani Baghshah

The remarkable progress in text-to-video diffusion models enables the generation of photorealistic videos, although the content of these generated videos often includes unnatural movement or deformation, reverse playback, and motionless…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Yuta Oshima , Masahiro Suzuki , Yutaka Matsuo , Hiroki Furuta

Personalized text-to-image generation using diffusion models has recently emerged and garnered significant interest. This task learns a novel concept (e.g., a unique toy), illustrated in a handful of images, into a generative model that…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Shaozhe Hao , Kai Han , Shihao Zhao , Kwan-Yee K. Wong

Text-to-image diffusion models are typically trained to optimize the log-likelihood objective, which presents challenges in meeting specific requirements for downstream tasks, such as image aesthetics and image-text alignment. Recent…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Chaofeng Chen , Annan Wang , Haoning Wu , Liang Liao , Wenxiu Sun , Qiong Yan , Weisi Lin

Personalized diffusion models have shown remarkable success in Text-to-Image (T2I) generation by enabling the injection of user-defined concepts into diverse contexts. However, balancing concept fidelity with contextual alignment remains a…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Shamil Ayupov , Maksim Nakhodnov , Anastasia Yaschenko , Andrey Kuznetsov , Aibek Alanov

Scaling up model and data size has been quite successful for the evolution of LLMs. However, the scaling law for the diffusion based text-to-image (T2I) models is not fully explored. It is also unclear how to efficiently scale the model for…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Hao Li , Yang Zou , Ying Wang , Orchid Majumder , Yusheng Xie , R. Manmatha , Ashwin Swaminathan , Zhuowen Tu , Stefano Ermon , Stefano Soatto

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Although recent text-to-image generative models have achieved impressive performance, they still often struggle with capturing the compositional complexities of prompts including attribute binding, and spatial relationships between…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Seyed Mohammad Hadi Hosseini , Amir Mohammad Izadi , Ali Abdollahi , Armin Saghafian , Mahdieh Soleymani Baghshah

With the rapid development of AIGC technology, significant progress has been made in diffusion model-based technologies for text-to-image (T2I) and text-to-video (T2V). In recent years, a few studies have introduced the strategy of Direct…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Lifan Jiang , Boxi Wu , Jiahui Zhang , Xiaotong Guan , Shuang Chen

Recent text-to-image (T2I) models have benefited from large-scale and high-quality data, demonstrating impressive performance. However, these T2I models still struggle to produce images that are aesthetically pleasing, geometrically…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Jianshu Guo , Wenhao Chai , Jie Deng , Hsiang-Wei Huang , Tian Ye , Yichen Xu , Jiawei Zhang , Jenq-Neng Hwang , Gaoang Wang

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Text-to-Image (T2I) models have made remarkable progress in generating images from text prompts, but their output quality and safety still depend heavily on how prompts are phrased. Existing safety methods typically refine prompts using…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Jinwoo Jeon , JunHyeok Oh , Hayeong Lee , Byung-Jun Lee

Most text-to-video(T2V) diffusion models depend on pre-trained text encoders for semantic alignment, yet they often fail to maintain video quality when provided with concise prompts rather than well-designed ones. The primary issue lies in…

计算机视觉与模式识别 · 计算机科学 2025-11-07 Xiangjun Zhang , Litong Gong , Yinglin Zheng , Yansong Liu , Wentao Jiang , Mingyi Xu , Biao Wang , Tiezheng Ge , Ming Zeng

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos