English
Related papers

Related papers: Detailed Human-Centric Text Description-Driven Lar…

200 papers

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

Despite the recent progress in text-to-video generation, existing studies usually overlook the issue that only spatial contents but not temporal motions in synthesized videos are under the control of text. Towards such a challenge, this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Xi Chen , Zhiheng Liu , Mengting Chen , Yutong Feng , Yu Liu , Yujun Shen , Hengshuang Zhao

Revolutionary advancements in text-to-image models have unlocked new dimensions for sophisticated content creation, such as text-conditioned image editing, enabling the modification of existing images based on textual guidance. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoyu Zheng , Wenqiao Zhang , Yaoke Wang , Juncheng Li , Zheqi Lv , Xin Min , Mengze Li , Dongping Zhang , Siliang Tang , Yueting Zhuang

Generating controllable and physically plausible indoor scenes is a pivotal prerequisite for constructing high-fidelity simulation environments for embodied AI. However, existing deeplearning-based methods usually treat all objects as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zini Chen , Junming Huang , Rong Zhang , Jiamin Xu , Cheng Peng , Chi Wang , Weiwei Xu

We propose a new framework for conditional image synthesis from semantic layouts of any precision levels, ranging from pure text to a 2D semantic canvas with precise shapes. More specifically, the input layout consists of one or more…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yu Zeng , Zhe Lin , Jianming Zhang , Qing Liu , John Collomosse , Jason Kuen , Vishal M. Patel

Scene Text Image Super-resolution (STISR) has recently achieved great success as a preprocessing method for scene text recognition. STISR aims to transform blurred and noisy low-resolution (LR) text images in real-world settings into clear…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Chihiro Noguchi , Shun Fukuda , Masao Yamanaka

The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images. Although performs well for simple texts, the models may get confused when faced with complex texts that contain…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Chang Yu , Junran Peng , Xiangyu Zhu , Zhaoxiang Zhang , Qi Tian , Zhen Lei

In recent years, event cameras have gained significant attention due to their bio-inspired properties, such as high temporal resolution and high dynamic range. However, obtaining large-scale labeled ground-truth data for event-based vision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yixuan Hu , Yuxuan Xue , Simon Klenk , Daniel Cremers , Gerard Pons-Moll

This work aims to generate natural and diverse group motions of multiple humans from textual descriptions. While single-person text-to-motion generation is extensively studied, it remains challenging to synthesize motions for more than one…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Mengyi Shan , Lu Dong , Yutao Han , Yuan Yao , Tao Liu , Ifeoma Nwogu , Guo-Jun Qi , Mitch Hill

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Ensuring the robustness of deep learning models requires comprehensive and diverse testing. Existing approaches, often based on simple data augmentation techniques or generative adversarial networks, are limited in producing realistic and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Luciano Baresi , Davide Yi Xian Hu , Muhammad Irfan Mas'udi , Giovanni Quattrocchi

Diffusion models have gained attention for image editing yielding impressive results in text-to-image tasks. On the downside, one might notice that generated images of stable diffusion models suffer from deteriorated details. This pitfall…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Joshua Santoso , Christian Simon , Williem

The rapid advancement of GenAI technology over the past few years has significantly contributed towards highly realistic deepfake content generation. Despite ongoing efforts, the research community still lacks a large-scale and reasoning…

Multimedia · Computer Science 2025-06-17 Parul Gupta , Shreya Ghosh , Tom Gedeon , Thanh-Toan Do , Abhinav Dhall

Scene text detection and document layout analysis have long been treated as two separate tasks in different image domains. In this paper, we bring them together and introduce the task of unified scene text detection and layout analysis. The…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Shangbang Long , Siyang Qin , Dmitry Panteleev , Alessandro Bissacco , Yasuhisa Fujii , Michalis Raptis

Comprehending natural language instructions is a charming property for 3D indoor scene synthesis systems. Existing methods directly model object joint distributions and express object relations implicitly within a scene, thereby hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Chenguo Lin , Yadong Mu

Recent advancements in personalizing text-to-image (T2I) diffusion models have shown the capability to generate images based on personalized visual concepts using a limited number of user-provided examples. However, these models often…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yan Hong , Jianfu Zhang

Current text recognition systems, including those for handwritten scripts and scene text, have relied heavily on image synthesis and augmentation, since it is difficult to realize real-world complexity and diversity through collecting and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yuanzhi Zhu , Zhaohai Li , Tianwei Wang , Mengchao He , Cong Yao

We propose a systematic learning-based approach to the generation of massive quantities of synthetic 3D scenes and arbitrary numbers of photorealistic 2D images thereof, with associated ground truth information, for the purposes of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-21 Chenfanfu Jiang , Siyuan Qi , Yixin Zhu , Siyuan Huang , Jenny Lin , Lap-Fai Yu , Demetri Terzopoulos , Song-Chun Zhu

Recent large-scale text-driven synthesis models have attracted much attention thanks to their remarkable capabilities of generating highly diverse images that follow given text prompts. Such text-based synthesis methods are particularly…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Amir Hertz , Ron Mokady , Jay Tenenbaum , Kfir Aberman , Yael Pritch , Daniel Cohen-Or

Existing scene text spotters are designed to locate and transcribe texts from images. However, it is challenging for a spotter to achieve precise detection and recognition of scene texts simultaneously. Inspired by the glimpse-focus…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jiahao Lyu , Jin Wei , Gangyan Zeng , Zeng Li , Enze Xie , Wei Wang , Yu Zhou