English
Related papers

Related papers: HiGarment: Cross-modal Harmony Based Diffusion Mod…

200 papers

Large-scale diffusion models have achieved state-of-the-art results on text-to-image synthesis (T2I) tasks. Despite their ability to generate high-quality yet creative images, we observe that attribution-binding and compositional…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Weixi Feng , Xuehai He , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , Xin Eric Wang , William Yang Wang

Spatial transcriptomics (ST) bridges gene expression and tissue morphology but faces clinical adoption barriers due to technical complexity and prohibitive costs. While computational methods predict gene expression from H&E-stained…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Ziqiao Weng , Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee AD Cooper , Weidong Cai , Bo Zhou

Beyond high-fidelity image synthesis, diffusion models have recently exhibited promising results in dense visual perception tasks. However, most existing work treats diffusion models as a standalone component for perception tasks, employing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shuhong Zheng , Zhipeng Bao , Ruoyu Zhao , Martial Hebert , Yu-Xiong Wang

Achieving efficient, high-fidelity, high-resolution garment simulation is challenging due to its computational demands. Conversely, low-resolution garment simulation is more accessible and ideal for low-budget devices like smartphones. In…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Meng Zhang , Jun Li

Current subject-driven image generation methods encounter significant challenges in person-centric image generation. The reason is that they learn the semantic scene and person generation by fine-tuning a common pre-trained diffusion, which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Yibin Wang , Weizhong Zhang , Jianwei Zheng , Cheng Jin

Currently, high-fidelity text-to-image models are developed in an accelerating pace. Among them, Diffusion Models have led to a remarkable improvement in the quality of image generation, making it vary challenging to distinguish between…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ziyue Zeng , Haoyuan Liu , Dingjie Peng , Luoxu Jing , Hiroshi Watanabe

Recent advancements in diffusion models have showcased their impressive capacity to generate visually striking images. Nevertheless, ensuring a close match between the generated image and the given prompt remains a persistent challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Yupeng Zhou , Daquan Zhou , Zuo-Liang Zhu , Yaxing Wang , Qibin Hou , Jiashi Feng

Recently, several point-based image editing methods (e.g., DragDiffusion, FreeDrag, DragNoise) have emerged, yielding precise and high-quality results based on user instructions. However, these methods often make insufficient use of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 DuoSheng Chen , Binghui Chen , Yifeng Geng , Liefeng Bo

Diffusion models have become central to various image editing tasks, yet they often fail to fully adhere to physical laws, particularly with effects like shadows, reflections, and occlusions. In this work, we address the challenge of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Ankit Dhiman , Manan Shah , R Venkatesh Babu

Diffusion models (DMs) have recently been introduced in image deblurring and exhibited promising performance, particularly in terms of details reconstruction. However, the diffusion model requires a large number of inference iterations to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zheng Chen , Yulun Zhang , Ding Liu , Bin Xia , Jinjin Gu , Linghe Kong , Xin Yuan

Articulated object generation has seen increasing advancements, yet existing models often lack the ability to be conditioned on text prompts. To address the significant gap between textual descriptions and 3D articulated object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hao Sun , Lei Fan , Donglin Di , Shaohui Liu

Human body restoration plays a vital role in various applications related to the human body. Despite recent advances in general image restoration using generative models, their performance in human body restoration remains mediocre, often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yiming Zhang , Zhe Wang , Xinjie Li , Yunchen Yuan , Chengsong Zhang , Xiao Sun , Zhihang Zhong , Jian Wang

Dexterous grasp synthesis must jointly satisfy functional intent and physical feasibility, yet existing pipelines often decouple semantic grounding from refinement, yielding unstable or non-functional contacts under object and pose…

Robotics · Computer Science 2026-03-13 Yifan Han , Yichuan Peng , Pengfei Yi , Junyan Li , Hanqing Wang , Gaojing Zhang , Qi Peng Liu , Wenzhao Lian

Although recent advancements in diffusion models have significantly enriched the quality of generated images, challenges remain in synthesizing pixel-based human-drawn sketches, a representative example of abstract expression. To combat…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jiho Park , Sieun Choi , Jaeyoon Seo , Jihie Kim

Diffusion models have demonstrated a remarkable ability in Text-to-Image (T2I) generation applications. Despite the advanced generation output, they suffer from heavy computation overhead, especially for large models that contain tens of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Desen Sun , Jason Hon , Jintao Zhang , Sihang Liu

Image harmonization, which involves adjusting the foreground of a composite image to attain a unified visual consistency with the background, can be conceptualized as an image-to-image translation task. Diffusion models have recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Pengfei Zhou , Fangxiang Feng , Xiaojie Wang

Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains due to their creative and high-fidelity image generation. Nonetheless, existing large-scale diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Younghyun Kim , Geunmin Hwang , Junyu Zhang , Eunbyung Park

Image-based head swapping task aims to stitch a source head to another source body flawlessly. This seldom-studied task faces two major challenges: 1) Preserving the head and body from various sources while generating a seamless transition…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Qinghe Wang , Lijie Liu , Miao Hua , Pengfei Zhu , Wangmeng Zuo , Qinghua Hu , Huchuan Lu , Bing Cao

Text-to-image generation has greatly advanced content creation, yet accurately rendering visual text remains a key challenge due to blurred glyphs, semantic drift, and limited style control. Existing methods often rely on pre-rendered glyph…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Yuanrui Wang , Cong Han , Yafei Li , Zhipeng Jin , Xiawei Li , SiNan Du , Wen Tao , Yi Yang , Shuanglong Li , Chun Yuan , Liu Lin

We introduce a diffusion-based cross-domain image translator in the absence of paired training data. Unlike GAN-based methods, our approach integrates diffusion models to learn the image translation process, allowing for more coverable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shilong Zou , Yuhang Huang , Renjiao Yi , Chenyang Zhu , Kai Xu