中文
相关论文

相关论文: Efficient Multi-Instance Generation with Janus-Pro…

200 篇论文

We introduce the Nexus Adapters, novel text-guided efficient adapters to the diffusion-based framework for the Structure Preserving Conditional Generation (SPCG). Recently, structure-preserving methods have achieved promising results in…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Aryan Das , Koushik Biswas , Swalpa Kumar Roy , Badri Narayana Patro , Vinay Kumar Verma

Recent text-driven image editing in diffusion models has shown remarkable success. However, the existing methods assume that the user's description sufficiently grounds the contexts in the source image, such as objects, background, style,…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Sunwoo Kim , Wooseok Jang , Hyunsu Kim , Junho Kim , Yunjey Choi , Seungryong Kim , Gayeong Lee

Existing score-distilling text-to-3D generation techniques, despite their considerable promise, often encounter the view inconsistency problem. One of the most notable issues is the Janus problem, where the most canonical view of an object…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Susung Hong , Donghoon Ahn , Seungryong Kim

Semantic segmentation in adverse weather scenarios is a critical task for autonomous driving systems. While foundation models have shown promise, the need for specialized adaptors becomes evident for handling more challenging scenarios. We…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Sanket Kalwar , Mihir Ungarala , Shruti Jain , Aaron Monis , Krishna Reddy Konda , Sourav Garg , K Madhava Krishna

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

计算机视觉与模式识别 · 计算机科学 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Recent diffusion model customization has shown impressive results in incorporating subject or style concepts with a handful of images. However, the modular composition of multiple concepts into a customized model, aimed to efficiently merge…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Mingkang Zhu , Xi Chen , Zhongdao Wang , Bei Yu , Hengshuang Zhao , Jiaya Jia

Diffusion models have achieved remarkable success in image generation, yet their deployment remains constrained by the heavy computational cost and the need for numerous inference steps. Previous efforts on fewer-step distillation attempt…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Zhuobai Dong , Rui Zhao , Songjie Wu , Junchao Yi , Linjie Li , Zhengyuan Yang , Lijuan Wang , Alex Jinpeng Wang

The rapid advancement of Text-to-Image(T2I) generative models has enabled the synthesis of high-quality images guided by textual descriptions. Despite this significant progress, these models are often susceptible in generating contents that…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Yichen Sun , Zhixuan Chu , Zhan Qin , Kui Ren

Image super-resolution (SR) methods typically model degradation to improve reconstruction accuracy in complex and unknown degradation scenarios. However, extracting degradation information from low-resolution images is challenging, which…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Zheng Chen , Yulun Zhang , Jinjin Gu , Xin Yuan , Linghe Kong , Guihai Chen , Xiaokang Yang

Convolutional neural networks (CNNs) have been widely used in efficient image super-resolution. However, for CNN-based methods, performance gains often require deeper networks and larger feature maps, which increase complexity and inference…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Xinning Chai , Yao Zhang , Yuxuan Zhang , Zhengxue Cheng , Yingsheng Qin , Yucai Yang , Li Song

Preference-conditioned image generation seeks to adapt generative models to individual users, producing outputs that reflect personal aesthetic choices beyond the given textual prompt. Despite recent progress, existing approaches either…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Wenyi Mo , Tianyu Zhang , Yalong Bai , Ligong Han , Ying Ba , Dimitris N. Metaxas

Prompt learning has become a dominant paradigm for adapting vision-language models (VLMs) such as CLIP to downstream tasks without modifying pretrained weights. While extending prompts to both vision and text encoders across multiple…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Sajjad Ghiasvand , Haniyeh Ehsani Oskouie , Mahnoosh Alizadeh , Ramtin Pedarsani

Text-driven motion diffusion models are capable of generating realistic human motions, but text alone often struggles to express fine-level nuances of motion, commonly referred to as style. Recent approaches have tackled this challenge by…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Junhyuk Jeon , Seokhyeon Hong , Junyong Noh

Balancing accuracy and latency on high-resolution images is a critical challenge for lightweight models, particularly for Transformer-based architectures that often suffer from excessive latency. To address this issue, we introduce…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Junzhou Li , Manqi Zhao , Yilin Gao , Zhiheng Yu , Yin Li , Dongsheng Jiang , Li Xiao

There has been a significant increase in the deployment of neural network models, presenting substantial challenges in model adaptation and fine-tuning. Efficient adaptation is crucial in maintaining model performance across diverse tasks…

机器学习 · 计算机科学 2025-04-02 Maolin Wang , Xiangyu Zhao

Text-to-image diffusion models excel at generating high-quality, diverse images from natural language prompts. However, they often fail to produce semantically accurate results when the prompt contains concept combinations that contradict…

图形学 · 计算机科学 2026-03-25 Saar Huberman , Or Patashnik , Omer Dahary , Ron Mokady , Daniel Cohen-Or

The ability of large language models (LLMs) to process and reason over long textual inputs is critical for a wide range of real-world applications. However, progress in this area is significantly constrained by the absence of high-quality,…

计算与语言 · 计算机科学 2025-09-05 Seganrasan Subramanian , Abhigya Verma

The diffusion transformer (DiT) architecture has attracted significant attention in image generation, achieving better fidelity, performance, and diversity. However, most existing DiT - based image generation methods focus on global - aware…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Zhen Xiong , Yuqi Li , Chuanguang Yang , Tiao Tan , Zhihong Zhu , Siyuan Li , Yue Ma

Recent advances in generative modeling with diffusion processes (DPs) enabled breakthroughs in image synthesis. Despite impressive image quality, these models have various prompt compliance problems, including low recall in generating…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Deepak Sridhar , Abhishek Peri , Rohith Rachala , Nuno Vasconcelos