English
Related papers

Related papers: FreeFlux: Understanding and Exploiting Layer-Speci…

200 papers

Many biological systems evolve through continuous local dynamics while switching between latent regimes defined by learning, stimulus context, internal state, or developmental stage. These processes are often observed only as unpaired…

Machine Learning · Computer Science 2026-05-12 Josue Ortega Caro , Yongxu Zhang , Hannah M Batchelor , Sizhuang He , Jessica Cardin , Shreya Saxena

Multi-object tracking (MOT) is a fundamental task in computer vision with critical applications in autonomous driving and robotics. Multimodal MOT that integrates visible light and thermal infrared information is particularly essential for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Weiran Li , Yeqiang Liu , Yijie Wei , Mina Han , Qiannan Guo , Zhenbo Li

This paper introduces StructDiff, a generative framework based on a single-scale diffusion model for single-image generation. Single-image generation aims to synthesize diverse samples with similar visual content to the source image by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yinxi He , Kang Liao , Chunyu Lin , Tianyi Wei , Yao Zhao

Image composition aims to seamlessly insert a user-specified object into a new scene, but existing models struggle with complex lighting (e.g., accurate shadows, water reflections) and diverse, high-resolution inputs. Modern text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Shilin Lu , Zhuming Lian , Zihan Zhou , Shaocong Zhang , Chen Zhao , Adams Wai-Kin Kong

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

Flow matching models have recently emerged as an efficient alternative to diffusion, especially for text-guided image generation and editing, offering faster inference through continuous-time dynamics. However, existing flow-based editors…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Carmine Zaccagnino , Fabio Quattrini , Enis Simsar , Marta Tintoré Gazulla , Rita Cucchiara , Alessio Tonioni , Silvia Cascianelli

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

Existing text-to-image diffusion models struggle to synthesize realistic images given dense captions, where each text prompt provides a detailed description for a specific image region. To address this, we propose DenseDiffusion, a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yunji Kim , Jiyoung Lee , Jin-Hwa Kim , Jung-Woo Ha , Jun-Yan Zhu

The rapid growth of model scale has necessitated substantial computational resources for fine-tuning. Existing approach such as Low-Rank Adaptation (LoRA) has sought to address the problem of handling the large updated parameters in full…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Yiming Shi , Jiwei Wei , Yujia Wu , Ran Ran , Chengwei Sun , Shiyuan He , Yang Yang

We present a novel framework for free-viewpoint facial performance relighting using diffusion-based image-to-image translation. Leveraging a subject-specific dataset containing diverse facial expressions captured under various lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Mingming He , Pascal Clausen , Ahmet Levent Taşel , Li Ma , Oliver Pilarski , Wenqi Xian , Laszlo Rikker , Xueming Yu , Ryan Burgert , Ning Yu , Paul Debevec

Diffusion transformers typically incorporate textual information via attention layers and a modulation mechanism using a pooled text embedding. Nevertheless, recent approaches discard modulation-based text conditioning and rely exclusively…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Nikita Starodubcev , Daniil Pakhomov , Zongze Wu , Ilya Drobyshevskiy , Yuchen Liu , Zhonghao Wang , Yuqian Zhou , Zhe Lin , Dmitry Baranchuk

Rectified flow models have become a de facto standard in image generation due to their stable sampling trajectories and high-fidelity outputs. Despite their strong generative capabilities, they face critical limitations in image editing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Sung-Hoon Yoon , Minghan Li , Gaspard Beaudouin , Congcong Wen , Muhammad Rafay Azhar , Mengyu Wang

So far, expensive finetuning beyond the pretraining sequence length has been a requirement for effectively extending the context of language models (LM). In this work, we break this key bottleneck by Dropping the Positional Embeddings of…

Computation and Language · Computer Science 2025-12-16 Yoav Gelberg , Koshi Eguchi , Takuya Akiba , Edoardo Cetin

Diffusion models have revolutionized text-to-image (T2I) synthesis, producing high-quality, photorealistic images. However, they still struggle to properly render the spatial relationships described in text prompts. To address the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Andrea Rigo , Luca Stornaiuolo , Mauro Martino , Bruno Lepri , Nicu Sebe

Deformed document image rectification is essential for real-world document understanding tasks, such as layout analysis and text recognition. However, current multi-task methods -- such as background removal, 3D coordinate prediction, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Heng Li , Xiangping Wu , Qingcai Chen

We present DanceText, a training-free framework for multilingual text editing in images, designed to support complex geometric transformations and achieve seamless foreground-background integration. While diffusion-based generative models…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zhenyu Yu , Mohd Yamani Idna Idris , Hua Wang , Pei Wang , Rizwan Qureshi , Shaina Raza , Aman Chadha , Yong Xiang , Zhixiang Chen

Despite the recent advances in personalized text-to-image (P-T2I) generative models, it remains challenging to perform finetuning-free multi-subject-driven T2I in a resource-efficient manner. Predominantly, contemporary approaches,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Maitreya Patel , Sangmin Jung , Chitta Baral , Yezhou Yang

As the field of image generation rapidly advances, traditional diffusion models and those integrated with multimodal large language models (LLMs) still encounter limitations in interpreting complex prompts and preserving image consistency…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xinyu Zhang , Mengxue Kang , Fei Wei , Shuang Xu , Yuhe Liu , Lin Ma

Text-embedded image generation plays a critical role in industries such as graphic design, advertising, and digital content creation. Text-to-Image generation methods leveraging diffusion models, such as TextDiffuser-2, have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kazi Mahathir Rahman , Showrin Rahman , Sharmin Sultana Srishty