English
Related papers

Related papers: TC-LoRA: Temporally Modulated Conditional LoRA for…

200 papers

We present a new theoretical framework for Diffusion Limited Aggregation and associated Dielectric Breakdown Models in two dimensions. Key steps are understanding how these models interrelate when the ultra-violet cut-off strategy is…

Statistical Mechanics · Physics 2007-05-23 R. C. Ball , E. Somfai

Generative model-based policies have shown strong performance in imitation-based robotic manipulation by learning action distributions from demonstrations. However, in long-horizon tasks, visually similar observations often recur across…

Robotics · Computer Science 2026-02-10 Yuxuan Hu , Xiangyu Chen , Chuhao Zhou , Yuxi Liu , Gen Li , Jindou Jia , Jianfei Yang

Diffusion and flow models achieve State-Of-The-Art (SOTA) generative performance, yet many practically important behaviors such as fine-grained prompt fidelity, compositional correctness, and text rendering are weakly specified by score or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

Remote sensing change detection is often challenged by spatial misalignment between bi-temporal images, especially when acquisitions are separated by long seasonal or multi-year gaps. While modern convolutional and transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Seyedehanita Madani , Vishal M. Patel

How much explicit guidance is necessary for conditional diffusion? We consider the problem of conditional sampling using an unconditional diffusion model and limited explicit guidance (e.g., a noised classifier, or a conditional diffusion…

Subject-driven image generation aims to synthesize novel depictions of a specific subject across diverse contexts while preserving its core identity features. Achieving both strong identity consistency and high prompt diversity presents a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Aditi Singhania , Arushi Jain , Krutik Malani , Riddhi Dhawan , Souymodip Chakraborty , Vineet Batra , Ankit Phogat

Online reinforcement learning is becoming increasingly important for aligning diffusion models with non-differentiable objectives. However, existing methods still face limitations in assigning fine-grained credit along denoising…

Machine Learning · Computer Science 2026-05-28 Zhengyang Liang , Qihang Zhang , Ceyuan Yang

Diffusion probabilistic models have achieved enormous success in the field of image generation and manipulation. In this paper, we explore a novel paradigm of using the diffusion model and classifier guidance in the latent semantic space…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Changhao Shi , Haomiao Ni , Kai Li , Shaobo Han , Mingfu Liang , Martin Renqiang Min

Diffusion models have demonstrated remarkable success in various domains, including molecular generation. However, conditional molecular generation remains a fundamental challenge due to an intrinsic trade-off between targeting specific…

Machine Learning · Computer Science 2024-11-04 Hojung Jung , Youngrok Park , Laura Schmid , Jaehyeong Jo , Dongkyu Lee , Bongsang Kim , Se-Young Yun , Jinwoo Shin

Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible…

Machine Learning · Computer Science 2024-04-12 Minshuo Chen , Song Mei , Jianqing Fan , Mengdi Wang

Diffusion models excel at generation, but their latent spaces are high dimensional and not explicitly organized for interpretation or control. We introduce ConDA (Contrastive Diffusion Alignment), a plug-and-play geometry layer that applies…

Diffusion models have become a powerful backbone for text-to-image generation, producing high-quality visuals from natural language prompts. However, when prompts involve multiple objects alongside global or local style instructions, the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ankit Sanjyal

Controllable layout generation aims at synthesizing plausible arrangement of element bounding boxes with optional constraints, such as type or position of a specific element. In this work, we try to solve a broad range of layout generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Naoto Inoue , Kotaro Kikuchi , Edgar Simo-Serra , Mayu Otani , Kota Yamaguchi

Recent studies have explored the combination of multiple LoRAs to simultaneously generate user-specified subjects and styles. However, most existing approaches fuse LoRA weights using static statistical heuristics that deviate from LoRA's…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Qinglong Cao , Yuntian Chen , Chao Ma , Xiaokang Yang

The controllable generation of diffusion models aims to steer the model to generate samples that optimize some given objective functions. It is desirable for a variety of applications including image generation, molecule generation, and…

Machine Learning · Computer Science 2025-05-29 Owen Oertell , Shikun Sun , Yiding Chen , Jin Peng Zhou , Zhiyong Wang , Wen Sun

Personalizing visual generative models to meet specific user needs has gained increasing attention, yet current methods like Low-Rank Adaptation (LoRA) remain impractical due to their demand for task-specific data and lengthy optimization.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yiming Hao , Mutian Xu , Chongjie Ye , Jie Qin , Shunlin Lu , Yipeng Qin , Xiaoguang Han

While diffusion Multimodal Large Language Models (dMLLMs) have recently achieved remarkable strides in multimodal generation, the development of interpretability mechanisms has lagged behind their architectural evolution. Unlike traditional…

Artificial Intelligence · Computer Science 2026-04-14 Haomin Zuo , Yidi Li , Luoxiao Yang , Xiaofeng Zhang

We introduce SteeringDiffusion, a bottlenecked activation-level control interface for diffusion models that exposes a smooth, monotonic, and runtime-adjustable control surface over the content--style trade-off. Our method keeps the U-Net…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Fangzheng Wu , Brian Summa

Most existing cross-modal generative methods based on diffusion models use guidance to provide control over the latent space to enable conditional generation across different modalities. Such methods focus on providing guidance through…

Machine Learning · Computer Science 2023-05-31 Zizhao Hu , Mohammad Rostami

Controlling the behavior of language models (LMs) without re-training is a major open problem in natural language generation. While recent works have demonstrated successes on controlling simple sentence attributes (e.g., sentiment), there…

Computation and Language · Computer Science 2022-05-31 Xiang Lisa Li , John Thickstun , Ishaan Gulrajani , Percy Liang , Tatsunori B. Hashimoto