English
Related papers

Related papers: ISAC: Training-Free Instance-to-Semantic Attention…

200 papers

With recent advancements in text-to-image (T2I) models, effectively generating multiple instances within a single image prompt has become a crucial challenge. Existing methods, while successful in generating positions of individual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Geon Park , Seon Bin Kim , Gunho Jung , Seong-Whan Lee

Multi-Instance Generation has advanced significantly in spatial placement and attribute binding. However, existing approaches still face challenges in fine-grained semantic understanding, particularly when dealing with complex textual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Shiyan Du , Conghan Yue , Xinyu Cheng , Dongyu Zhang

Various works have aimed at combining the inference efficiency of recurrent models and training parallelism of multi-head attention for sequence modeling. However, most of these works focus on tasks with fixed-dimension observation spaces,…

Machine Learning · Computer Science 2024-10-14 Bryce Ferenczi , Michael Burke , Tom Drummond

Despite the success in large-scale text-to-image generation and text-conditioned image editing, existing methods still struggle to produce consistent generation and editing results. For example, generation approaches usually fail to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Mingdeng Cao , Xintao Wang , Zhongang Qi , Ying Shan , Xiaohu Qie , Yinqiang Zheng

Recent advances in text-to-image (T2I) diffusion models have significantly improved the quality of generated images. However, providing efficient control over individual subjects, particularly the attributes characterizing them, remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Stefan Andreas Baumann , Felix Krause , Michael Neumayr , Nick Stracke , Melvin Sevi , Vincent Tao Hu , Björn Ommer

Classification tasks are widely investigated in the In-Context Learning (ICL) paradigm. However, current efforts are evaluated on disjoint benchmarks and settings, while their performances are significantly influenced by some trivial…

Computation and Language · Computer Science 2025-04-21 Hakaze Cho , Naoya Inoue

Text-to-image (T2I) diffusion models generate high-quality images but often fail to capture the spatial relations specified in text prompts. This limitation can be traced to two factors: lack of fine-grained spatial supervision in training…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Sarah Rastegar , Violeta Chatalbasheva , Sieger Falkena , Anuj Singh , Yanbo Wang , Tejas Gokhale , Hamid Palangi , Hadi Jamali-Rad

Text-to-image diffusion models exhibit remarkable generative capabilities, yet their internal operations remain opaque, particularly when handling prompts that are not fully descriptive. In such scenarios, models must make implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Katarzyna Zaleska , Łukasz Popek , Monika Wysoczańska , Kamil Deja

Current diffusion models create photorealistic images given a text prompt as input but struggle to correctly bind attributes mentioned in the text to the right objects in the image. This is evidenced by our novel image-graph alignment model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Maria Mihaela Trusca , Wolf Nuyts , Jonathan Thomm , Robert Honig , Thomas Hofmann , Tinne Tuytelaars , Marie-Francine Moens

Recently, text-to-image diffusion models have demonstrated impressive ability to generate high-quality images conditioned on the textual input. However, these models struggle to accurately adhere to textual instructions regarding spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Wenqiang Sun , Teng Li , Zehong Lin , Jun Zhang

Despite the rapid advancement of unsupervised learning in visual representation, it requires training on large-scale datasets that demand costly data collection, and pose additional challenges due to concerns regarding data privacy.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 David Junhao Zhang , Mutian Xu , Chuhui Xue , Wenqing Zhang , Xiaoguang Han , Song Bai , Mike Zheng Shou

Feature representation via self-supervised learning has reached remarkable success in image-level contrastive learning, which brings impressive performances on image classification tasks. While image-level feature representation mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Junwei Yang , Ke Zhang , Zhaolin Cui , Jinming Su , Junfeng Luo , Xiaolin Wei

Text-to-image generation has seen groundbreaking advancements with diffusion models, enabling high-fidelity synthesis and precise image editing through cross-attention manipulation. Recently, autoregressive (AR) models have re-emerged as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Taihang Hu , Linxuan Li , Kai Wang , Yaxing Wang , Jian Yang , Ming-Ming Cheng

We present TeSMo, a method for text-controlled scene-aware motion generation based on denoising diffusion models. Previous text-to-motion methods focus on characters in isolation without considering scenes due to the limited availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Hongwei Yi , Justus Thies , Michael J. Black , Xue Bin Peng , Davis Rempe

Spread through air spaces (STAS) constitutes a novel invasive pattern in lung adenocarcinoma (LUAD), associated with tumor recurrence and diminished survival rates. However, large-scale STAS diagnosis in LUAD remains a labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Liangrui Pan , xiaoyu Li , Guang Zhu , Guanting Li , Ruixin Wang , Jiadi Luo , Yaning Yang , Liang qingchun , Shaoliang Peng

Fine-Tuning Diffusion Models enable a wide range of personalized generation and editing applications on diverse visual modalities. While Low-Rank Adaptation (LoRA) accelerates the fine-tuning process, it still requires multiple reference…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xiaojie Li , Chenghao Gu , Shuzhao Xie , Yunpeng Bai , Weixiang Zhang , Zhi Wang

Multimodal Diffusion Transformers (MM-DiTs) have achieved remarkable progress in text-driven visual generation. However, even state-of-the-art MM-DiT models like FLUX struggle with achieving precise alignment between text prompts and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Zhengyao Lv , Tianlin Pan , Chenyang Si , Zhaoxi Chen , Wangmeng Zuo , Ziwei Liu , Kwan-Yee K. Wong

Integrated Sensing and Communication (ISAC) holds great promise for enabling event-level sensing, such as behavioral intention prediction (BIP) in autonomous driving, particularly under non-line-of-sight (NLoS) or adverse weather conditions…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Haotian Liu , Zhiqing Wei , Yucong Du , Jiachen Wei , Xingwang Li , Zhiyong Feng

Text-to-Image (T2I) generation models have advanced rapidly in recent years, but accurately capturing spatial relationships like "above" or "to the right of" poses a persistent challenge. Earlier methods improved spatial relationship…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jessica Bader , Mateusz Pach , Maria A. Bravo , Serge Belongie , Zeynep Akata

We propose In-Context Clustering (ICC), a flexible LLM-based procedure for clustering data from diverse distributions. Unlike traditional clustering algorithms constrained by predefined similarity measures, ICC flexibly captures complex…

Machine Learning · Computer Science 2025-10-10 Ying Wang , Mengye Ren , Andrew Gordon Wilson