English
Related papers

Related papers: Think Bright, Diffuse Nice: Enhancing T2I-ICL via …

200 papers

Diffusion models (DMs) have enabled breakthroughs in image synthesis tasks but lack an intuitive interface for consistent image-to-image (I2I) translation. Various methods have been explored to address this issue, including mask-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Sihan Xu , Ziqiao Ma , Yidong Huang , Honglak Lee , Joyce Chai

Text-to-Image (T2I) models are capable of generating high-quality artistic creations and visual content. However, existing research and evaluation standards predominantly focus on image realism and shallow text-image alignment, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yuwei Niu , Munan Ning , Mengren Zheng , Weiyang Jin , Bin Lin , Peng Jin , Jiaqi Liao , Chaoran Feng , Kunpeng Ning , Bin Zhu , Li Yuan

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

We propose a novel framework and a solution to tackle the continual learning (CL) problem with changing network architectures. Most CL methods focus on adapting a single architecture to a new task/class by modifying its weights. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Divyam Madaan , Hongxu Yin , Wonmin Byeon , Jan Kautz , Pavlo Molchanov

In-context Learning (ICL) is an emerging few-shot learning paradigm on Language Models (LMs) with inner mechanisms un-explored. There are already existing works describing the inner processing of ICL, while they struggle to capture all the…

Computation and Language · Computer Science 2025-02-21 Hakaze Cho , Mariko Kato , Yoshihiro Sakai , Naoya Inoue

The goal of neuro-symbolic AI is to integrate symbolic and subsymbolic AI approaches, to overcome the limitations of either. Prominent systems include Logic Tensor Networks (LTN) or DeepProbLog, which offer neural predicates and end-to-end…

Artificial Intelligence · Computer Science 2025-06-18 Stephen Roth , Lennart Baur , Derian Boer , Stefan Kramer

Subject-Driven Text-to-Image (T2I) Generation aims to preserve a subject's identity while editing its context based on a text prompt. A core challenge in this task is the "similarity-controllability paradox", where enhancing textual control…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shuang Li , Chao Deng , Hang Chen , Liqun Liu , Zhenyu Hu , Te Cao , Mengge Xue , Yuan Chen , Peng Shu , Huan Yu , Jie Jiang

Text-to-image (T2I) models have advanced creative content generation, yet their reliance on large uncurated datasets often reproduces societal biases. We present FairT2I, a training-free and interactive framework grounded in a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jinya Sakurai , Yuki Koyama , Issei Sato

In-Context Learning (ICL) enables pretrained LLMs to adapt to downstream tasks by conditioning on a small set of input-output demonstrations, without any parameter updates. Although there have been many theoretical efforts to explain how…

Machine Learning · Computer Science 2026-03-23 Xuhan Tong , Yuchen Zeng , Jiawei Zhang

As modern text-to-image (T2I) models draw closer to synthesizing highly realistic content, the threat of unsafe content generation grows, and it becomes paramount to exercise control. Existing approaches steer these models by applying…

Recent progress in vision-language pretraining has enabled significant improvements to many downstream computer vision applications, such as classification, retrieval, segmentation and depth prediction. However, a fundamental capability…

Despite remarkable progress in image quality and prompt fidelity, text-to-image (T2I) diffusion models continue to exhibit persistent "hallucinations", where generated content subtly or significantly diverges from the intended prompt…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jianjiang Yang , Ziyan Huang , Yanshu li , Da Peng , Huaiyuan Yao

Text-to-image (T2I) diffusion models have shown remarkable success in generating high-quality images from text prompts. Recent efforts extend these models to incorporate conditional images (e.g., canny edge) for fine-grained spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Liheng Zhang , Lexi Pang , Hang Ye , Xiaoxuan Ma , Yizhou Wang

Benefited from image-text contrastive learning, pre-trained vision-language models, e.g., CLIP, allow to direct leverage texts as images (TaI) for parameter-efficient fine-tuning (PEFT). While CLIP is capable of making image features to be…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Chun-Mei Feng , Kai Yu , Xinxing Xu , Salman Khan , Rick Siow Mong Goh , Wangmeng Zuo , Yong Liu

Prompt tuning has emerged as an effective rehearsal-free technique for class-incremental learning (CIL) that learns a tiny set of task-specific parameters (or prompts) to instruct a pre-trained transformer to learn on a sequence of tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Thomas De Min , Massimiliano Mancini , Stéphane Lathuilière , Subhankar Roy , Elisa Ricci

Text-to-image (T2I) models offer great potential for creating virtually limitless synthetic data, a valuable resource compared to fixed and finite real datasets. Previous works evaluate the utility of synthetic data from T2I models on three…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zhang Xiaofeng , Aaron Courville , Michal Drozdzal , Adriana Romero-Soriano

Biological brains learn continually from a stream of unlabeled data, while integrating specialized information from sparsely labeled examples without compromising their ability to generalize. Meanwhile, machine learning methods are…

Machine Learning · Computer Science 2026-01-27 Viet Anh Khoa Tran , Emre Neftci , Willem A. M. Wybo

Infrared-visible image fusion aims to integrate complementary information for robust visual understanding, but existing fusion methods struggle with simultaneously adapting to multiple downstream tasks. To address this issue, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zengyi Yang , Yu Liu , Juan Cheng , Zhiqin Zhu , Yafei Zhang , Huafeng Li

Accurately assessing image complexity (IC) is critical for computer vision, yet most existing methods rely solely on visual features and often neglect high-level semantic information, limiting their accuracy and generalization. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shipeng Liu , Zhonglin Zhang , Dengfeng Chen , Liang Zhao

Text-to-Image (T2I) generation has made significant advancements with the advent of diffusion models. These models exhibit remarkable abilities to produce images based on textual prompts. Current T2I models allow users to specify object…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Muhammad Atif Butt , Kai Wang , Javier Vazquez-Corral , Joost van de Weijer