English
Related papers

Related papers: MuseumMaker: Continual Style Customization without…

200 papers

Art reinterpretation is the practice of creating a variation of a reference work, making a paired artwork that exhibits a distinct artistic style. We ask if such an image pair can be used to customize a generative model to capture the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Maxwell Jones , Sheng-Yu Wang , Nupur Kumari , David Bau , Jun-Yan Zhu

Recent progresses in large-scale text-to-image models have yielded remarkable accomplishments, finding various applications in art domain. However, expressing unique characteristics of an artwork (e.g. brushwork, colortone, or composition)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Namhyuk Ahn , Junsoo Lee , Chunggi Lee , Kunhee Kim , Daesik Kim , Seung-Hun Nam , Kibeom Hong

Customization generation techniques have significantly advanced the synthesis of specific concepts across varied contexts. Multi-concept customization emerges as the challenging task within this domain. Existing approaches often rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yang Yang , Wen Wang , Liang Peng , Chaotian Song , Yao Chen , Hengjia Li , Xiaolong Yang , Qinglin Lu , Deng Cai , Boxi Wu , Wei Liu

Despite the burst of innovative methods for controlling the diffusion process, effectively controlling image styles in text-to-image generation remains a challenging task. Many adapter-based methods impose image representation conditions on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wen Li , Muyuan Fang , Cheng Zou , Biao Gong , Ruobing Zheng , Meng Wang , Jingdong Chen , Ming Yang

Large language models (LLMs) suffer from catastrophic forgetting during continual learning. Conventional rehearsal-based methods rely on previous training data to retain the model's ability, which may not be feasible in real-world…

Computation and Language · Computer Science 2024-05-28 Jianheng Huang , Leyang Cui , Ante Wang , Chengyi Yang , Xinting Liao , Linfeng Song , Junfeng Yao , Jinsong Su

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

The customization of text-to-image models has seen significant advancements, yet generating multiple personalized concepts remains a challenging task. Current methods struggle with attribute leakage and layout confusion when handling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zebin Yao , Fangxiang Feng , Ruifan Li , Xiaojie Wang

Incremental class learning, a scenario in continual learning context where classes and their training data are sequentially and disjointedly observed, challenges a problem widely known as catastrophic forgetting. In this work, we propose a…

Machine Learning · Computer Science 2019-07-19 Euntae Choi , Kyungmi Lee , Kiyoung Choi

With the increasing popularity of deep learning on edge devices, compressing large neural networks to meet the hardware requirements of resource-constrained devices became a significant research direction. Numerous compression methodologies…

Machine Learning · Computer Science 2022-01-11 Kuluhan Binici , Nam Trung Pham , Tulika Mitra , Karianto Leman

As deep learning models grow in complexity and the volume of training data increases, reducing storage and computational costs becomes increasingly important. Dataset distillation addresses this challenge by synthesizing a compact set of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhe Li , Sarah Cechnicka , Cheng Ouyang , Katharina Breininger , Peter Schüffler , Bernhard Kainz

Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mengyao Cui , Zhe Zhu , Shao-Ping Lu , Yulu Yang

The recent proliferation of large-scale text-to-image models has led to growing concerns that such models may be misused to generate harmful, misleading, and inappropriate content. Motivated by this issue, we derive a technique inspired by…

Machine Learning · Computer Science 2023-10-18 Alvin Heng , Harold Soh

Personalized text-to-image generation aims to synthesize novel images of a specific subject or style using only a few reference images. Recent methods based on Low-Rank Adaptation (LoRA) enable efficient single-concept customization by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuqi Peng , Lingtao Zheng , Yufeng Yang , Yi Huang , Mingfu Yan , Jianzhuang Liu , Shifeng Chen

Recent years have witnessed significant advancements in text-guided style transfer, primarily attributed to innovations in diffusion models. These models excel in conditional guidance, utilizing text or images to direct the sampling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Nisha Huang , Kaer Huang , Yifan Pu , Jiangshan Wang , Jie Guo , Yiqiang Yan , Xiu Li , Tong-Yee Lee

Text-to-video (T2V) models have shown remarkable capabilities in generating diverse videos. However, they struggle to produce user-desired stylized videos due to (i) text's inherent clumsiness in expressing specific styles and (ii) the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Gongye Liu , Menghan Xia , Yong Zhang , Haoxin Chen , Jinbo Xing , Yibo Wang , Xintao Wang , Yujiu Yang , Ying Shan

Artistic style transfer aims to transfer the style of an artwork to a photograph while maintaining its original overall content. Many prior works focus on designing various transfer modules to transfer the style statistics to the content…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yueming Lyu , Yue Jiang , Bo Peng , Jing Dong

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

Computation and Language · Computer Science 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Catastrophic forgetting is a significant challenge in continual learning, in which a model loses prior knowledge when it is fine-tuned on new tasks. This problem is particularly critical for large language models (LLMs) undergoing continual…

Computation and Language · Computer Science 2025-09-03 Ege Süalp , Mina Rezaei

Customized video generation aims to generate high-quality videos guided by text prompts and subject's reference images. However, since it is only trained on static images, the fine-tuning process of subject learning disrupts abilities of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Tao Wu , Yong Zhang , Xintao Wang , Xianpan Zhou , Guangcong Zheng , Zhongang Qi , Ying Shan , Xi Li

Learning a set of tasks over time, also known as continual learning (CL), is one of the most challenging problems in artificial intelligence due to catastrophic forgetting. Large language models (LLMs) are often impractical to frequent…

Machine Learning · Computer Science 2025-10-28 Jaya Krishna Mandivarapu