English
Related papers

Related papers: Taming Encoder for Zero Fine-tuning Image Customiz…

200 papers

The availability of data is limited in some fields, especially for object detection tasks, where it is necessary to have correctly labeled bounding boxes around each object. A notable example of such data scarcity is found in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Matteo Paiano , Stefano Martina , Carlotta Giannelli , Filippo Caruso

In the realm of image generation, creating customized images from visual prompt with additional textual instruction emerges as a promising endeavor. However, existing methods, both tuning-based and tuning-free, struggle with interpreting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Jing He , Haodong Li , Yongzhe Hu , Guibao Shen , Yingjie Cai , Weichao Qiu , Ying-Cong Chen

Image captioning model is a cross-modality knowledge discovery task, which targets at automatically describing an image with an informative and coherent sentence. To generate the captions, the previous encoder-decoder frameworks directly…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Ziwei Wang , Yadan Luo , Zi Huang

Detection of objects in cluttered indoor environments is one of the key enabling functionalities for service robots. The best performing object detection approaches in computer vision exploit deep Convolutional Neural Networks (CNN) to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Georgios Georgakis , Arsalan Mousavian , Alexander C. Berg , Jana Kosecka

Since the generative neural networks have made a breakthrough in the image generation problem, lots of researches on their applications have been studied such as image restoration, style transfer and image completion. However, there has…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Jeesoo Kim , Jangho Kim , Jaeyoung Yoo , Daesik Kim , Nojun Kwak

Text-to-image generation models represent the next step of evolution in image synthesis, offering a natural way to achieve flexible yet fine-grained control over the result. One emerging area of research is the fast adaptation of large…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Anton Voronov , Mikhail Khoroshikh , Artem Babenko , Max Ryabinin

Model customization introduces new concepts to existing text-to-image models, enabling the generation of these new concepts/objects in novel contexts. However, such methods lack accurate camera view control with respect to the new object,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Nupur Kumari , Grace Su , Richard Zhang , Taesung Park , Eli Shechtman , Jun-Yan Zhu

Language-guided image generation has achieved great success nowadays by using diffusion models. However, texts can be less detailed to describe highly-specific subjects such as a particular dog or a certain car, which makes pure…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yiyang Ma , Huan Yang , Wenjing Wang , Jianlong Fu , Jiaying Liu

Synthesizing photo-realistic images from text descriptions is a challenging problem. Previous studies have shown remarkable progresses on visual quality of the generated images. In this paper, we consider semantics from the input text…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Guojun Yin , Bin Liu , Lu Sheng , Nenghai Yu , Xiaogang Wang , Jing Shao

Generating images from semantic visual knowledge is a challenging task, that can be useful to condition the synthesis process in complex, subtle, and unambiguous ways, compared to alternatives such as class labels or text descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Renato Sortino , Simone Palazzo , Concetto Spampinato

Diffusion models (DMs) have recently gained attention with state-of-the-art performance in text-to-image synthesis. Abiding by the tradition in deep learning, DMs are trained and evaluated on the images with fixed sizes. However, users are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zhiyu Jin , Xuli Shen , Bin Li , Xiangyang Xue

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Phillip Mueller , Jannik Wiese , Ioan Craciun , Lars Mikelsons

The recent success of the generative model shows that leveraging the multi-modal embedding space can manipulate an image using text information. However, manipulating an image with other sources rather than text, such as sound, is not easy…

Graphics · Computer Science 2021-12-02 Seung Hyun Lee , Wonseok Roh , Wonmin Byeon , Sang Ho Yoon , Chan Young Kim , Jinkyu Kim , Sangpil Kim

Generating a photorealistic image with intended human pose is a promising yet challenging research topic for many applications such as smart photo editing, movie making, virtual try-on, and fashion display. In this paper, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Wei Sun , Jawadul H. Bappy , Shanglin Yang , Yi Xu , Tianfu Wu , Hui Zhou

Inspired by the software industry's practice of offering different editions or versions of a product tailored to specific user groups or use cases, we propose a novel task, namely, training-free editioning, for text-to-image models.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Jinqi Wang , Yunfei Fu , Zhangcan Ding , Bailin Deng , Yu-Kun Lai , Yipeng Qin

Personalized image generative models are highly proficient at synthesizing images from text or a single image, yet they lack explicit control for composing objects from specific parts of multiple source images without user specified masks…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Shivam Singh , Yiming Chen , Agneet Chatterjee , Amit Raj , James Hays , Yezhou Yang , Chitta Baral

Image harmonization is an important step in photo editing to achieve visual consistency in composite images by adjusting the appearances of foreground to make it compatible with background. Previous approaches to harmonize composites are…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Konstantin Sofiiuk , Polina Popenova , Anton Konushin

Benefited from the deep learning, image Super-Resolution has been one of the most developing research fields in computer vision. Depending upon whether using a discriminator or not, a deep convolutional neural network can provide an image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Zhi-Song Liu , Wan-Chi Siu , Li-Wen Wang , Chu-Tak Li , Marie-Paule Cani , Yui-Lam Chan

The remarkable advancement in text-to-image generation models significantly boosts the research in ID customization generation. However, existing personalization methods cannot simultaneously satisfy high fidelity and high-efficiency…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Peng Xing , Ning Wang , Jianbo Ouyang , Zechao Li

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu