English
Related papers

Related papers: Implicit Style-Content Separation using B-LoRA

200 papers

With the development of generative technologies in deep learning, a large number of image-to-image translation and style transfer models have emerged at an explosive rate in recent years. These two technologies have made significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xiaoming Yu , Jie Tian , Zhenhua Hu

Arbitrary style transfer holds widespread attention in research and boasts numerous practical applications. The existing methods, which either employ cross-attention to incorporate deep style attributes into content attributes or use…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Zhanjie Zhang , Jiakai Sun , Guangyuan Li , Lei Zhao , Quanwei Zhang , Zehua Lan , Haolin Yin , Wei Xing , Huaizhong Lin , Zhiwen Zuo

Blind Image Quality Assessment (BIQA) aims to develop methods that estimate the quality scores of images in the absence of a reference image. In this paper, we approach BIQA from a distortion identification perspective, where our primary…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sepehr Kazemi Ranjbar , Emad Fatemizadeh

Explicitly disentangling style and content in vision models remains challenging due to their semantic overlap and the subjectivity of human perception. Existing methods propose separation through generative or discriminative objectives, but…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Pingchuan Ma , Xiaopei Yang , Yusong Li , Ming Gui , Felix Krause , Johannes Schusterbauer , Björn Ommer

Simply by rearranging the regions of an image, we can create a new image of any subject matter. The definition of regions is user definable, ranging from regularly and irregularly-shaped blocks, concentric rings, or even individual pixels.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Shumeet Baluja , David Marwood , Ashwin Baluja

Arbitrary image style transfer is a challenging task which aims to stylize a content image conditioned on arbitrary style images. In this task the feature-level content-style transformation plays a vital role for proper fusion of features.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Siyu Huang , Haoyi Xiong , Tianyang Wang , Bihan Wen , Qingzhong Wang , Zeyu Chen , Jun Huan , Dejing Dou

This paper introduces a novel framework named D-LORD (Double Latent Optimization for Representation Disentanglement), which is designed for motion stylization (motion style transfer and motion retargeting). The primary objective of this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Meenakshi Gupta , Mingyuan Lei , Tat-Jen Cham , Hwee Kuan Lee

We consider the problem of independently, in a disentangled fashion, controlling the outputs of text-to-image diffusion models with color and style attributes of a user-supplied reference image. We present the first training-free,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Aishwarya Agarwal , Srikrishna Karanam , Balaji Vasan Srinivasan

Low-Rank Adaptation (LoRA) enables parameter-efficient fine-tuning of large models by decomposing weight updates into low-rank matrices, significantly reducing storage and computational overhead. While effective, standard LoRA lacks…

Machine Learning · Computer Science 2026-05-11 Viktar Dubovik , Patryk Marszałek , Jacek Tabor , Tomasz Kuśmierczyk

Fine-tuning models via Low-Rank Adaptation (LoRA) demonstrates remarkable performance in subject-driven or style-driven generation tasks. Studies have explored combinations of different LoRAs to jointly generate learned styles and content.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jia-Chen Zhang , Yu-Jie Xiong

Motion customization aims to adapt the diffusion model (DM) to generate videos with the motion specified by a set of video clips with the same motion concept. To realize this goal, the adaptation of DM should be possible to model the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Huijie Liu , Jingyun Wang , Shuai Ma , Jie Hu , Xiaoming Wei , Guoliang Kang

We propose a controllable style transfer framework based on Implicit Neural Representation that pixel-wisely controls the stylized output via test-time training. Unlike traditional image optimization methods that often suffer from unstable…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Sunwoo Kim , Youngjo Min , Younghun Jung , Seungryong Kim

Subject-driven image generation plays a crucial role in applications such as virtual try-on and poster design. Existing approaches typically fine-tune pretrained generative models or apply LoRA-based adaptations for individual subjects.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Peng Zheng , Ye Wang , Rui Ma , Zuxuan Wu

Arbitrary Style Transfer is a technique used to produce a new image from two images: a content image, and a style image. The newly produced image is unseen and is generated from the algorithm itself. Balancing the structure and style…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Weiting Li , Rahul Vyas , Ramya Sree Penta

Recently, the progress of learning-by-synthesis has proposed a training model for synthetic images, which can effectively reduce the cost of human and material resources. However, due to the different distribution of synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2020-02-17 Yuxiao Yan , Yang Yan , Jinjia Peng , Huibing Wang , Xianping Fu

We describe a method to train a generative model with latent factors that are (approximately) independent and localized. This means that perturbing the latent variables affects only local regions of the synthesized image, corresponding to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yanchao Yang , Yutong Chen , Stefano Soatto

Efficient finetuning of large language models (LLMs) aims to adapt the LLMs with reduced computational and memory cost. Previous LoRA-based approaches initialize the low-rank matrices with Gaussian distribution and zero values while keeping…

Computation and Language · Computer Science 2025-03-04 Hanqing Wang , Yixia Li , Shuo Wang , Guanhua Chen , Yun Chen

Image style transfer is a challenging task in computational vision. Existing algorithms transfer the color and texture of style images by controlling the neural network's feature layers. However, they fail to control the strength of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Junjie Kang , Jinsong Wu , Shiqi Jiang

Low-Rank Adaptation (LoRA) has proven effective in reducing computational costs while maintaining performance comparable to fully fine-tuned foundation models across various tasks. However, its fixed low-rank structure restricts its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Chuyan Zhang , Kefan Wang , Yun Gu

Tuning-free diffusion-based models have demonstrated significant potential in the realm of image personalization and customization. However, despite this notable progress, current models continue to grapple with several complex challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Haofan Wang , Matteo Spinelli , Qixun Wang , Xu Bai , Zekui Qin , Anthony Chen