English
Related papers

Related papers: ID-LoRA: Identity-Driven Audio-Video Personalizati…

200 papers

Diffusion models have demonstrated remarkable efficacy across various image-to-image tasks. In this research, we introduce Imagine yourself, a state-of-the-art model designed for personalized image generation. Unlike conventional…

Recent text-to-audio generation techniques have the potential to allow novice users to freely generate music audio. Even if they do not have musical knowledge, such as about chord progressions and instruments, users can try various text…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-26 Hiromu Yakura , Masataka Goto

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach…

Computation and Language · Computer Science 2023-12-06 Xiaoqian Li , Ercong Nie , Sheng Liang

Prompt-based all-in-one image restoration (IR) frameworks have achieved remarkable performance by incorporating degradation-specific information into prompt modules. Nevertheless, handling the complex and diverse degradations encountered in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yuang Ai , Huaibo Huang , Ran He

Person re-identification (ReID) has evolved from handcrafted feature-based methods to deep learning approaches and, more recently, to models incorporating large language models (LLMs). Early methods struggled with variations in lighting,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Amran Bhuiyan , Mizanur Rahman , Md Tahmid Rahman Laskar , Aijun An , Jimmy Xiangji Huang

As deep learning technology continues to advance, image generation models, especially models like Stable Diffusion, are finding increasingly widespread application in visual arts creation. However, these models often face challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Chengcheng Feng , Mu He , Qiuyu Tian , Haojie Yin , Xiaofang Zhao , Hongwei Tang , Xingqiang Wei

Personalized dialogue systems have gained significant attention in recent years for their ability to generate responses in alignment with different personas. However, most existing approaches rely on pre-defined personal profiles, which are…

Computation and Language · Computer Science 2024-10-15 Chuanqi Cheng , Quan Tu , Shuo Shang , Cunli Mao , Zhengtao Yu , Wei Wu , Rui Yan

Identity-Preserving Personalized Generation (IPPG) has advanced film production and artistic creation, yet existing approaches overemphasize facial regions, resulting in outputs dominated by facial close-ups.These methods suffer from weak…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Songsong Zhang , Chuanqi Tang , Hongguang Zhang , Guijian Tang , Minglong Li , Xueqiong Li , Shaowu Yang , Yuanxi Peng , Wenjing Yang , Jing Zhao

Speech sound disorder is among the most common communication challenges in preschool children. Home-based practice is essential for effective therapy and for acquiring generalization of target sounds, yet sustaining engaging and consistent…

Human-Computer Interaction · Computer Science 2025-10-29 Sumin Hong , Xavier Briggs , Qingxiao Zheng , Yao Du , Jinjun Xiong , Toby Jia-jun Li

Lip reading aims to predict spoken language by analyzing lip movements. Despite advancements in lip reading technologies, performance degrades when models are applied to unseen speakers due to their sensitivity to variations in visual…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jeong Hun Yeo , Chae Won Kim , Hyunjun Kim , Hyeongseop Rha , Seunghee Han , Wen-Huang Cheng , Yong Man Ro

Continual Learning (CL) with foundation models has recently emerged as a promising paradigm to exploit abundant knowledge acquired during pre-training for tackling sequential tasks. However, existing prompt-based and Low-Rank…

Machine Learning · Computer Science 2025-03-10 Yichen Wu , Hongming Piao , Long-Kai Huang , Renzhen Wang , Wanhua Li , Hanspeter Pfister , Deyu Meng , Kede Ma , Ying Wei

Previous in-context learning (ICL) research has focused on tasks such as classification, machine translation, text2table, etc., while studies on whether ICL can improve human-like dialogue generation are scarce. Our work fills this gap by…

Computation and Language · Computer Science 2024-02-20 Jiashu Pu , Yajing Wan , Yuru Zhang , Jing Chen , Ling Cheng , Qian Shao , Yongzhu Chang , Tangjie Lv , Rongsheng Zhang

Fine-tuning large-scale pretrained models is prohibitively expensive in terms of computational and memory costs. LoRA, as one of the most popular Parameter-Efficient Fine-Tuning (PEFT) methods, offers a cost-effective alternative by…

Machine Learning · Computer Science 2024-07-17 Shaowen Wang , Linxi Yu , Jian Li

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

Generating high-quality and temporally synchronized audio from video content is essential for video editing and post-production tasks, enabling the creation of semantically aligned audio for silent videos. However, most existing approaches…

Sound · Computer Science 2025-08-18 Haomin Zhang , Kristin Qi , Shuxin Yang , Zihao Chen , Chaofan Ding , Xinhan Di

Low-Rank Adaptation (LoRA) is extensively utilized in text-to-image models for the accurate rendition of specific elements like distinct characters or unique styles in generated images. Nonetheless, existing methods face challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Zhong , Yelong Shen , Shuohang Wang , Yadong Lu , Yizhu Jiao , Siru Ouyang , Donghan Yu , Jiawei Han , Weizhu Chen

Video editing-based talking face generation aims to preserve video details such as pose, lighting, and gestures while modifying only lip motion, often using an identity reference image to maintain speaker consistency. However, this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Dogucan Yaman , Fevziye Irem Eyiokur , Hazım Kemal Ekenel , Alexander Waibel

Significant advances have been made in human-centric video generation, yet the joint video-depth generation problem remains underexplored. Most existing monocular depth estimation methods may not generalize well to synthesized images or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yuanhao Zhai , Kevin Lin , Linjie Li , Chung-Ching Lin , Jianfeng Wang , Zhengyuan Yang , David Doermann , Junsong Yuan , Zicheng Liu , Lijuan Wang

Long input sequences are central to in-context learning, document understanding, and multi-step reasoning of Large Language Models (LLMs). However, the quadratic attention cost of Transformers makes inference memory-intensive and slow.…

Computation and Language · Computer Science 2026-02-19 Rujikorn Charakorn , Edoardo Cetin , Shinnosuke Uesaka , Robert Tjarko Lange

Low-Rank Adaptation (LoRA) has demonstrated strong generalization capabilities across a variety of tasks for efficiently fine-tuning AI models, especially on resource-constrained edges. However, in real-world applications, edge users often…

Machine Learning · Computer Science 2025-09-16 Miaoge Li , Yang Chen , Zhijie Rao , Can Jiang , Jingcai Guo