English
Related papers

Related papers: Don't Let It Fade: Preserving Edits in Diffusion L…

200 papers

Drawing upon recent advances in language model alignment, we formulate offline Reinforcement Learning as a two-stage optimization problem: First pretraining expressive generative policies on reward-free behavior datasets, then fine-tuning…

Machine Learning · Computer Science 2024-10-31 Huayu Chen , Kaiwen Zheng , Hang Su , Jun Zhu

Diffusion models have emerged as a powerful paradigm for generative sequential recommendation, which typically generate next items to recommend guided by user interaction histories with a multi-step denoising process. However, the…

Information Retrieval · Computer Science 2025-10-23 Wenyu Mao , Jiancan Wu , Guoqing Hu , Zhengyi Yang , Wei Ji , Xiang Wang

Large language models have achieved remarkable success under the autoregressive paradigm, yet high-quality text generation need not be tied to a fixed left-to-right order. Existing alternatives still struggle to jointly achieve generation…

Computation and Language · Computer Science 2026-05-08 Hongcan Guo , Qinyu Zhao , Yian Zhao , Shen Nie , Rui Zhu , Qiushan Guo , Feng Wang , Tao Yang , Hengshuang Zhao , Guoqiang Wei , Yan Zeng

Test-time adaptation (TTA) enables a pre-trained model to adapt online to an unlabeled test stream under distribution shift. While most TTA research focuses on the adaptation objective, practical streams also depend critically on the memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Shyma Alhuwaider , Yasmeen Alsaedy , Merey Ramazanova , Silvio Giancola , Bernard Ghanem

Large language models (LLMs) are revolutionizing conversational recommender systems by adeptly indexing item content, understanding complex conversational contexts, and generating relevant item titles. However, controlling the distribution…

Information Retrieval · Computer Science 2024-05-21 Zhankui He , Zhouhang Xie , Harald Steck , Dawen Liang , Rahul Jha , Nathan Kallus , Julian McAuley

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Vision-Language Models (VLMs) have become essential backbones of modern multimodal intelligence, yet their outputs remain prone to hallucination-plausible text misaligned with visual inputs. Existing alignment approaches often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Kejia Chen , Jiawen Zhang , Jiacong Hu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song

Multimodal Diffusion Transformers (MM-DiTs) have achieved remarkable progress in text-driven visual generation. However, even state-of-the-art MM-DiT models like FLUX struggle with achieving precise alignment between text prompts and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Zhengyao Lv , Tianlin Pan , Chenyang Si , Zhaoxi Chen , Wangmeng Zuo , Ziwei Liu , Kwan-Yee K. Wong

Text-to-audio (TTA) generation is a recent popular problem that aims to synthesize general audio given text descriptions. Previous methods utilized latent diffusion models to learn audio embedding in a latent space with text embedding as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shentong Mo , Jing Shi , Yapeng Tian

Text-to-video editing aims to edit the visual appearance of a source video conditional on textual prompts. A major challenge in this task is to ensure that all frames in the edited video are visually consistent. Most recent works apply…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Yuren Cong , Mengmeng Xu , Christian Simon , Shoufa Chen , Jiawei Ren , Yanping Xie , Juan-Manuel Perez-Rua , Bodo Rosenhahn , Tao Xiang , Sen He

Diffusion Language Models (DLMs) have emerged as a compelling alternative to autoregressive approaches, enabling parallel text generation with competitive performance. Despite these advantages, there is a critical instability in DLMs: the…

Computation and Language · Computer Science 2026-02-24 Zihou Zhang , Zheyong Xie , Li Zhong , Haifeng Liu , Yao Hu , Shaosheng Cao

Diffusion large language models (dLLMs) offer a promising paradigm for parallel text generation, but in practice they face an accuracy-parallelism trade-off, where increasing tokens per forward (TPF) often degrades generation quality.…

Computation and Language · Computer Science 2026-05-12 Haoyang Zhou , Li Kong , Shijie Ren , Xiting Wang , Shuang Liang , Guowei Wang , Zhenxuan Pan

Generative recommendation represents each item as a semantic ID, i.e., a sequence of discrete tokens, and generates the next item through autoregressive decoding. While effective, existing autoregressive models face two intrinsic…

Information Retrieval · Computer Science 2025-11-12 Teng Shi , Chenglei Shen , Weijie Yu , Shen Nie , Chongxuan Li , Xiao Zhang , Ming He , Yan Han , Jun Xu

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

Machine Learning · Computer Science 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang

Diffusion Transformers (DiT) have become the dominant methods in image and video generation yet still suffer substantial computational costs. As an effective approach for DiT acceleration, feature caching methods are designed to cache the…

Machine Learning · Computer Science 2025-11-19 Chang Zou , Evelyn Zhang , Runlin Guo , Haohang Xu , Conghui He , Xuming Hu , Linfeng Zhang

Vision-language foundation models (VLMs), such as CLIP, exhibit remarkable performance across a wide range of tasks. However, deploying these models can be unreliable when significant distribution gaps exist between training and test data,…

Machine Learning · Computer Science 2025-09-29 Zongbo Han , Jialong Yang , Guangyu Wang , Junfan Li , Qianli Xu , Mike Zheng Shou , Changqing Zhang

With the rapid development of conditional diffusion models, significant progress has been made in text-to-video generation. However, we observe that these models often neglect semantically important tokens during inference, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Guoqing Zhang , Lu Shi , Wanru Xu , Linna Zhang , Sen Wang , Fangfang Wang , Yigang Cen

While Diffusion Models excel in text-to-image synthesis, they often suffer from concept omission when synthesizing complex multi-instance scenes. Existing training-free methods attempt to resolve this by rescaling attention maps, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Zitong Wang , Zijun Shen , Haohao Xu , Zhengjie Luo , Weibin Wu

This paper presents a method to accelerate the inference process of diffusion transformer (DiT)-based text-to-speech (TTS) models by applying a selective caching mechanism to transformer layers. Specifically, I integrate SmoothCache into…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-11 Siratish Sakpiboonchit

Large language models (LLMs) augmented with retrieval systems have significantly advanced natural language processing tasks by integrating external knowledge sources, enabling more accurate and contextually rich responses. To improve the…

Computation and Language · Computer Science 2025-05-28 Xin Sun , Jianan Xie , Zhongqi Chen , Qiang Liu , Shu Wu , Yuehe Chen , Bowen Song , Weiqiang Wang , Zilei Wang , Liang Wang