中文
相关论文

相关论文: McSc: Motion-Corrective Preference Alignment for V…

200 篇论文

Recent advancements in personalized Text-to-Video (T2V) generation have made significant strides in synthesizing character-specific content. However, these methods face a critical limitation: the inability to perform fine-grained control…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Haopeng Fang , Di Qiu , Binjie Mao , He Tang

Although video multimodal large language models (video MLLMs) have achieved substantial progress in video captioning tasks, it remains challenging to adjust the focal emphasis of video captions according to human preferences. To address…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Jiyang Tang , Hengyi Li , Yifan Du , Wayne Xin Zhao

Recent great advances in video generation models have demonstrated their potential to produce high-quality videos, bringing challenges to effective evaluation. Unlike human evaluation, existing automated evaluation metrics lack highlevel…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Zhun Mou , Bin Xia , Zhengchao Huang , Wenming Yang , Jiaya Jia

Inspired by advances in LLMs, reasoning-enhanced sequential recommendation performs multi-step deliberation before making final predictions, unlocking greater potential for capturing user preferences. However, current methods are…

信息检索 · 计算机科学 2025-12-17 Yifan Shao , Peilin Zhou , Shoujin Wang , Weizhi Zhang , Xu Cai , Sunghun Kim

The current text-to-video (T2V) generation has made significant progress in synthesizing realistic general videos, but it is still under-explored in identity-specific human video generation with customized ID images. The key challenge lies…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Hengjia Li , Haonan Qiu , Shiwei Zhang , Xiang Wang , Yujie Wei , Zekun Li , Yingya Zhang , Boxi Wu , Deng Cai

Human preference alignment presents a critical yet underexplored challenge for diffusion models in text-to-3D generation. Existing solutions typically require task-specific fine-tuning, posing significant hurdles in data-scarce 3D domains.…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Jiaqi Leng , Shuyuan Tu , Haidong Cao , Sicheng Xie , Daoguo Dong , Zuxuan Wu , Yu-Gang Jiang

The current reward learning from human preferences could be used to resolve complex reinforcement learning (RL) tasks without access to a reward function by defining a single fixed preference between pairs of trajectory segments. However,…

人工智能 · 计算机科学 2020-12-29 Zehong Cao , KaiChiu Wong , Chin-Teng Lin

Current metrics for text-to-image models typically rely on statistical metrics which inadequately represent the real preference of humans. Although recent work attempts to learn these preferences via human annotated images, they reduce the…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Sixian Zhang , Bohan Wang , Junqiang Wu , Yan Li , Tingting Gao , Di Zhang , Zhongyuan Wang

We present LongVPO, a novel two-stage Direct Preference Optimization framework that enables short-context vision-language models to robustly understand ultra-long videos without any long-video annotations. In Stage 1, we synthesize…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Zhenpeng Huang , Jiaqi Li , Zihan Jia , Xinhao Li , Desen Meng , Lingxue Song , Xi Chen , Liang Li , Limin Wang

We present an approach to robot learning from egocentric human videos by modeling human preferences in a reward function and optimizing robot behavior to maximize this reward. Prior work on reward learning from human videos attempts to…

机器人学 · 计算机科学 2026-02-13 Mrinal Verghese , Christopher G. Atkeson

Existing text-to-video (T2V) models often struggle with generating videos with sufficiently pronounced or complex actions. A key limitation lies in the text prompt's inability to precisely convey intricate motion details. To address this,…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Qiang Zhou , Shaofeng Zhang , Nianzu Yang , Ye Qian , Hao Li

While text-to-3D generation has attracted growing interest, existing methods often struggle to produce 3D assets that align well with human preferences. Current preference alignment techniques for 3D content typically rely on…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Xiandong Zou , Ruihao Xia , Hongsong Wang , Pan Zhou

We present a method for multi-concept customization of pretrained text-to-video (T2V) models. Intuitively, the multi-concept customized video can be derived from the (non-linear) intersection of the video manifolds of the individual…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Divya Kothandaraman , Kihyuk Sohn , Ruben Villegas , Paul Voigtlaender , Dinesh Manocha , Mohammad Babaeizadeh

Video large language models (Video LLMs) achieve strong benchmark accuracy, yet often answer video questions through shortcuts such as single-frame cues and language priors rather than by tracking spatiotemporal dynamics. This issue is…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Dazhao Du , Jian Liu , Jialong Qin , Tao Han , Bohai Gu , Fangqi Zhu , Yujia Zhang , Eric Liu , Xi Chen , Song Guo

Recent advances in generative super-resolution (SR) have greatly improved visual realism, yet existing evaluation and optimization frameworks remain misaligned with human perception. Full-Reference and No-Reference metrics often fail to…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Yushuai Song , Weize Quan , Weining Wang , Jiahui Sun , Jing Liu , Meng Li , Pengbin Yu , Zhentao Chen , Wei Shen , Lunxi Yuan , Dong-ming Yan

Human preference alignment is critical in building powerful and reliable large language models (LLMs). However, current methods either ignore the multi-dimensionality of human preferences (e.g. helpfulness and harmlessness) or struggle with…

机器学习 · 计算机科学 2024-10-14 Xingzhou Lou , Junge Zhang , Jian Xie , Lifeng Liu , Dong Yan , Kaiqi Huang

Recent studies have demonstrated significant progress in aligning text-to-image diffusion models with human preference via Reinforcement Learning from Human Feedback. However, while existing methods achieve high scores on automated reward…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Chubin Chen , Sujie Hu , Jiashu Zhu , Meiqi Wu , Jintao Chen , Yanxun Li , Nisha Huang , Chengyu Fang , Jiahong Wu , Xiangxiang Chu , Xiu Li

The wide popularity of short videos on social media poses new opportunities and challenges to optimize recommender systems on the video-sharing platforms. Users provide complex and multi-faceted responses towards recommendations, including…

机器学习 · 计算机科学 2022-05-27 Qingpeng Cai , Ruohan Zhan , Chi Zhang , Jie Zheng , Guangwei Ding , Pinghua Gong , Dong Zheng , Peng Jiang

Large-scale pre-trained diffusion models have exhibited remarkable capabilities in diverse video generations. Given a set of video clips of the same motion concept, the task of Motion Customization is to adapt existing text-to-video…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Rui Zhao , Yuchao Gu , Jay Zhangjie Wu , David Junhao Zhang , Jiawei Liu , Weijia Wu , Jussi Keppo , Mike Zheng Shou

Measuring alignment between language and vision is a fundamental challenge, especially as multimodal data becomes increasingly detailed and complex. Existing methods often rely on collecting human or AI preferences, which can be costly and…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Hyojin Bahng , Caroline Chan , Fredo Durand , Phillip Isola