中文
相关论文

相关论文: PhyGDPO: Physics-Aware Groupwise Direct Preference…

200 篇论文

Video Large Language Models (Video LLMs) have shown impressive performance across a wide range of video-language tasks. However, they often fail in scenarios requiring a deeper understanding of physical dynamics. This limitation primarily…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Yu-Wei Zhan , Xin Wang , Hong Chen , Tongtong Feng , Wei Feng , Ren Wang , Guangyao Li , Qing Li , Wenwu Zhu

Instruction-based video editing aims to modify an input video according to a natural-language instruction while preserving content fidelity and temporal coherence. However, existing diffusion-based approaches are often trained on paired…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Xiaoyan Cong , Haotian Yang , Angtian Wang , Yizhi Wang , Yiding Yang , Canyu Zhang , Chongyang Ma

Aligning large language models (LLMs) with human values and safety constraints is challenging, especially when objectives like helpfulness, truthfulness, and avoidance of harm conflict. Reinforcement Learning from Human Feedback (RLHF) has…

计算与语言 · 计算机科学 2025-03-31 Xuying Li , Zhuo Li , Yuji Kosuga , Victor Bian

While large-scale video diffusion models have demonstrated impressive capabilities in generating high-resolution and semantically rich content, a significant gap remains between their pretraining performance and real-world deployment…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Zeyue Xue , Siming Fu , Jie Huang , Shuai Lu , Haoran Li , Yijun Liu , Yuming Li , Xiaoxuan He , Mengzhao Chen , Haoyang Huang , Nan Duan , Ping Luo

Text-to-3D generation has shown great promise in generating novel 3D content based on given text prompts. However, existing generative methods mostly focus on geometric or visual plausibility while ignoring precise physics perception for…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Qingshan Xu , Jiao Liu , Melvin Wong , Caishun Chen , Yew-Soon Ong

Existing image-to-video generation methods often produce physically implausible motions and lack precise control over object dynamics. While prior approaches have incorporated physics simulators, they remain confined to 2D planar motions…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Tianyidan Xie , Zhentao Huang , Mingjie Wang , Xin Huang , Jun Zhou , Minglun Gong , Zili Yi

Recent advances in Text-to-Video generation (T2V) have achieved remarkable success in synthesizing high-quality general videos from textual descriptions. A largely overlooked problem in T2V is that existing models have not adequately…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Shenghai Yuan , Jinfa Huang , Yujun Shi , Yongqi Xu , Ruijie Zhu , Bin Lin , Xinhua Cheng , Li Yuan , Jiebo Luo

Recent years have seen substantial progress in diffusion-based controllable video generation. However, achieving precise control in complex scenarios, including fine-grained object parts, sophisticated motion trajectories, and coherent…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Haitao Zhou , Chuang Wang , Rui Nie , Jinlin Liu , Dongdong Yu , Qian Yu , Changhu Wang

The emergence of generative models enables the creation of texts and images tailored to users' preferences. Existing personalized generative models have two critical limitations: lacking a dedicated paradigm for accurate preference…

信息检索 · 计算机科学 2026-04-23 Yuting Zhang , Ying Sun , Dazhong Shen , Ziwei Xie , Feng Liu , Changwang Zhang , Xiang Liu , Jun Wang , Hui Xiong

In this paper, we introduce FedMGP, a new paradigm for personalized federated prompt learning in vision-language models. FedMGP equips each client with multiple groups of paired textual and visual prompts, enabling the model to capture…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Weihao Bo , Yanpeng Sun , Yu Wang , Xinyu Zhang , Zechao Li

Personalized diffusion models have shown remarkable success in Text-to-Image (T2I) generation by enabling the injection of user-defined concepts into diverse contexts. However, balancing concept fidelity with contextual alignment remains a…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Shamil Ayupov , Maksim Nakhodnov , Anastasia Yaschenko , Andrey Kuznetsov , Aibek Alanov

Large vision-language models (LVLMs) often fail to align with human preferences, leading to issues like generating misleading content without proper visual context (also known as hallucination). A promising solution to this problem is using…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Chenglong Wang , Yang Gan , Yifu Huo , Yongyu Mu , Murun Yang , Qiaozhi He , Tong Xiao , Chunliang Zhang , Tongran Liu , Quan Du , Di Yang , Jingbo Zhu

Reinforcement learning with verifiable rewards (RLVR) has become a practical route to improve large language model reasoning, and Group Relative Policy Optimization (GRPO) is a widely used optimizer in this setting. However, RLVR training…

机器学习 · 计算机科学 2026-05-14 Tue Le , Linh Ngo Van , Trung Le

A primary bottleneck in large-scale text-to-video generation today is physical consistency and controllability. Despite recent advances, state-of-the-art models often produce unrealistic motions, such as objects falling upward, or abrupt…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Yu Yuan , Xijun Wang , Tharindu Wickremasinghe , Zeeshan Nadir , Bole Ma , Stanley H. Chan

A critical component of the current generation of language models is preference alignment, which aims to precisely control the model's behavior to meet human needs and values. The most notable among such methods is Reinforcement Learning…

人工智能 · 计算机科学 2024-10-22 Oh Joon Kwon , Daiki E. Matsunaga , Kee-Eung Kim

Recent progress in text-to-video (T2V) generation has enabled the synthesis of visually compelling and temporally coherent videos from natural language. However, these models often fall short in basic physical commonsense, producing outputs…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Enes Sanli , Baris Sarper Tezcan , Aykut Erdem , Erkut Erdem

RLHF techniques like DPO can significantly improve the generation quality of text-to-image diffusion models. However, these methods optimize for a single reward that aligns model generation with population-level preferences, neglecting the…

机器学习 · 计算机科学 2025-01-14 Meihua Dang , Anikait Singh , Linqi Zhou , Stefano Ermon , Jiaming Song

Video generation models have achieved remarkable progress in creating high-quality, photorealistic content. However, their ability to accurately simulate physical phenomena remains a critical and unresolved challenge. This paper presents…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Jing Gu , Xian Liu , Yu Zeng , Ashwin Nagarajan , Fangrui Zhu , Daniel Hong , Yue Fan , Qianqi Yan , Kaiwen Zhou , Ming-Yu Liu , Xin Eric Wang

This is a short technical report describing the winning entry of the PhysicsIQ Challenge, presented at the Perception Test Workshop at ICCV 2025. State-of-the-art video generative models exhibit severely limited physical understanding, and…

The practical applications of diffusion models have been limited by the misalignment between generated images and corresponding text prompts. Recent studies have introduced direct preference optimization (DPO) to enhance the alignment of…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Zijing Hu , Fengda Zhang , Kun Kuang