中文
相关论文

相关论文: PhyGDPO: Physics-Aware Groupwise Direct Preference…

200 篇论文

Aligning text-to-image (T2I) diffusion models with Direct Preference Optimization (DPO) has shown notable improvements in generation quality. However, applying DPO to T2I faces two challenges: the sensitivity of DPO to preference pairs and…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Renjie Chen , Wenfeng Lin , Yichen Zhang , Jiangchuan Wei , Boyuan Liu , Chao Feng , Jiao Ran , Mingyu Guo

Existing generative models for 3D shapes can synthesize high-fidelity and visually plausible shapes. For certain classes of shapes that have undergone an engineering design process, the realism of the shape is tightly coupled with the…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yingxuan You , Chen Zhao , Hantao Zhang , Ming Xu , Pascal Fua

Forecasting multi-step user behavior trajectories requires reasoning over structured preferences across future actions, a challenge overlooked by traditional sequential recommendation. This problem is critical for applications such as…

信息检索 · 计算机科学 2025-11-04 Hongtao Huang , Chengkai Huang , Junda Wu , Tong Yu , Julian McAuley , Lina Yao

A key challenge in music generation models is their lack of direct alignment with human preferences, as music evaluation is inherently subjective and varies widely across individuals. We introduce MR-FlowDPO, a novel approach that enhances…

声音 · 计算机科学 2025-12-16 Alon Ziv , Sanyuan Chen , Andros Tjandra , Yossi Adi , Wei-Ning Hsu , Bowen Shi

Recent advancements in video generation models have significantly improved their ability to follow text prompts. However, the customization of dynamic visual effects, defined as temporally evolving and appearance-driven visual phenomena…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Rui Zhao , Mike Zheng Shou

Fine-tuning pre-trained generative models with Reinforcement Learning (RL) has emerged as an effective approach for aligning outputs more closely with nuanced human preferences. In this paper, we investigate the application of Group…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Matteo Gallici , Haitz Sáez de Ocáriz Borde

Unified models capable of interleaved generation have emerged as a promising paradigm, with the community increasingly converging on autoregressive modeling for text and flow matching for image generation. To advance this direction, we…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Jie Liu , Zilyu Ye , Linxiao Yuan , Shenhan Zhu , Yu Gao , Jie Wu , Kunchang Li , Xionghui Wang , Xiaonan Nie , Weilin Huang , Wanli Ouyang

Recent diffusion-based text-to-image customization methods have achieved significant success in understanding concrete concepts to control generation processes, such as styles and shapes. However, few efforts dive into the realistic yet…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Fan Wu , Cheng Chen , Zhoujie Fu , Jiacheng Wei , Yi Xu , Deheng Ye , Guosheng Lin

Reinforcement learning from human feedback (RLHF) has proven effectiveness for aligning text-to-image (T2I) diffusion models with human preferences. Although Direct Preference Optimization (DPO) is widely adopted for its computational…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Jiamu Bai , Xin Yu , Meilong Xu , Weitao Lu , Xin Pan , Kiwan Maeng , Daniel Kifer , Jian Wang , Yu Wang

Reinforcement learning has emerged as a principled post-training paradigm for Temporal Video Grounding (TVG) due to its on-policy optimization, yet existing GRPO-based methods remain fundamentally constrained by sparse reward signals and…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Jiaze Li , Hao Yin , Haoran Xu , Boshen Xu , Wenhui Tan , Zewen He , Jianzhong Ju , Zhenbo Luo , Jian Luan

Text-to-image (T2I) diffusion models have revolutionized visual content creation, but extending these capabilities to text-to-video (T2V) generation remains a challenge, particularly in preserving temporal consistency. Existing methods that…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Dohun Lee , Bryan S Kim , Geon Yeong Park , Jong Chul Ye

Group Relative Policy Optimization (GRPO) enables stable and preference-oriented updates via group-wise comparisons for post-training video generation. However, GRPO directly optimizes reward-induced advantages. Under sustained…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Rui Li , Yuanzhi Liang , Ziqi Ni , Haibing Huang , Chi Zhang , Xuelong Li

We introduce Talk2Move, a reinforcement learning (RL) based diffusion framework for text-instructed spatial transformation of objects within scenes. Spatially manipulating objects in a scene through natural language poses a challenge for…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Jing Tan , Zhaoyang Zhang , Yantao Shen , Jiarui Cai , Shuo Yang , Jiajun Wu , Wei Xia , Zhuowen Tu , Stefano Soatto

Recent video-language models have shown great potential for video understanding, but still struggle with accurate temporal grounding for event-level perception. We observe that two main factors in video understanding (i.e., temporal…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Wenzheng Zeng , Difei Gao , Mike Zheng Shou , Hwee Tou Ng

4D content generation focuses on creating dynamic 3D objects that change over time. Existing methods primarily rely on pre-trained video diffusion models, utilizing sampling processes or reference videos. However, these approaches face…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Jiajing Lin , Zhenzhong Wang , Yongjie Hou , Yuzhou Tang , Min Jiang

Vision-language models (VLMs) have made significant progress in image classification by training with large-scale paired image-text data. Their performances largely depend on the prompt quality. While recent methods show that visual…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Xiangyan Qu , Gaopeng Gou , Jiamin Zhuang , Jing Yu , Kun Song , Qihao Wang , Yili Li , Gang Xiong

We introduce PhysWorld, a framework that enables robot learning from video generation through physical world modeling. Recent video generation models can synthesize photorealistic visual demonstrations from language commands and images,…

Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the inherent text-dominated nature of VLMs often leads to insufficient visual faithfulness,…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Zengbin Wang , Feng Xiong , Liang Lin , Xuecai Hu , Yong Wang , Yanlin Wang , Man Zhang , Xiangxiang Chu

Existing single-image 3D indoor scene generators often produce results that look visually plausible but fail to obey real-world physics, limiting their reliability in robotics, embodied AI, and design. To examine this gap, we introduce a…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Dongli Wu , Jingyu Hu , Ka-Hei Hui , Xiaobao Wei , Chengwen Luo , Jianqiang Li , Zhengzhe Liu

Group Relative Policy Optimization (GRPO) has recently shown strong performance in post-training large language models and vision-language models. It raises a question of whether the GRPO also significantly promotes the test-time adaptation…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Yujun Li , Hongyuan Zhang , Yuan Yuan