中文
相关论文

相关论文: Diverse Video Generation with Determinantal Point …

200 篇论文

Multi-subject personalized image generation aims to synthesize customized images containing multiple specified subjects without requiring test-time optimization. However, achieving fine-grained independent control over multiple subjects…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Qiaoqiao Jin , Siming Fu , Dong She , Weinan Jia , Hualiang Wang , Mu Liu , Jidong Jiang

Generating future frames given a few context (or past) frames is a challenging task. It requires modeling the temporal coherence of videos and multi-modality in terms of diversity in the potential future states. Current variational…

计算机视觉与模式识别 · 计算机科学 2021-07-13 Gaurav Shrivastava , Abhinav Shrivastava

With the rapid development of AIGC technology, significant progress has been made in diffusion model-based technologies for text-to-image (T2I) and text-to-video (T2V). In recent years, a few studies have introduced the strategy of Direct…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Lifan Jiang , Boxi Wu , Jiahui Zhang , Xiaotong Guan , Shuang Chen

3D generation has rapidly accelerated in the past decade owing to the progress in the field of generative modeling. Score Distillation Sampling (SDS) based rendering has improved 3D asset generation to a great extent. Further, the recent…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Aradhya N. Mathur , Phu Pham , Aniket Bera , Ojaswa Sharma

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a promising framework for enhancing the reasoning capabilities of large language models. However, existing approaches such as GRPO often suffer from zero gradients. This…

计算与语言 · 计算机科学 2025-09-09 Shihui Yang , Chengfeng Dou , Peidong Guo , Kai Lu , Qiang Ju , Fei Deng , Rihui Xin

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding generation in external knowledge, yielding relevance responses that are aligned with factual evidence and evolving corpora. Standard RAG pipelines…

机器学习 · 计算机科学 2026-04-07 Xun Sun , Baiheng Xie , Li Huang , Qiang Gao

Group-advantage-based reinforcement learning methods, such as GRPO and DAPO, have demonstrated strong performance across diverse domains, including mathematical reasoning and text-to-image generation. However, their reliance on sample-level…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Shufan Li , Konstantinos Kallidromitis , Akash Gokul Yusuke Kato , Kazuki Kozuka , Aditya Grover

Predicting multiple trajectories for road users is important for automated driving systems: ego-vehicle motion planning indeed requires a clear view of the possible motions of the surrounding agents. However, the generative models used for…

机器学习 · 计算机科学 2023-02-08 Laura Calem , Hedi Ben-Younes , Patrick Pérez , Nicolas Thome

Applying Reinforcement Learning (RL) to Video Large Language Models (Video-LLMs) shows significant promise for complex video reasoning. However, popular Reinforcement Fine-Tuning (RFT) methods, such as outcome-based Group Relative Policy…

计算与语言 · 计算机科学 2025-05-27 Yunxin Li , Xinyu Chen , Zitao Li , Zhenyu Liu , Longyue Wang , Wenhan Luo , Baotian Hu , Min Zhang

Generating safety-critical driving scenarios is crucial for evaluating and improving autonomous driving systems, but long-tail risky situations are rarely observed in real-world data and difficult to specify through manual scenario design.…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Hongyi Lin , Wenxiu Shi , Heye Huang , Dingyi Zhuang , Song Zhang , Yang Liu , Xiaobo Qu , Jinhua Zhao

A determinantal point process (DPP) is a random process useful for modeling the combinatorial problem of subset selection. In particular, DPPs encourage a random subset Y to contain a diverse set of items selected from a base set Y. For…

机器学习 · 计算机科学 2012-10-19 Raja Hafiz Affandi , Alex Kulesza , Emily B. Fox

Text-to-video generation is expensive, so only a few samples are typically produced per prompt. In this low-sample regime, maximizing the value of each batch requires high cross-video diversity. Recent methods improve diversity for image…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Xinshuang Liu , Runfa Blark Li , Truong Nguyen

The incorporation of online reinforcement learning (RL) into diffusion and flow-based generative models has recently gained attention as a powerful paradigm for aligning model behavior with human preferences. By leveraging stochastic…

机器学习 · 计算机科学 2025-11-25 Yujie Zhou , Pengyang Ling , Jiazi Bu , Yibin Wang , Yuhang Zang , Jiaqi Wang , Li Niu , Guangtao Zhai

Group Relative Policy Optimization (GRPO) is a powerful technique for aligning generative models, but its effectiveness is bottlenecked by the conflict between large group sizes and prohibitive computational costs. In this work, we…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Shiran Ge , Chenyi Huang , Yuang Ai , Qihang Fan , Huaibo Huang , Ran He

Optimizing discrete diffusion model (DDM) with rewards remains a challenge: the non-autoregressive paradigm makes importance sampling intractable and rollout complex, puzzling reinforcement learning methods such as Group Relative Policy…

人工智能 · 计算机科学 2025-10-06 Tianren Ma , Mu Zhang , Yibing Wang , Qixiang Ye

We present a determinantal point process (DPP) inspired alternative to non-maximum suppression (NMS) which has become an integral step in all state-of-the-art object detection frameworks. DPPs have been shown to encourage diversity in…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Samik Some , Mithun Das Gupta , Vinay P. Namboodiri

Detecting actions in videos is an important yet challenging task. Previous works usually utilize (a) sliding window paradigms, or (b) per-frame action scoring and grouping to enumerate the possible temporal locations. Their performances are…

计算机视觉与模式识别 · 计算机科学 2019-09-18 Luxuan Li , Tao Kong , Fuchun Sun , Huaping Liu

Most reinforcement learning algorithms seek a single optimal strategy that solves a given task. However, it can often be valuable to learn a diverse set of solutions, for instance, to make an agent's interaction with users more engaging, or…

机器学习 · 计算机科学 2024-01-09 Wentse Chen , Shiyu Huang , Yuan Chiang , Tim Pearce , Wei-Wei Tu , Ting Chen , Jun Zhu

Balancing exploration and exploitation during reinforcement learning fine-tuning of generative models presents a critical challenge, as existing approaches rely on fixed divergence regularization that creates an inherent dilemma: strong…

机器学习 · 计算机科学 2025-10-22 Jiajun Fan , Tong Wei , Chaoran Cheng , Yuxin Chen , Ge Liu

Reinforcement learning (RL) has become a powerful tool for post-training visual generative models, with Group Relative Policy Optimization (GRPO) increasingly used to align generators with human preferences. However, existing GRPO pipelines…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Ziqi Ni , Yuanzhi Liang , Rui Li , Yi Zhou , Haibin Huang , Chi Zhang , Xuelong Li