English
Related papers

Related papers: Diverse Video Generation with Determinantal Point …

200 papers

Multi-subject personalized image generation aims to synthesize customized images containing multiple specified subjects without requiring test-time optimization. However, achieving fine-grained independent control over multiple subjects…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qiaoqiao Jin , Siming Fu , Dong She , Weinan Jia , Hualiang Wang , Mu Liu , Jidong Jiang

Generating future frames given a few context (or past) frames is a challenging task. It requires modeling the temporal coherence of videos and multi-modality in terms of diversity in the potential future states. Current variational…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Gaurav Shrivastava , Abhinav Shrivastava

With the rapid development of AIGC technology, significant progress has been made in diffusion model-based technologies for text-to-image (T2I) and text-to-video (T2V). In recent years, a few studies have introduced the strategy of Direct…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Lifan Jiang , Boxi Wu , Jiahui Zhang , Xiaotong Guan , Shuang Chen

3D generation has rapidly accelerated in the past decade owing to the progress in the field of generative modeling. Score Distillation Sampling (SDS) based rendering has improved 3D asset generation to a great extent. Further, the recent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Aradhya N. Mathur , Phu Pham , Aniket Bera , Ojaswa Sharma

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a promising framework for enhancing the reasoning capabilities of large language models. However, existing approaches such as GRPO often suffer from zero gradients. This…

Computation and Language · Computer Science 2025-09-09 Shihui Yang , Chengfeng Dou , Peidong Guo , Kai Lu , Qiang Ju , Fei Deng , Rihui Xin

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding generation in external knowledge, yielding relevance responses that are aligned with factual evidence and evolving corpora. Standard RAG pipelines…

Machine Learning · Computer Science 2026-04-07 Xun Sun , Baiheng Xie , Li Huang , Qiang Gao

Group-advantage-based reinforcement learning methods, such as GRPO and DAPO, have demonstrated strong performance across diverse domains, including mathematical reasoning and text-to-image generation. However, their reliance on sample-level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shufan Li , Konstantinos Kallidromitis , Akash Gokul Yusuke Kato , Kazuki Kozuka , Aditya Grover

Predicting multiple trajectories for road users is important for automated driving systems: ego-vehicle motion planning indeed requires a clear view of the possible motions of the surrounding agents. However, the generative models used for…

Machine Learning · Computer Science 2023-02-08 Laura Calem , Hedi Ben-Younes , Patrick Pérez , Nicolas Thome

Applying Reinforcement Learning (RL) to Video Large Language Models (Video-LLMs) shows significant promise for complex video reasoning. However, popular Reinforcement Fine-Tuning (RFT) methods, such as outcome-based Group Relative Policy…

Computation and Language · Computer Science 2025-05-27 Yunxin Li , Xinyu Chen , Zitao Li , Zhenyu Liu , Longyue Wang , Wenhan Luo , Baotian Hu , Min Zhang

Generating safety-critical driving scenarios is crucial for evaluating and improving autonomous driving systems, but long-tail risky situations are rarely observed in real-world data and difficult to specify through manual scenario design.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Hongyi Lin , Wenxiu Shi , Heye Huang , Dingyi Zhuang , Song Zhang , Yang Liu , Xiaobo Qu , Jinhua Zhao

A determinantal point process (DPP) is a random process useful for modeling the combinatorial problem of subset selection. In particular, DPPs encourage a random subset Y to contain a diverse set of items selected from a base set Y. For…

Machine Learning · Computer Science 2012-10-19 Raja Hafiz Affandi , Alex Kulesza , Emily B. Fox

Text-to-video generation is expensive, so only a few samples are typically produced per prompt. In this low-sample regime, maximizing the value of each batch requires high cross-video diversity. Recent methods improve diversity for image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Xinshuang Liu , Runfa Blark Li , Truong Nguyen

The incorporation of online reinforcement learning (RL) into diffusion and flow-based generative models has recently gained attention as a powerful paradigm for aligning model behavior with human preferences. By leveraging stochastic…

Machine Learning · Computer Science 2025-11-25 Yujie Zhou , Pengyang Ling , Jiazi Bu , Yibin Wang , Yuhang Zang , Jiaqi Wang , Li Niu , Guangtao Zhai

Group Relative Policy Optimization (GRPO) is a powerful technique for aligning generative models, but its effectiveness is bottlenecked by the conflict between large group sizes and prohibitive computational costs. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shiran Ge , Chenyi Huang , Yuang Ai , Qihang Fan , Huaibo Huang , Ran He

Optimizing discrete diffusion model (DDM) with rewards remains a challenge: the non-autoregressive paradigm makes importance sampling intractable and rollout complex, puzzling reinforcement learning methods such as Group Relative Policy…

Artificial Intelligence · Computer Science 2025-10-06 Tianren Ma , Mu Zhang , Yibing Wang , Qixiang Ye

We present a determinantal point process (DPP) inspired alternative to non-maximum suppression (NMS) which has become an integral step in all state-of-the-art object detection frameworks. DPPs have been shown to encourage diversity in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Samik Some , Mithun Das Gupta , Vinay P. Namboodiri

Detecting actions in videos is an important yet challenging task. Previous works usually utilize (a) sliding window paradigms, or (b) per-frame action scoring and grouping to enumerate the possible temporal locations. Their performances are…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Luxuan Li , Tao Kong , Fuchun Sun , Huaping Liu

Most reinforcement learning algorithms seek a single optimal strategy that solves a given task. However, it can often be valuable to learn a diverse set of solutions, for instance, to make an agent's interaction with users more engaging, or…

Machine Learning · Computer Science 2024-01-09 Wentse Chen , Shiyu Huang , Yuan Chiang , Tim Pearce , Wei-Wei Tu , Ting Chen , Jun Zhu

Balancing exploration and exploitation during reinforcement learning fine-tuning of generative models presents a critical challenge, as existing approaches rely on fixed divergence regularization that creates an inherent dilemma: strong…

Machine Learning · Computer Science 2025-10-22 Jiajun Fan , Tong Wei , Chaoran Cheng , Yuxin Chen , Ge Liu

Reinforcement learning (RL) has become a powerful tool for post-training visual generative models, with Group Relative Policy Optimization (GRPO) increasingly used to align generators with human preferences. However, existing GRPO pipelines…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ziqi Ni , Yuanzhi Liang , Rui Li , Yi Zhou , Haibin Huang , Chi Zhang , Xuelong Li