English
Related papers

Related papers: Diverse Video Generation with Determinantal Point …

200 papers

Recent advances in image-to-video (I2V) generation have achieved remarkable progress in synthesizing high-quality, temporally coherent videos from static images. Among all the applications of I2V, human-centric video generation includes a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Liao Shen , Wentao Jiang , Yiran Zhu , Jiahe Li , Tiezheng Ge , Zhiguo Cao , Bo Zheng

Post-training plays a crucial role in refining and aligning large language models to meet specific tasks and human preferences. While recent advancements in post-training techniques, such as Group Relative Policy Optimization (GRPO),…

Artificial Intelligence · Computer Science 2025-10-28 Kaichen Zhang , Yuzhong Hong , Junwei Bao , Hongfei Jiang , Yang Song , Dingqian Hong , Hui Xiong

Fine-tuning pre-trained generative models with Reinforcement Learning (RL) has emerged as an effective approach for aligning outputs more closely with nuanced human preferences. In this paper, we investigate the application of Group…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Matteo Gallici , Haitz Sáez de Ocáriz Borde

Recent flow matching models for text-to-image generation have achieved remarkable quality, yet their integration with reinforcement learning for human preference alignment remains suboptimal, hindering fine-grained reward-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xiaoxuan He , Siming Fu , Yuke Zhao , Wanli Li , Jian Yang , Dacheng Yin , Fengyun Rao , Bo Zhang

Determinantal Point Processes (DPPs) are elegant probabilistic models of repulsion and diversity over discrete sets of items. But their applicability to large sets is hindered by expensive cubic-complexity matrix operations for basic tasks…

Machine Learning · Computer Science 2016-05-31 Chengtao Li , Stefanie Jegelka , Suvrit Sra

Preference modeling techniques, such as direct preference optimization (DPO), has shown effective in enhancing the generalization abilities of large language model (LLM). However, in tasks involving video instruction-following, providing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Ruohong Zhang , Liangke Gui , Zhiqing Sun , Yihao Feng , Keyang Xu , Yuanhan Zhang , Di Fu , Chunyuan Li , Alexander Hauptmann , Yonatan Bisk , Yiming Yang

Recent advances in large language models have highlighted the critical need for precise control over model outputs through predefined constraints. While existing methods attempt to achieve this through either direct instruction-response…

Computation and Language · Computer Science 2025-03-27 Zhouhong Gu , Xingzhou Chen , Xiaoran Shi , Tao Wang , Suhang Zheng , Tianyu Li , Hongwei Feng , Yanghua Xiao

Diffusion models have achieved remarkable progress in text-to-image generation, yet aligning them with human preference remains challenging due to the presence of multiple, sometimes conflicting, evaluation metrics (e.g., semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Dipesh Tamboli , Souradip Chakraborty , Aditya Malusare , Biplab Banerjee , Amrit Singh Bedi , Vaneet Aggarwal

Existing text generation methods tend to produce repeated and "boring" expressions. To tackle this problem, we propose a new text generation model, called Diversity-Promoting Generative Adversarial Network (DP-GAN). The proposed model…

Computation and Language · Computer Science 2018-08-22 Jingjing Xu , Xuancheng Ren , Junyang Lin , Xu Sun

Aligning text-to-image (T2I) diffusion models with Direct Preference Optimization (DPO) has shown notable improvements in generation quality. However, applying DPO to T2I faces two challenges: the sensitivity of DPO to preference pairs and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Renjie Chen , Wenfeng Lin , Yichen Zhang , Jiangchuan Wei , Boyuan Liu , Chao Feng , Jiao Ran , Mingyu Guo

To predict a set of diverse and informative proposals with enriched representations, this paper introduces a differentiable Determinantal Point Process (DPP) layer that is able to augment the object detection architectures. Most modern…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Samaneh Azadi , Jiashi Feng , Trevor Darrell

A critical component of the current generation of language models is preference alignment, which aims to precisely control the model's behavior to meet human needs and values. The most notable among such methods is Reinforcement Learning…

Artificial Intelligence · Computer Science 2024-10-22 Oh Joon Kwon , Daiki E. Matsunaga , Kee-Eung Kim

Unified models capable of interleaved generation have emerged as a promising paradigm, with the community increasingly converging on autoregressive modeling for text and flow matching for image generation. To advance this direction, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jie Liu , Zilyu Ye , Linxiao Yuan , Shenhan Zhu , Yu Gao , Jie Wu , Kunchang Li , Xionghui Wang , Xiaonan Nie , Weilin Huang , Wanli Ouyang

Autonomous navigation in intelligent mobile systems represents a core research focus within artificial intelligence-driven robotics. Contemporary path planning approaches face constraints in dynamic environmental responsiveness and…

Robotics · Computer Science 2025-03-11 Junzhe Wang

Human image generation is a key focus in image synthesis due to its broad applications, but even slight inaccuracies in anatomy, pose, or details can compromise realism. To address these challenges, we explore Direct Preference Optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Sanghyeon Na , Yonggyu Kim , Hyunjoon Lee

Reinforcement learning (RL) has emerged as a popular method for post-training large language models (LLMs). While improving the model's performance on downstream tasks, it often reduces the model's output diversity, leading to narrow,…

Computation and Language · Computer Science 2026-03-03 Yilei Chen , Souradip Chakraborty , Lorenz Wolf , Yannis Paschalidis , Aldo Pacchiano

Direct Preference Optimization (DPO) has emerged as a powerful approach to align text-to-image (T2I) models with human feedback. Unfortunately, successful application of DPO to T2I models requires a huge amount of resources to collect and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Shyamgopal Karthik , Huseyin Coskun , Zeynep Akata , Sergey Tulyakov , Jian Ren , Anil Kag

Reinforcement learning algorithms such as group-relative policy optimization (GRPO) have shown strong potential for improving the mathematical reasoning capabilities of large language models. While a growing body of work seeks to improve…

Machine Learning · Computer Science 2026-05-12 Wenquan Lu , Hai Huang , Enqi Liu , Randall Balestriero

Direct Preference Optimization (DPO) has been successfully used to align large language models (LLMs) according to human preferences, and more recently it has also been applied to improving the quality of text-to-image diffusion models.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Shivanshu Shekhar , Shreyas Singh , Tong Zhang

Video large language models (Video-LLMs) have made significant progress in understanding videos. However, processing multiple frames leads to lengthy visual token sequences, presenting challenges such as the limited context length cannot…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Hui Sun , Shiyin Lu , Huanyu Wang , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Ming Li