English
Related papers

Related papers: Generative Modeling with Multi-Instance Reward Lea…

200 papers

Generative retrieval offers a promising alternative by unifying the fragmented multi-stage retrieval process into a single end-to-end model. However, its practical adoption in industrial e-commerce search remains challenging, given the…

Information Retrieval · Computer Science 2026-05-15 Jianbo Zhu , Xing Fang , Jing Wang , Mingmin Jin , Bokang Wang , Guangxin Song , Zhenyu Xie , Junjie Bai

Many recommendation systems limit user inputs to text strings or behavior signals such as clicks and purchases, and system outputs to a list of products sorted by relevance. With the advent of generative AI, users have come to expect richer…

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang

Reward modeling in large language models is susceptible to reward hacking, causing models to latch onto superficial features such as the tendency to generate lists or unnecessarily long responses. In reinforcement learning from human…

Computation and Language · Computer Science 2025-02-19 Taneesh Gupta , Shivam Shandilya , Xuchao Zhang , Rahul Madhavan , Supriyo Ghosh , Chetan Bansal , Huaxiu Yao , Saravan Rajmohan

Online recommendation and advertising are two major income channels for online recommendation platforms (e.g. e-commerce and news feed site). However, most platforms optimize recommending and advertising strategies by different teams…

Information Retrieval · Computer Science 2020-06-22 Xiangyu Zhao , Xudong Zheng , Xiwang Yang , Xiaobing Liu , Jiliang Tang

Online learning methods often rely on supervised data. However, under data distribution shifts, such as in continual learning (CL), where continuously arriving online data streams incorporate new concepts (e.g., classes), real-time manual…

Machine Learning · Computer Science 2026-04-01 Minhyuk Seo , Seongwon Cho , Minjae Lee , Diganta Misra , Hyeonbeom Choi , Seon Joo Kim , Jonghyun Choi

Reinforcement learning (RL), particularly GRPO, improves image generation quality significantly by comparing the relative performance of images generated within the same group. However, in the later stages of training, the model tends to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Henglin Liu , Huijuan Huang , Jing Wang , Chang Liu , Xiu Li , Xiangyang Ji

With the rise of large language models (LLMs), generative engines are becoming powerful alternatives to traditional search, reshaping retrieval tasks. In e-commerce, for instance, conversational shopping agents now guide consumers to…

Information Retrieval · Computer Science 2025-11-27 Puneet S. Bagga , Vivek F. Farias , Tamar Korkotashvili , Tianyi Peng , Yuhang Wu

This paper proposes a novel meta-learning approach to optimize a robust portfolio ensemble. The method uses a deep generative model to generate diverse and high-quality sub-portfolios combined to form the ensemble portfolio. The generative…

Neural and Evolutionary Computing · Computer Science 2023-07-18 Kamer Ali Yuksel

Recent advances in human preference alignment have significantly improved multimodal generation and understanding. A key approach is to train reward models that provide supervision signals for preference optimization. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yibin Wang , Yuhang Zang , Hao Li , Cheng Jin , Jiaqi Wang

Generative image modeling techniques such as GAN demonstrate highly convincing image generation result. However, user interaction is often necessary to obtain the desired results. Existing attempts add interactivity but require either…

Graphics · Computer Science 2020-09-01 Toby Chong Long Hin , I-Chao Shen , Issei Sato , Takeo Igarashi

Training effective Generative Adversarial Networks (GANs) requires large amounts of training data, without which the trained models are usually sub-optimal with discriminator over-fitting. Several prior studies address this issue by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Kaiwen Cui , Jiaxing Huang , Zhipeng Luo , Gongjie Zhang , Fangneng Zhan , Shijian Lu

Key Opinion Leader (KOL) play a crucial role in modern marketing by shaping consumer perceptions and enhancing brand credibility. However, collaborating with human KOLs often involves high costs and logistical challenges. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Tan-Hiep To , Duy-Khang Nguyen , Tam V. Nguyen , Minh-Triet Tran , Trung-Nghia Le

In the online advertising industry, the process of designing an ad creative (i.e., ad text and image) requires manual labor. Typically, each advertiser launches multiple creatives via online A/B tests to infer effective creatives for the…

Computation and Language · Computer Science 2020-12-03 Shaunak Mishra , Manisha Verma , Yichao Zhou , Kapil Thadani , Wei Wang

Text-to-Image (T2I) generation has achieved remarkable progress in recent years. Meanwhile, reinforcement learning methods, particularly those based on Group Relative Policy Optimization (GRPO), have attracted widespread attention and been…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Baoteng Li , Xianghao Zang , Xinran Wang , Xiangyu Na , Zhixiang He , Hao Sun , Chi Zhang , Zhongjiang He , Tianwei Cao , Kongming Liang , Zhanyu Ma

Despite significant advancements in image generation using advanced generative frameworks, cross-image integration of content and style remains a key challenge. Current generative models, while powerful, frequently depend on vague textual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shaoxu Li , Ye Pan

Recommender systems and search engines serve as foundational elements of online platforms, with the former delivering information proactively and the latter enabling users to seek information actively. Unifying both tasks in a shared model…

Information Retrieval · Computer Science 2025-10-28 Jujia Zhao , Wenjie Wang , Chen Xu , Xiuying Chen , Zhaochun Ren , Suzan Verberne

A fundamental challenge in creative writing lies in reconciling the inherent tension between maintaining global coherence in long-form narratives and preserving local expressiveness in short-form texts. While long-context generation…

Artificial Intelligence · Computer Science 2026-04-08 Xiaolong Wei , Zerun Zhu , Simin Niu , Xingyu Zhang , Peiying Yu , Changxuan Xiao , Yuchen Li , Jicheng Yang , Zhejun Zhao , Chong Meng , Long Xia , Daiting Shi

Generative AI (GenAI) has spurred the expectation of being creative, due to its ability to generate content, yet so far, its creativity has somewhat disappointed, because it is trained using existing data following human intentions to…

Artificial Intelligence · Computer Science 2024-05-14 Ming-Hui Huang , Roland T. Rust

Text-to-image models produce images that align well with natural language prompts, but compositional generation has long been a central challenge. Models often struggle to satisfy multiple concepts within a single prompt, frequently…

Artificial Intelligence · Computer Science 2026-03-20 Jungmyung Wi , Hyunsoo Kim , Donghyun Kim