English
Related papers

Related papers: SAPO: Step-Aligned Policy Optimization for Reasoni…

200 papers

Advancements in Generative AI offers new opportunities for FashionAI, surpassing traditional recommendation systems that often lack transparency and struggle to integrate expert knowledge, leaving the potential for personalized fashion…

Information Retrieval · Computer Science 2025-04-15 Yuxi Bi , Yunfan Gao , Haofen Wang

The retrieval phase is a vital component in recommendation systems, requiring the model to be effective and efficient. Recently, generative retrieval has become an emerging paradigm for document retrieval, showing notable performance. These…

Information Retrieval · Computer Science 2024-07-09 Zihua Si , Zhongxiang Sun , Jiale Chen , Guozhang Chen , Xiaoxue Zang , Kai Zheng , Yang Song , Xiao Zhang , Jun Xu , Kun Gai

Generative information retrieval (GenIR) is a promising neural retrieval paradigm that formulates document retrieval as a document identifier (docid) generation task, allowing for end-to-end optimization toward a unified global retrieval…

Information Retrieval · Computer Science 2026-05-26 Kidist Amde Mekonnen , Yubao Tang , Maarten de Rijke

Leveraging long-term user behavioral patterns is a key trajectory for enhancing the accuracy of modern recommender systems. While generative recommender systems have emerged as a transformative paradigm, they face hurdles in effectively…

Information Retrieval · Computer Science 2026-02-06 Shiteng Cao , Junda She , Ji Liu , Bin Zeng , Chengcheng Guo , Kuo Cai , Qiang Luo , Ruiming Tang , Han Li , Kun Gai , Zhiheng Li , Cheng Yang

The central challenge of reinforcement learning for reasoning lies not only in the sparsity of outcome-level supervision, but more fundamentally in how to transform feedback provided only at the end of a sequence into fine-grained learning…

Machine Learning · Computer Science 2026-05-26 Fei Ding , Yongkang Zhang , Runhao Liu , Yuhao Liao , Zijian Zeng , Sibo wang , Huiming Yang

Sequential recommendations aim to capture users' preferences from their historical interactions so as to predict the next item that they will interact with. Sequential recommendation methods usually assume that all items in a user's…

Information Retrieval · Computer Science 2023-04-24 Yujie Lin , Chenyang Wang , Zhumin Chen , Zhaochun Ren , Xin Xin , Qiang Yan , Maarten de Rijke , Xiuzhen Cheng , Pengjie Ren

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for post-training reasoning models. However, group-based methods such as Group Relative Policy Optimization (GRPO) face a critical dilemma in…

Machine Learning · Computer Science 2026-04-07 Yuning Wu , Ke Wang , Devin Chen , Kai Wei

Recent advances in large language models have highlighted the critical need for precise control over model outputs through predefined constraints. While existing methods attempt to achieve this through either direct instruction-response…

Computation and Language · Computer Science 2025-03-27 Zhouhong Gu , Xingzhou Chen , Xiaoran Shi , Tao Wang , Suhang Zheng , Tianyu Li , Hongwei Feng , Yanghua Xiao

Sequential recommendation is an important recommendation task that aims to predict the next item in a sequence. Recently, adaptations of language models, particularly Transformer-based models such as SASRec and BERT4Rec, have achieved…

Information Retrieval · Computer Science 2023-06-21 Aleksandr V. Petrov , Craig Macdonald

Recent advances in large language models (LLMs) have popularized test-time scaling, where models generate additional reasoning tokens before producing final answers. These approaches have demonstrated significant performance improvements on…

Artificial Intelligence · Computer Science 2026-01-13 Wenxun Wu , Yuanyang Li , Guhan Chen , Linyue Wang , Hongyang Chen

Traditional methods for reasoning segmentation rely on supervised fine-tuning with categorical labels and simple descriptions, limiting its out-of-domain generalization and lacking explicit reasoning processes. To address these limitations,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yuqi Liu , Bohao Peng , Zhisheng Zhong , Zihao Yue , Fanbin Lu , Bei Yu , Jiaya Jia

This work investigates the formal policy synthesis of continuous-state stochastic dynamic systems given high-level specifications in linear temporal logic. To learn an optimal policy that maximizes the satisfaction probability, we take a…

Artificial Intelligence · Computer Science 2023-04-21 Lening Li , Zhentian Qian

Generative recommendation frameworks typically represent items as discrete Semantic IDs (SIDs). While existing studies have sought to enhance SID construction by incorporating multimodal content, collaborative signals, or more advanced…

Information Retrieval · Computer Science 2026-04-30 Yibiao Wei , Jie Zou , Pengfei Zhang , Xiao Ao , Weikang Guo , Zeyu Ma , Yang Yang

Large reasoning models often reach correct answers through flawed intermediate steps, creating a gap between final accuracy and reasoning reliability. Existing alignment strategies address this with external verifiers or massive sampling,…

Artificial Intelligence · Computer Science 2026-05-11 Kejia Chen , Jiawen Zhang , Yihong Wu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song , Ruoxi Jia

Despite the promising progress of recent autoregressive models in text-to-image (T2I) generation, their ability to handle multi-attribute and ambiguous prompts remains limited. To address these limitations, existing works have applied…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yaqi Li , Peng Chen , Mingyang Han , Pi Bu , Haoxiang Shi , Runzhou Zhao , Yang Yao , Xuan Zhang , Jun Song , Bo Zheng

We revisit retrieval-augmented generation (RAG) by embedding retrieval control directly into generation. Instead of treating retrieval as an external intervention, we express retrieval decisions within token-level decoding, enabling…

Computation and Language · Computer Science 2026-04-21 Bo Li , Mingda Wang , Gexiang Fang , Shikun Zhang , Wei Ye

Group Relative Policy Optimization (GRPO) enhances policy learning by computing gradients from relative comparisons among candidate outputs that share a common input prefix. Despite its effectiveness, GRPO introduces substantial…

Machine Learning · Computer Science 2025-06-09 Zikang Liu , Tongtian Yue , Yepeng Tang , Longteng Guo , Junxian Cai , Qingbin Liu , Xi Chen , Jing Liu

Recent advancements in aligning large language models via reinforcement learning have achieved remarkable gains in solving complex reasoning problems, but at the cost of expensive on-policy rollouts and limited exploration of diverse…

Latent reasoning has emerged as a promising paradigm for sequential recommendation, enabling models to capture complex user intent through multi-step deliberation. Yet existing approaches often rely on deterministic latent chains that…

Information Retrieval · Computer Science 2026-02-13 Jie Jiang , Yang Wu , Qian Li , Yuling Xiong , Yihang Su , Junbang Huo , Longfei Lu , Jun Zhang , Huan Yu

Large language models (LLMs) trained with reinforcement objectives often achieve superficially correct answers via shortcut strategies, pairing correct outputs with spurious or unfaithful reasoning and degrading under small causal…

Machine Learning · Computer Science 2025-09-30 Xiangqi Wang , Yue Huang , Yujun Zhou , Xiaonan Luo , Kehan Guo , Xiangliang Zhang