English
Related papers

Related papers: DTRec: Learning Dynamic Reasoning Trajectories for…

200 papers

Preference-based alignment methods (e.g., RLHF, DPO) typically optimize a single scalar objective, implicitly averaging over heterogeneous human preferences. In practice, systematic annotator and user-group disagreement makes mean-reward…

Machine Learning · Computer Science 2026-05-19 Mingxi Zou , Jiaxiang Chen , Junfan Li , Langzhang Liang , Qifan Wang , Xu Yinghui , Zenglin Xu

Modern recommender systems must adapt to dynamic, need-specific objectives for diverse recommendation scenarios, yet most traditional recommenders are optimized for a single static target and struggle to reconfigure behavior on demand.…

Machine Learning · Computer Science 2026-03-13 Yijun Pan , Weikang Qiu , Qiyao Ma , Mingxuan Ju , Tong Zhao , Neil Shah , Rex Ying

Scaling inference-time computation has substantially improved the reasoning capabilities of language models. However, existing methods have significant limitations: serialized chain-of-thought approaches generate overly long outputs,…

Artificial Intelligence · Computer Science 2025-08-19 Jiayi Pan , Xiuyu Li , Long Lian , Charlie Snell , Yifei Zhou , Adam Yala , Trevor Darrell , Kurt Keutzer , Alane Suhr

Proactive Recommender Systems (PRSs) aim to guide user preference shift toward target items by generating paths of intermediate recommendations. Reinforcement learning (RL) provides a principled framework for optimizing such sequential…

Machine Learning · Computer Science 2026-05-29 Hongru Hou , Tiehua Mei , Denghui Geng , Jinhui Huang , Ao Xu , Hengrui Chen , Jiaqing Liang , Deqing Yang

Multi-step processes via large language models (LLMs) have proven effective for solving complex reasoning tasks. However, the depth of exploration of the reasoning procedure can significantly affect the task performance. Existing methods to…

Artificial Intelligence · Computer Science 2025-06-19 Jinghan Zhang , Xiting Wang , Fengran Mo , Yeyang Zhou , Wanfu Gao , Kunpeng Liu

Diffusion Large Language Models (dLLMs) are rapidly emerging alongside autoregressive models as a powerful paradigm for complex reasoning, with reinforcement learning increasingly used for downstream alignment. Existing trajectory-based RL…

Machine Learning · Computer Science 2025-11-20 Ranfei Chen , Ming Chen , Kaifei Wang

Recent studies show that Large Language Models (LLMs) achieve strong reasoning capabilities through supervised fine-tuning or reinforcement learning. However, a key approach, the Process Reward Model (PRM), suffers from reward hacking,…

Computation and Language · Computer Science 2026-04-10 Teng Wang , Zhangyi Jiang , Zhenqi He , Shenyang Tong , Wenhan Yang , Yanan Zheng , Zeyu Li , Zifan He , Hailei Gong , Zewen Ye , Shengjie Ma , Jianping Zhang

The paper studies sequential reasoning over graph-structured data, which stands as a fundamental task in various trending fields like automated math problem solving and neural graph algorithm learning, attracting a lot of research interest.…

Artificial Intelligence · Computer Science 2024-12-13 Shuo Shi , Chao Peng , Chenyang Xu , Zhengfeng Yang

Large language models often fail at logical reasoning when semantic heuristics conflict with decisive evidence - a phenomenon we term cognitive traps. To address this fundamental limitation, we introduce the Deliberative Reasoning Network…

Artificial Intelligence · Computer Science 2026-01-22 Anran Xu , Jincheng Wang , Baigen Cai , Tao Wen

Large Language Models (LLMs) are increasingly deployed in critical applications requiring reliable reasoning, yet their internal reasoning processes remain difficult to evaluate systematically. Existing methods focus on final-answer…

Machine Learning · Computer Science 2026-02-03 Shaima Ahmad Freja , Ferhat Ozgur Catak , Betul Yurdem , Chunming Rong

Sequential Recommendation aims to recommend items that a target user will interact with in the near future based on the historically interacted items. While modeling temporal dynamics is crucial for sequential recommendation, most of the…

Information Retrieval · Computer Science 2021-09-27 Zeyuan Chen , Wei Zhang , Junchi Yan , Gang Wang , Jianyong Wang

Large language models (LLMs) have recently demonstrated strong potential for sequential recommendation. However, current LLM-based approaches face critical limitations in modeling users' long-term and diverse interests. First, due to…

Information Retrieval · Computer Science 2025-10-30 Jingyi Zhou , Cheng Chen , Kai Zuo , Manjie Xu , Zhendong Fu , Yibo Chen , Xu Tang , Yao Hu

To support complex search tasks, where the initial information requirements are complex or may change during the search, a search engine must adapt the information delivery as the user's information requirements evolve. To support this…

Information Retrieval · Computer Science 2021-05-24 Jianghong Zhou , Eugene Agichtein

Reinforcement learning (RL) has become a promising paradigm for optimizing Retrieval-Augmented Generation (RAG) in complex reasoning tasks. However, traditional outcome-based RL approaches often suffer from reward sparsity and inefficient…

Artificial Intelligence · Computer Science 2026-01-30 Zhao Wang , Ziliang Zhao , Zhicheng Dou

Recent advancements in large reasoning models (LRMs) have significantly enhanced language models' capabilities in complex problem-solving by emulating human-like deliberative thinking. However, these models often exhibit overthinking (i.e.,…

Artificial Intelligence · Computer Science 2025-06-19 Weixiang Zhao , Jiahe Guo , Yang Deng , Xingyu Sui , Yulin Hu , Yanyan Zhao , Wanxiang Che , Bing Qin , Tat-Seng Chua , Ting Liu

Learning internal reasoning processes is crucial for developing AI systems capable of sustained adaptation in dynamic real-world environments. However, most existing approaches primarily emphasize learning task-specific outputs or static…

Artificial Intelligence · Computer Science 2026-02-13 Hong Su

Deep neural networks are widely used in personalized recommendation systems. Unlike regular DNN inference workloads, recommendation inference is memory-bound due to the many random memory accesses needed to lookup the embedding tables. The…

Strategic recommendations (SR) refer to the problem where an intelligent agent observes the sequential behaviors and activities of users and decides when and how to interact with them to optimize some long-term objectives, both for the user…

Machine Learning · Computer Science 2020-09-17 Georgios Theocharous , Yash Chandak , Philip S. Thomas , Frits de Nijs

Reasoning models improve their problem-solving ability through inference-time scaling, allocating more compute via longer token budgets. Identifying which reasoning traces are likely to succeed remains a key opportunity: reliably predicting…

Artificial Intelligence · Computer Science 2025-10-14 Martina G. Vilas , Safoora Yousefi , Besmira Nushi , Eric Horvitz , Vidhisha Balachandran

Modeling the evolution of user preference is essential in recommender systems. Recently, dynamic graph-based methods have been studied and achieved SOTA for recommendation, majority of which focus on user's stable long-term preference.…

Information Retrieval · Computer Science 2022-08-02 Huixuan Chi , Hao Xu , Hao Fu , Mengya Liu , Mengdi Zhang , Yuji Yang , Qinfen Hao , Wei Wu