中文
相关论文

相关论文: PROMISE: Process Reward Models Unlock Test-Time Sc…

200 篇论文

Large language models (LLMs) have shown strong performance in many reasoning benchmarks. However, recent studies have pointed to memorization, rather than generalization, as one of the leading causes for such performance. LLMs, in fact, are…

计算与语言 · 计算机科学 2025-09-19 Xingwei Tan , Marco Valentino , Mahmud Akhter , Maria Liakata , Nikolaos Aletras

Owing to their powerful semantic reasoning capabilities, Large Language Models (LLMs) have been effectively utilized as recommenders, achieving impressive performance. However, the high inference latency of LLMs significantly restricts…

信息检索 · 计算机科学 2024-08-21 Yu Cui , Feng Liu , Pengbo Wang , Bohao Wang , Heng Tang , Yi Wan , Jun Wang , Jiawei Chen

Real-world recommendation systems commonly offer diverse content scenarios for users to interact with. Considering the enormous number of users in industrial platforms, it is infeasible to utilize a single unified recommendation model to…

信息检索 · 计算机科学 2024-12-10 Chonggang Song , Chunxu Shen , Hao Gu , Yaoming Wu , Lingling Yi , Jie Wen , Chuan Chen

A core objective in recommender systems is to accurately model the distribution of user preferences over items to enable personalized recommendations. Recently, driven by the strong generative capabilities of large language models (LLMs),…

信息检索 · 计算机科学 2026-02-10 Yuanbo Zhao , Ruochen Liu , Senzhang Wang , Jun Yin , Yuxin Dong , Huan Gong , Hao Chen , Shirui Pan , Chengqi Zhang

Process Reward Models (PRMs) provide step-level feedback for reasoning, but current PRMs usually output only a single reward score for each step. Downstream methods must therefore treat imperfect step-level reward predictions as reliable…

计算与语言 · 计算机科学 2026-05-18 Jinyuan Li , Langlin Huang , Chengsong Huang , Shaoyang Xu , Donghong Cai , Yuyi Yang , Wenxuan Zhang , Jiaxin Huang

Large Language Models (LLMs) can infer sensitive attributes such as gender or age from indirect cues like names and pronouns, potentially biasing recommendations. While several debiasing methods exist, they require access to the LLMs'…

信息检索 · 计算机科学 2026-03-16 Mihaela Rotar , Theresia Veronika Rampisela , Maria Maistro

Process Reward Models (PRMs) provide step-level supervision to large language models (LLMs), but scaling up training data annotation remains challenging for both humans and LLMs. To address this limitation, we propose an active learning…

机器学习 · 计算机科学 2025-04-16 Keyu Duan , Zichen Liu , Xin Mao , Tianyu Pang , Changyu Chen , Qiguang Chen , Michael Qizhe Shieh , Longxu Dou

The explainability of recommendation systems is crucial for enhancing user trust and satisfaction. Leveraging large language models (LLMs) offers new opportunities for comprehensive recommendation logic generation. However, in existing…

信息检索 · 计算机科学 2024-07-04 Hongke Zhao , Songming Zheng , Likang Wu , Bowen Yu , Jing Wang

Large Reasoning Models (LRMs) have demonstrated impressive capabilities but suffer from cognitive inefficiencies like "overthinking" simple problems and "underthinking" complex ones. While existing methods that use supervised fine-tuning…

人工智能 · 计算机科学 2026-03-24 Tian Liang , Wenxiang Jiao , Zhiwei He , Jiahao Xu , Haitao Mi , Dong Yu

Recent work increasingly focuses on improving the reasoning capabilities of Multimodal Large Language Models (MLLMs). Among existing methods, Process Reward Models (PRMs) stand out for offering dense, step-wise supervision to guide…

While Pre-trained Language Models (PLMs) internalize a great amount of world knowledge, they have been shown incapable of recalling these knowledge to solve tasks requiring complex & multi-step reasoning. Similar to how humans develop a…

计算与语言 · 计算机科学 2022-10-25 Boshi Wang , Xiang Deng , Huan Sun

Speech enhancement (SE) is the foundational task of enhancing the clarity and quality of speech in the presence of non-stationary additive noise. While deterministic deep learning models have been commonly employed for SE, recent research…

音频与语音处理 · 电气工程与系统科学 2025-03-11 Sonal Kumar , Sreyan Ghosh , Utkarsh Tyagi , Anton Jeran Ratnarajah , Chandra Kiran Reddy Evuru , Ramani Duraiswami , Dinesh Manocha

Recent advances have shown that optimizing prompts for Large Language Models (LLMs) can significantly improve task performance, yet many optimization techniques rely on heuristics or manual exploration. We present LatentPrompt, a…

计算与语言 · 计算机科学 2025-08-05 Mateusz Bystroński , Grzegorz Piotrowski , Nitesh V. Chawla , Tomasz Kajdanowicz

Reward is critical to the evaluation and training of large language models (LLMs). However, existing rule-based or model-based reward methods struggle to generalize to GUI agents, where access to ground-truth trajectories or application…

人工智能 · 计算机科学 2026-04-16 Gaole Dai , Shiqi Jiang , Ting Cao , Yuqing Yang , Yuanchun Li , Rui Tan , Mo Li , Lili Qiu

Reinforcement learning has emerged as an effective paradigm for training large language models to interleave reasoning with search engine calls. However, existing approaches face a fundamental credit assignment problem: methods like…

计算与语言 · 计算机科学 2026-04-02 Chris Samarinas , Haw-Shiuan Chang , Hamed Zamani

Verifiers or reward models are often used to enhance the reasoning performance of large language models (LLMs). A common approach is the Best-of-N method, where N candidate solutions generated by the LLM are ranked by a verifier, and the…

机器学习 · 计算机科学 2025-02-25 Lunjun Zhang , Arian Hosseini , Hritik Bansal , Mehran Kazemi , Aviral Kumar , Rishabh Agarwal

Reward-based fine-tuning steers a pretrained diffusion or flow-based generative model toward higher-reward samples while remaining close to the pretrained model. Although existing methods are derived from different perspectives, we show…

机器学习 · 计算机科学 2026-05-08 Jeongjae Lee , Jinho Chang , Jeongsol Kim , Jong Chul Ye

Schema matching is the process of identifying correspondences between the elements of two given schemata, essential for database management systems, data integration, and data warehousing. For datasets across different scenarios, the…

数据库 · 计算机科学 2025-03-07 Longyu Feng , Huahang Li , Chen Jason Zhang

Generative retrieval reformulates retrieval as an autoregressive generation task, where large language models (LLMs) generate target documents directly from a query. As a novel paradigm, the mechanisms that underpin its performance and…

信息检索 · 计算机科学 2025-06-10 Hongru Cai , Yongqi Li , Ruifeng Yuan , Wenjie Wang , Zhen Zhang , Wenjie Li , Tat-Seng Chua

Reinforcement Learning with Verifiable Rewards (RLVR) has catalyzed significant breakthroughs in complex LLM reasoning within verifiable domains, such as mathematics and programming. Recent efforts have sought to extend this paradigm to…

机器学习 · 计算机科学 2026-02-03 Zheng Zhang , Ao Lu , Yuanhao Zeng , Ziwei Shan , Jinjin Guo , Lufei Li , Yexin Li , Kan Ren