English
Related papers

Related papers: PROMISE: Process Reward Models Unlock Test-Time Sc…

200 papers

Sequential recommender systems rank relevant items by modeling a user's interaction history and computing the inner product between the resulting user representation and stored item embeddings. To avoid the significant memory overhead of…

The design of high-performance optical systems remains a specialized domain gated by the limited availability of expert engineers, creating a bottleneck that stalls innovation despite the growing demand for imaging hardware. While deep…

Optics · Physics 2026-02-17 Roy Maman , David Ohana , Jacob Engelberg , Uriel Levy

Process supervision, i.e., evaluating each step, is critical for complex large language model (LLM) reasoning and test-time searching with increased inference compute. Existing approaches, represented by process reward models (PRMs),…

Computation and Language · Computer Science 2025-03-07 Wenxiang Chen , Wei He , Zhiheng Xi , Honglin Guo , Boyang Hong , Jiazheng Zhang , Rui Zheng , Nijun Li , Tao Gui , Yun Li , Qi Zhang , Xuanjing Huang

Large language models (LLMs) underpin applications in code generation, mathematical reasoning, and agent-based workflows. In practice, systems access LLMs via commercial APIs or open-source deployments, and the model landscape (e.g., GPT,…

Computation and Language · Computer Science 2025-12-02 Yaxuan Wang , Quan Liu , Zhenting Wang , Zichao Li , Wei Wei , Yang Liu , Yujia Bao

Professional job recommendation involves a complex bipartite matching process that must reconcile a candidate's subjective preference with an employer's objective qualification. While Large Language Models (LLMs) are well-suited for…

Artificial Intelligence · Computer Science 2026-02-04 Bryce Kan , Wei Yang , Emily Nguyen , Ganghui Yi , Bowen Yi , Chenxiao Yu , Yan Liu

The recent explosion in the capabilities of large language models has led to a wave of interest in how best to prompt a model to perform a given task. While it may be tempting to simply choose a prompt based on average performance on a…

Machine Learning · Computer Science 2024-03-29 Thomas P. Zollo , Todd Morrill , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

Large Language Models (LLMs) have advanced recommendation capabilities through enhanced reasoning, but pose significant challenges for real-world deployment due to high inference costs. Conversely, while Small Language Models (SLMs) offer…

Computation and Language · Computer Science 2025-10-13 Prosenjit Biswas , Pervez Shaik , Abhinav Thorat , Ravi Kolla , Niranjan Pedanekar

Inference-time scaling methods rely on Process Reward Models (PRMs), which are often poorly calibrated and overestimate success probabilities. We propose, to our knowledge, the first use of conditional optimal transport for calibrating…

Machine Learning · Computer Science 2026-05-13 Rachel Ma , Dylan Hadfield-Menell , Kristjan Greenewald

The shift toward interacting with frozen, "black-box" Large Language Models (LLMs) has transformed prompt engineering from a heuristic exercise into a critical optimization challenge. We propose a Reinforcement Learning (RL) framework for…

Artificial Intelligence · Computer Science 2026-05-15 Krishna Sayana , Ketan Todi , Ambarish Jash

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Automating radiology report generation with Large Vision-Language Models (LVLMs) holds great potential, yet these models often produce clinically critical hallucinations, posing serious risks. Existing hallucination detection methods…

Computation and Language · Computer Science 2025-10-28 Alois Thomas , Maya Varma , Jean-Benoit Delbrouck , Curtis P. Langlotz

Large language models (LLMs) have enhanced conventional recommendation models via user profiling, which generates representative textual profiles from users' historical interactions. However, their direct application to session-based…

Information Retrieval · Computer Science 2026-04-16 Gyuseok Lee , Wonbin Kweon , Zhenrui Yue , Yaokun Liu , Yifan Liu , Susik Yoon , Dong Wang , SeongKu Kang

Generative Retrieval (GR) offers a promising paradigm for recommendation through next-token prediction (NTP). However, scaling it to large-scale industrial systems introduces three challenges: (i) within a single request, the identical…

Information Retrieval · Computer Science 2026-04-17 Yanyan Zou , Junbo Qi , Lunsong Huang , Yu Li , Kewei Xu , Jiabao Gao , Binglei Zhao , Xuanhua Yang , Sulong Xu , Shengjie Li

Generative reward models (GRMs) for vision-language models (VLMs) often evaluate outputs via a three-stage pipeline: rubric generation, criterion-based scoring, and a final verdict. However, the intermediate rubric is rarely optimized…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Weijie Qiu , Dai Guan , Junxin Wang , Zhihang Li , Yongbo Gai , Mengyu Zhou , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

Generative Recommendation (GR) has emerged as a transformative paradigm with its end-to-end generation advantages. However, existing GR methods primarily focus on direct Semantic ID (SID) generation from interaction sequences, failing to…

Information Retrieval · Computer Science 2026-05-19 Zihao Guo , Jian Wang , Ruxin Zhou , Youhua Liu , Jiawei Guo , Jun Zhao , Xiaoxiao Xu , Yongqi Liu , Kaiqiao Zhan

Large Language Models have demonstrated outstanding performance across various downstream tasks and have been widely applied in multiple scenarios. Human-annotated preference data is used for training to further improve LLMs' performance,…

Computation and Language · Computer Science 2025-03-06 Shimao Zhang , Xiao Liu , Xin Zhang , Junxiao Liu , Zheheng Luo , Shujian Huang , Yeyun Gong

Recent work on reinforcement learning with verifiable rewards (RLVR) has shown that large language models (LLMs) can be substantially improved using outcome-level verification signals, such as unit tests for code or exact-match checks for…

Computation and Language · Computer Science 2026-01-27 Massimiliano Pronesti , Anya Belz , Yufang Hou

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

Recent advances in reinforcement learning from human feedback (RLHF) and preference optimization have substantially improved the usability, coherence, and safety of large language models. However, recurring behaviors such as performative…

Artificial Intelligence · Computer Science 2026-05-13 William Parris

Recently, there has been growing interest in developing the next-generation recommender systems (RSs) based on pretrained large language models (LLMs). However, the semantic gap between natural language and recommendation tasks is still not…

Information Retrieval · Computer Science 2024-02-23 Yaochen Zhu , Liang Wu , Qi Guo , Liangjie Hong , Jundong Li