English
Related papers

Related papers: Voting with the Graph: Stable RLAIF via Topologica…

200 papers

knowledge graph-based recommendation methods have achieved great success in the field of recommender systems. However, over-reliance on high-quality knowledge graphs is a bottleneck for such methods. Specifically, the long-tailed…

Information Retrieval · Computer Science 2023-10-03 Yubo Gao , Haotian Wu

Reinforcement Learning from Human/AI Feedback (RLHF/RLAIF) has been extensively utilized for preference alignment of text-to-image models. Existing methods face certain limitations in terms of both data and algorithm. For training data,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Xingyu Lu , Yuhang Hu , YiFan Zhang , Kaiyu Jiang , Changyi Liu , Tianke Zhang , Jinpeng Wang , Chun Yuan , Bin Wen , Fan Yang , Tingting Gao , Di Zhang

Safety is essential for reinforcement learning (RL) applied in real-world situations. Chance constraints are suitable to represent the safety requirements in stochastic systems. Previous chance-constrained RL methods usually have a low…

Machine Learning · Computer Science 2021-03-17 Baiyu Peng , Yao Mu , Yang Guan , Shengbo Eben Li , Yuming Yin , Jianyu Chen

Click-through Rate (CTR) prediction in real-world recommender systems often deals with billions of user interactions every day. To improve the training efficiency, it is common to update the CTR prediction model incrementally using the new…

Information Retrieval · Computer Science 2025-05-07 Zhikai Wang , Yanyan Shen , Zibin Zhang , Kangyi Lin

Evaluating mathematical reasoning in LLMs is constrained by limited benchmark sizes and inherent model stochasticity, yielding high-variance accuracy estimates and unstable rankings across platforms. On difficult problems, an LLM may fail…

Machine Learning · Computer Science 2026-02-04 Zihan Dong , Zhixian Zhang , Yang Zhou , Can Jin , Ruijia Wu , Linjun Zhang

The success of AI assistants based on language models (LLMs) hinges crucially on Reinforcement Learning from Human Feedback (RLHF), which enables the generation of responses more aligned with human preferences. As universal AI assistants,…

Machine Learning · Computer Science 2023-12-27 Rui Zheng , Wei Shen , Yuan Hua , Wenbin Lai , Shihan Dou , Yuhao Zhou , Zhiheng Xi , Xiao Wang , Haoran Huang , Tao Gui , Qi Zhang , Xuanjing Huang

Reinforcement Learning with Verifiable Rewards (RLVR) replaces costly human labeling with automated verifiers. To reduce verifier hacking, many RLVR systems binarize rewards to $\{0,1\}$, but imperfect verifiers inevitably introduce…

Machine Learning · Computer Science 2026-05-25 Xin-Qiang Cai , Wei Wang , Feng Liu , Tongliang Liu , Gang Niu , Masashi Sugiyama

Post-processing techniques have been shown to improve the quality of the decision stream generated by classifiers used in pattern-recognition-based myoelectric control. However, these techniques have largely been tested individually and on…

Signal Processing · Electrical Eng. & Systems 2024-09-24 Shriram Tallam Puranam Raghu , Dawn MacIsaac , Erik Scheme

Many real-world systems undergo abrupt changes in dynamics as they move across critical points, often with dramatic consequences. Much existing theory on identifying the time-series signatures of nearby critical points -- such as increased…

Data Analysis, Statistics and Probability · Physics 2024-10-03 Brendan Harris , Leonardo L. Gollo , Ben D. Fulcher

In real-world applications of reinforcement learning (RL), noise from inherent stochasticity of environments is inevitable. However, current policy evaluation algorithms, which plays a key role in many RL algorithms, are either prone to…

Machine Learning · Computer Science 2019-06-19 Tadashi Kozuno , Dongqi Han , Kenji Doya

Neural network controllers increasingly demand millions of parameters, and language model approaches push into the billions. For embedded aerospace systems with strict power and latency constraints, this scaling is prohibitive. We present…

Machine Learning · Computer Science 2025-12-19 Amit Jain , Richard Linares

Large reasoning models (LRMs), such as OpenAI's o1 and DeepSeek-R1, harness test-time scaling to perform multi-step reasoning for complex problem-solving. This reasoning process, executed before producing final answers, is often guided by…

Computation and Language · Computer Science 2026-03-10 Chongyu Fan , Yihua Zhang , Jinghan Jia , Alfred Hero , Sijia Liu

Diffusion models have emerged as a powerful paradigm for generative sequential recommendation, which typically generate next items to recommend guided by user interaction histories with a multi-step denoising process. However, the…

Information Retrieval · Computer Science 2025-10-23 Wenyu Mao , Jiancan Wu , Guoqing Hu , Zhengyi Yang , Wei Ji , Xiang Wang

Reinforcement Learning from Verifiable Rewards (RLVR) on chain-of-thought reasoning has become a standard part of language model post-training recipes. A common assumption is that the reasoning chains trained through RLVR reliably represent…

Computation and Language · Computer Science 2026-04-27 Qinan Yu , Alexa Tartaglini , Peter Hase , Carlos Guestrin , Christopher Potts

Click-Through Rate (CTR) prediction, crucial in applications like recommender systems and online advertising, involves ranking items based on the likelihood of user clicks. User behavior sequence modeling has marked progress in CTR…

Information Retrieval · Computer Science 2023-08-22 Hengyu Zhang , Chang Meng , Wei Guo , Huifeng Guo , Jieming Zhu , Guangpeng Zhao , Ruiming Tang , Xiu Li

Click-through rate (CTR) prediction is a critical task in online advertising and recommender systems, relying on effective modeling of feature interactions. Explicit interactions capture predefined relationships, such as inner products, but…

Information Retrieval · Computer Science 2025-05-27 Kefan Wang , Hao Wang , Wei Guo , Yong Liu , Jianghao Lin , Defu Lian , Enhong Chen

Reward models (RMs) play a pivotal role in aligning large language models (LLMs) with human values. However, noisy preferences in human feedback can lead to reward misgeneralization - a phenomenon where reward models learn spurious…

Time series forecasting (TSF) holds significant importance in modern society, spanning numerous domains. Previous representation learning-based TSF algorithms typically embrace a contrastive learning paradigm featuring segregated…

Machine Learning · Computer Science 2023-12-12 Jiaxin Gao , Yuxiao Hu , Qinglong Cao , Siqi Dai , Yuntian Chen

The success of Large Language Models (LLMs) has motivated a shift toward generative approaches to retrieval and ranking, aiming to supersede classical Dual Encoders (DEs) and Cross Encoders (CEs). A prominent paradigm is pointwise…

Information Retrieval · Computer Science 2026-02-12 Benjamin Rozonoyer , Chong You , Michael Boratko , Himanshu Jain , Nilesh Gupta , Srinadh Bhojanapalli , Andrew McCallum , Felix Yu

Large Language Model (LLM) agents can increasingly automate complex reasoning through Test-Time Scaling (TTS), iterative refinement guided by reward signals. However, many real-world tasks involve multi-stage pipeline whose final outcomes…

Machine Learning · Computer Science 2025-12-30 Shuyu Gan , James Mooney , Pan Hao , Renxiang Wang , Mingyi Hong , Qianwen Wang , Dongyeop Kang