English
Related papers

Related papers: RECTOR: Priority-Aware Rule-Based Reranking for Co…

200 papers

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing the complex reasoning capabilities of Large Reasoning Models. However, standard outcome-based supervision suffers from a critical…

Artificial Intelligence · Computer Science 2026-03-02 Yanwei Ren , Haotian Zhang , Likang Xiao , Xikai Zhang , Jiaxing Huang , Jiayan Qiu , Baosheng Yu , Quan Chen , Liu Liu

Multimodal Large Language Models (MLLMs) are rapidly becoming the intelligence brain of end-to-end autonomous driving systems. A key challenge is to assess whether MLLMs can truly understand and follow complex real-world traffic rules.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Enhui Ma , Jiahuan Zhang , Guantian Zheng , Tao Tang , Shengbo Eben Li , Yuhang Lu , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Zhihui Hao , Xianpeng Lang , Kaicheng Yu

Code agents are currently having skillful performance on repository-level software engineering benchmarks, but it remains unclear whether success on end-to-end tasks such as issue resolution truly reflects repository context reasoning, the…

Software Engineering · Computer Science 2026-05-27 Hanyu Li , Yichi Zhang , Speed Zhu , Hang Su , Jun Zhu , Yinpeng Dong

Preference-based Reinforcement Learning (PbRL) enables policy learning through simple queries comparing trajectories from a single policy. While human responses to these queries make it possible to learn policies aligned with human…

Robotics · Computer Science 2026-01-22 Yuki Kadokawa , Jonas Frey , Takahiro Miki , Takamitsu Matsubara , Marco Hutter

Large Language Models (LLMs) often fail to utilize their latent reasoning capabilities due to a distributional mismatch between ambiguous human inquiries and the structured logic required for machine activation. Existing alignment methods…

Computation and Language · Computer Science 2026-04-29 Yixiao Zhou , Dongzhou Cheng , zhiliang wu , Yi Yang , Yu Cheng , Hehe Fan

Two-hop QA retrieval splits queries into two regimes determined by whether the hop-2 entity is explicitly named in the question (Q-dominant) or only in the bridge passage (B-dominant). We formalize this split with three theorems: (T1)…

Information Retrieval · Computer Science 2026-04-29 Andre Bacellar

AI tutoring systems in engineering labs face a tension between providing sufficient assistance and preserving learning opportunities. Existing systems typically offer instructors limited control over assistance timing, content, or cost.…

Computers and Society · Computer Science 2026-05-01 Emmanuel A. Olowe , Danial Chitnis

Rubric-based evaluation has become a prevailing paradigm for evaluating instruction following in large language models (LLMs). Despite its widespread use, the reliability of these rubric-level evaluations remains unclear, calling for…

Artificial Intelligence · Computer Science 2026-03-27 Tianjun Pan , Xuan Lin , Wenyan Yang , Qianyu He , Shisong Chen , Licai Qi , Wanqing Xu , Hongwei Feng , Bo Xu , Yanghua Xiao

Large language models (LLMs) are increasingly deployed as automated evaluators that assign numeric scores to model outputs, a paradigm known as LLM-as-a-Judge. However, standard Reinforcement Learning (RL) methods typically rely on binary…

Machine Learning · Computer Science 2026-03-19 Yasi Zhang , Tianyu Chen , Mingyuan Zhou , Oscar Leong , Ying Nian Wu , Michal Lukasik

Navigating urban environments represents a complex task for automated vehicles. They must reach their goal safely and efficiently while considering a multitude of traffic participants. We propose a modular decision making algorithm to…

Robotics · Computer Science 2019-04-26 Maxime Bouton , Alireza Nakhaei , Kikuo Fujimura , Mykel J. Kochenderfer

We localize the policy routing mechanism in alignment-trained language models. An intermediate-layer attention gate reads detected content and triggers deeper amplifier heads that boost the signal toward refusal. In smaller models the gate…

Computation and Language · Computer Science 2026-05-04 Gregory N. Frank

In this work, we study how the relevance/quality and quantity of past data influence performance by analyzing a contextual Newsvendor problem, in which a decision-maker trades off between underage and overage costs under uncertain demand.…

Machine Learning · Computer Science 2025-10-13 Omar Besbes , Will Ma , Omar Mouchtaki

Probing studies what information is encoded in a frozen LLM's layer representations by training a lightweight predictor on top of them. Beyond analysis, probes are often used operationally in probe-then-steer pipelines: a learned concept…

Machine Learning · Computer Science 2026-02-05 Ziqi Gao , Yaotian Zhu , Qingcheng Zeng , Xu Zhao , Ziqing Wang , Feng Ruan , Kaize Ding

Recently, Reinforcement Learning from Verifiable Rewards (RLVR) has been established as a highly effective technique for augmenting the math reasoning skills of Large Language Models (LLMs) based on a single instance. Current…

Machine Learning · Computer Science 2026-05-05 Rudray Dave , Vedang Dubey , Smit Deoghare , Sudhakar Mishra

We propose FACTER, a fairness-aware framework for LLM-based recommendation systems that integrates conformal prediction with dynamic prompt engineering. By introducing an adaptive semantic variance threshold and a violation-triggered…

Information Retrieval · Computer Science 2025-02-06 Arya Fayyazi , Mehdi Kamal , Massoud Pedram

The combinatorial theory of rotor-routers has connections with problems of statistical mechanics, graph theory, chaos theory, and computer science. A rotor-router network defines a deterministic walk on a digraph G in which a particle walks…

Combinatorics · Mathematics 2011-11-08 Xiaoyu He

Automated scoring plays a crucial role in education by reducing the reliance on human raters, offering scalable and immediate evaluation of student work. While large language models (LLMs) have shown strong potential in this task, their use…

Computation and Language · Computer Science 2026-03-26 Yun Wang , Zhaojun Ding , Xuansheng Wu , Siyue Sun , Ninghao Liu , Xiaoming Zhai

Counterfactual learning to rank (CLTR) can be risky and, in various circumstances, can produce sub-optimal models that hurt performance when deployed. Safe CLTR was introduced to mitigate these risks when using inverse propensity scoring to…

Machine Learning · Computer Science 2024-08-08 Shashank Gupta , Harrie Oosterhuis , Maarten de Rijke

The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers…

Robotics · Computer Science 2019-04-02 Subramanya Nageshrao , Eric Tseng , Dimitar Filev

Ordinal regression and ranking are challenging due to inherent ordinal dependencies that conventional methods struggle to model. We propose Ranking-Aware Reinforcement Learning (RARL), a novel RL framework that explicitly learns these…

Machine Learning · Computer Science 2026-01-29 Aiming Hao , Chen Zhu , Jiashu Zhu , Jiahong Wu , Xiangxiang Chu