English
Related papers

Related papers: Optimal Stopping vs Best-of-$N$ for Inference Time…

200 papers

As large language models (LLMs) scale in size and adoption, their computational and environmental costs continue to rise. Prior benchmarking efforts have primarily focused on latency reduction in idealized settings, often overlooking the…

Computation and Language · Computer Science 2025-04-25 Jared Fernandez , Clara Na , Vashisth Tiwari , Yonatan Bisk , Sasha Luccioni , Emma Strubell

Large language models (LLMs) typically approach combinatorial optimization as an inference-time procedure, solving each instance separately through sampling, search, or repeated prompting. We ask whether reinforcement learning can instead…

Machine Learning · Computer Science 2026-05-19 Soheyl Massoudi , Gabriel Apaza , Milad Habibi , Mark Fuge

LLM search agents increasingly rely on tools at inference time, but their trajectories are often constrained by hard limits on both tool calls and generated tokens. Under such dual budgets, better answers require not only stronger models,…

Artificial Intelligence · Computer Science 2026-05-08 Zhengru Fang , Senkang Forest Hu , Zhonghao Chang , Yu Guo , Yihang Tao , Hongyao Liu , Mengzhe Ruan , Jun Huang , Yuguang Fang

Large Language Models (LLMs) have a natural role in answering complex queries about data streams, but the high computational cost of LLM inference makes them infeasible in many such tasks. We propose online cascade learning, the first…

Machine Learning · Computer Science 2024-06-19 Lunyiu Nie , Zhimin Ding , Erdong Hu , Christopher Jermaine , Swarat Chaudhuri

Large Language Model (LLM) based multi-agent systems (MAS) show remarkable potential in collaborative problem-solving, yet they still face critical challenges: low communication efficiency, poor scalability, and a lack of effective…

Computation and Language · Computer Science 2025-02-19 Weize Chen , Jiarui Yuan , Chen Qian , Cheng Yang , Zhiyuan Liu , Maosong Sun

Generative models have made significant impacts across various domains, largely due to their ability to scale during training by increasing data, computational resources, and model size, a phenomenon characterized by the scaling laws.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Nanye Ma , Shangyuan Tong , Haolin Jia , Hexiang Hu , Yu-Chuan Su , Mingda Zhang , Xuan Yang , Yandong Li , Tommi Jaakkola , Xuhui Jia , Saining Xie

Inference-time computation is a critical yet challenging paradigm for enhancing the reasoning performance of large language models (LLMs). While existing strategies improve reasoning stability and consistency, they suffer from notable…

Multiagent Systems · Computer Science 2025-10-23 Rui Jerry Huang , Wendy Liu , Anastasia Miin , Lei Ding

This paper studies the optimal dividend problem with a bounded payout rate in a partially observed regime-switching diffusion model, where, in practice, the market regime is unobserved and key model parameters are unknown. To address this…

Optimization and Control · Mathematics 2026-01-29 Zhongqin Gao , Yan Lv , Jingmin He

In human-in-the-loop reinforcement learning or environments where calculating a reward is expensive, the costly rewards can make learning efficiency challenging to achieve. The cost of obtaining feedback from humans or calculating expensive…

Machine Learning · Computer Science 2025-03-03 Muhammed Yusuf Satici , David L. Roberts

The emergence of LM-based judging reward modeling, represented by generative reward models, has successfully made reinforcement learning from AI feedback (RLAIF) efficient and scalable. To further advance this paradigm, we propose a core…

Computation and Language · Computer Science 2025-11-18 Meiling Ning , Zhongbao Zhang , Junda Ye , Jiabao Guo , Qingyuan Guan

Instruction-based language modeling has received significant attention in pretrained language models. However, the efficiency of instruction engineering remains low and hinders the development of instruction studies. Recent studies have…

Computation and Language · Computer Science 2023-10-27 Heng Yang , Ke Li

Recent advancements in large language models (LLMs) have catalyzed the rise of reasoning-intensive inference paradigms, where models perform explicit step-by-step reasoning before generating final answers. While such approaches improve…

Artificial Intelligence · Computer Science 2026-04-28 Zichuan Fu , Xian Wu , Guojing Li , Yejing Wang , Yijun Chen , Zihao Zhao , Yixuan Luo , Hanyu Yan , Yefeng Zheng , Xiangyu Zhao

Reinforcement learning (RL) has emerged as a powerful method for improving the reasoning abilities of large language models (LLMs). Outcome-based RL, which rewards policies solely for the correctness of the final answer, yields substantial…

Machine Learning · Computer Science 2025-09-09 Yuda Song , Julia Kempe , Remi Munos

Large Language Models (LLMs) present a critical trade-off between inference quality and computational cost: larger models offer superior capabilities but incur significant latency, while smaller models are faster but less powerful. Existing…

Machine Learning · Computer Science 2025-05-13 Hang Wu , Jianian Zhu , Yinghui Li , Haojie Wang , Biao Hou , Jidong Zhai

Large Language Models (LLMs) exhibit impressive capabilities but require careful alignment with human preferences. Traditional training-time methods finetune LLMs using human preference datasets but incur significant training costs and…

Computation and Language · Computer Science 2025-07-16 Yuancheng Xu , Udari Madhushani Sehwag , Alec Koppel , Sicheng Zhu , Bang An , Furong Huang , Sumitra Ganesh

Offline inverse reinforcement learning (Offline IRL) aims to recover the structure of rewards and environment dynamics that underlie observed actions in a fixed, finite set of demonstrations from an expert agent. Accurate models of…

Machine Learning · Computer Science 2024-03-01 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

Large language models (LLMs) have been a disruptive innovation in recent years, and they play a crucial role in our daily lives due to their ability to understand and generate human-like text. Their capabilities include natural language…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Akrit Mudvari , Yuang Jiang , Leandros Tassiulas

We study optimal stopping for diffusion processes with unknown model primitives within the continuous-time reinforcement learning (RL) framework developed by Wang et al. (2020), and present applications to option pricing and portfolio…

Optimization and Control · Mathematics 2025-08-12 Min Dai , Yu Sun , Zuo Quan Xu , Xun Yu Zhou

Self-Rewarding Language Models propose an architecture in which the Large Language Models(LLMs) both generates responses and evaluates its own outputs via LLM-as-a-Judge prompting, dynamically improving its generative capabilities through…

Computation and Language · Computer Science 2025-08-11 Yidong Wang , Xin Wang , Cunxiang Wang , Junfeng Fang , Qiufeng Wang , Jianing Chu , Xuran Meng , Shuxun Yang , Libo Qin , Yue Zhang , Wei Ye , Shikun Zhang

Recent advances in diffusion language models (DLMs) have presented a promising alternative to traditional autoregressive large language models (LLMs). However, DLMs still lag behind LLMs in reasoning performance, especially as the number of…

Computation and Language · Computer Science 2025-10-27 Chenglong Wang , Yang Gan , Hang Zhou , Chi Hu , Yongyu Mu , Kai Song , Murun Yang , Bei Li , Chunliang Zhang , Tongran Liu , Jingbo Zhu , Zhengtao Yu , Tong Xiao
‹ Prev 1 8 9 10 Next ›