English
Related papers

Related papers: Lookahead Path Likelihood Optimization for Diffusi…

200 papers

Discovering improved policy optimization algorithms for language models remains a costly manual process requiring repeated mechanism-level modification and validation. Unlike simple combinatorial code search, this problem requires searching…

Computation and Language · Computer Science 2026-03-26 Sirui Xia , Yikai Zhang , Aili Chen , Siye Wu , Siyu Yuan , Yanghua Xiao

Recurrent neural networks are able to learn complex long-term relationships from sequential data and output a pdf over the state space. Therefore, recurrent models are a natural choice to address path prediction tasks, where a trained model…

Computer Vision and Pattern Recognition · Computer Science 2018-08-30 Ronny Hug , Stefan Becker , Wolfgang Hübner , Michael Arens

We introduce LAMPO, a novel paradigm that leverages Large Language Models (LLMs) for solving few-shot multi-class ordinal classification tasks. Unlike conventional methods, which concatenate all demonstration examples with the test instance…

Machine Learning · Computer Science 2024-08-08 Zhen Qin , Junru Wu , Jiaming Shen , Tianqi Liu , Xuanhui Wang

This paper considers the average complexity of maximum likelihood (ML) decoding of convolutional codes. ML decoding can be modeled as finding the most probable path taken through a Markov graph. Integrated with the Viterbi algorithm (VA),…

Information Theory · Computer Science 2016-11-17 Jie Luo

Large language models (LLMs) are empowering decision-making in several applications, including tool or API usage and answering multiple-choice questions (MCQs). However, incorrect outputs pose significant risks in high-stakes domains like…

Machine Learning · Computer Science 2025-07-15 Harit Vishwakarma , Alan Mishler , Thomas Cook , Niccolò Dalmasso , Natraj Raman , Sumitra Ganesh

Large Language Models (LLMs) have been widely employed in programming language analysis to enhance human productivity. Yet, their reliability can be compromised by various code distribution shifts, leading to inconsistent outputs. While…

Software Engineering · Computer Science 2024-02-12 Yufei Li , Simin Chen , Yanghong Guo , Wei Yang , Yue Dong , Cong Liu

Optimal decision-making under partial observability requires agents to balance reducing uncertainty (exploration) against pursuing immediate objectives (exploitation). In this paper, we introduce a novel policy optimization framework for…

Machine Learning · Computer Science 2025-12-05 Hany Abdulsamad , Sahel Iqbal , Simo Särkkä

Chain-of-Thought (CoT) reasoning has been demonstrated as an effective technique for improving the problem-solving capabilities of large language models (LLMs) in the context of code generation. However, existing CoT methods often exhibit a…

Software Engineering · Computer Science 2025-03-20 Yuqi Zhu , Ge Li , Xue Jiang , Jia Li , Hong Mei , Zhi Jin , Yihong Dong

Strategic planning is critical for multi-step reasoning, yet compact Large Language Models (LLMs) often lack the capacity to formulate global strategies, leading to error propagation in long-horizon tasks. Our analysis reveals that LLMs…

Computation and Language · Computer Science 2026-04-15 Haoyu Zheng , Yun Zhu , Yuqian Yuan , Bo Yuan , Wenqiao Zhang , Siliang Tang , Jun Xiao

Large language models (LLMs) are increasingly explored for NP-hard combinatorial optimization problems, but most existing methods emphasize feasible-instance solution generation and do not explicitly address infeasibility detection. We…

Artificial Intelligence · Computer Science 2026-04-15 Yakun Wang , Min Chen , Zeguan Wu , Junyu Liu , Sitao Zhang , Zhenwen Shao

Large Language Diffusion Models (LLDMs) benefit from a flexible decoding mechanism that enables parallelized inference and controllable generations over autoregressive models. Yet such flexibility introduces a critical challenge: inference…

Machine Learning · Computer Science 2025-12-05 Yichuan Mo , Quan Chen , Mingjie Li , Zeming Wei , Yisen Wang

Despite large language models (LLMs) have achieved remarkable success, their prefix-only prompting paradigm and sequential generation process offer limited flexibility for bidirectional information. Diffusion large language models (dLLMs)…

Computation and Language · Computer Science 2025-10-14 Xiangqi Jin , Yuxuan Wang , Yifeng Gao , Zichen Wen , Biqing Qi , Dongrui Liu , Linfeng Zhang

We introduce a tool for rigorous and automated verification of large language model (LLM)- based policies in memoryless sequential decision-making tasks. Given a Markov decision process (MDP) representing the sequential decision-making…

Artificial Intelligence · Computer Science 2025-10-09 Dennis Gross , Helge Spieker , Arnaud Gotlieb

In information retrieval, large language models (LLMs) have demonstrated remarkable potential in text reranking tasks by leveraging their sophisticated natural language understanding and advanced reasoning capabilities. However,…

Information Retrieval · Computer Science 2025-09-22 Haowei Liu , Xuyang Wu , Guohao Sun , Zhiqiang Tao , Yi Fang

Large Language Models (LLMs) have shown remarkable promise in reasoning and decision-making, yet their integration with Reinforcement Learning (RL) for complex robotic tasks remains underexplored. In this paper, we propose an LLM-guided…

Machine Learning · Computer Science 2025-03-26 Chak Lam Shek , Pratap Tokekar

Large language models (LLMs) have significant potential to improve operational efficiency in operations management. Deploying these models requires specifying a policy that governs response quality, shapes user experience, and influences…

Machine Learning · Computer Science 2026-04-13 Mingjie Hu , Siyang Gao , Jian-qiang Hu , Enlu Zhou

Partial-label learning (PLL) is a typical weakly supervised learning problem, where each training instance is equipped with a set of candidate labels among which only one is the true label. Most existing methods elaborately designed…

Machine Learning · Computer Science 2020-09-08 Jiaqi Lv , Miao Xu , Lei Feng , Gang Niu , Xin Geng , Masashi Sugiyama

Diffusion Language Models (DLMs) have recently emerged as a strong alternative to autoregressive language models (LMs). DLMs offer comparable accuracy with faster inference speed via parallel decoding. However, standard DLM decoding…

Machine Learning · Computer Science 2025-11-27 Hengyu Fu , Baihe Huang , Virginia Adams , Charles Wang , Venkat Srinivasan , Jiantao Jiao

Large language models (LLMs) demonstrate remarkable emergent abilities to perform in-context learning across various tasks, including time series forecasting. This work investigates LLMs' ability to estimate probability density functions…

Machine Learning · Computer Science 2025-03-05 Toni J. B. Liu , Nicolas Boullé , Raphaël Sarfati , Christopher J. Earls

Reinforcement Learning (RL) is known for its strong decision-making capabilities and has been widely applied in various real-world scenarios. However, with the increasing availability of offline datasets and the lack of well-designed online…

Machine Learning · Computer Science 2025-09-03 Hanping Zhang , Yuhong Guo