English
Related papers

Related papers: Cast-R1: Learning Tool-Augmented Sequential Decisi…

200 papers

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

Artificial Intelligence · Computer Science 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

Sequential recommendation (SR) aims to predict a user's next action by learning from their historical interaction sequences. In real-world applications, these models require periodic updates to adapt to new interactions and evolving user…

Information Retrieval · Computer Science 2026-02-12 Xiaomeng Song , Xinru Wang , Hanbing Wang , Hongyu Lu , Yu Chen , Zhaochun Ren , Zhumin Chen

We introduce a novel modeling approach for time series imputation and forecasting, tailored to address the challenges often encountered in real-world data, such as irregular samples, missing data, or unaligned measurements from multiple…

Many autonomous systems, such as robots and self-driving cars, involve real-time decision making in complex environments, and require prediction of future outcomes from limited data. Moreover, their decisions are increasingly required to be…

Robotics · Computer Science 2021-05-26 Erfan Aasi , Cristian Ioan Vasile , Mahroo Bahreinian , Calin Belta

The proliferation of time series foundation models has created a landscape where no single method achieves consistent superiority, framing the central challenge not as finding the best model, but as orchestrating an optimal ensemble with…

Artificial Intelligence · Computer Science 2025-12-19 Defu Cao , Michael Gee , Jinbo Liu , Hengxuan Wang , Wei Yang , Rui Wang , Yan Liu

Large language models (LLMs) exhibit strong symbolic and compositional reasoning, yet they struggle with time series question answering as the data is typically transformed into an LLM-compatible modality, e.g., serialized text, plotted…

Artificial Intelligence · Computer Science 2026-04-08 Penghang Liu , Elizabeth Fons , Annita Vapsi , Mohsen Ghassemi , Svitlana Vyetrenko , Daniel Borrajo , Vamsi K. Potluru , Manuela Veloso

Early artificial intelligence paradigms exhibited separated cognitive functions: Neural Networks focused on "perception-representation," Reinforcement Learning on "decision-making-behavior," and Symbolic AI on "knowledge-reasoning." With…

Artificial Intelligence · Computer Science 2026-01-07 Zhi Liu , Guangzhi Wang

In this paper, we propose a new procedure for unconditional and conditional forecasting in agent-based models. The proposed algorithm is based on the application of amortized neural networks and consists of two steps. The first step…

Econometrics · Economics 2023-08-14 Denis Koshelev , Alexey Ponomarenko , Sergei Seleznev

Time series forecasting is a key component in many industrial and business decision processes and recurrent neural network (RNN) based models have achieved impressive progress on various time series forecasting tasks. However, most of the…

Machine Learning · Computer Science 2021-01-26 Zekai Chen , Jiaze E , Xiao Zhang , Hao Sheng , Xiuzheng Cheng

Time series forecasting involves collecting and analyzing past observations to develop a model to extrapolate such observations into the future. Forecasting of future events is important in many fields to support decision making as it…

Machine Learning · Computer Science 2020-09-22 Igor Ilic , Berk Gorgulu , Mucahit Cevik , Mustafa Gokce Baydogan

Stochastic resetting, the procedure of stopping and re-initializing random processes, has recently emerged as a powerful tool for accelerating processes ranging from queuing systems to molecular simulations. However, its usefulness is…

Statistical Mechanics · Physics 2025-03-18 Tommer D. Keidar , Ofir Blumer , Barak Hirshberg , Shlomi Reuveni

Large language models (LLMs) have demonstrated strong capabilities in language understanding and reasoning, yet they remain limited when tackling real-world tasks that require up-to-date knowledge, precise operations, or specialized tool…

Machine Learning · Computer Science 2025-09-17 Yabo Zhang , Yihan Zeng , Qingyun Li , Zhen Hu , Kavin Han , Wangmeng Zuo

Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they remain limited in long-horizon multimodal scenarios, often suffering from visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chenghao Li , Fusheng Hao , Xikai Zhang , Likang Xiao , Yanwei Ren , Fuxiang Wu , Quan Chen , Liu Liu

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

How should an agent decide when and how to plan? A dominant approach builds agents as reactive policies with adaptive computation (e.g., chain-of-thought), trained end-to-end expecting planning to emerge implicitly. Without control over the…

Artificial Intelligence · Computer Science 2026-05-22 Mingkai Deng , Jinyu Hou , Lara Sá Neves , Varad Pimpalkhute , Taylor W. Killian , Zhengzhong Liu , Eric P. Xing

Most decision-focused learning work has focused on single stage problems whereas many real-world decision problems are more appropriately modelled using multistage optimisation. In multistage problems contextual information is revealed over…

Optimization and Control · Mathematics 2025-05-29 Egon Peršak , Miguel F. Anjos

Robots and autonomous agents often complete goal-based tasks with limited resources, relying on imperfect models and sensor measurements. In particular, reinforcement learning (RL) and feedback control can be used to help a robot achieve a…

Artificial Intelligence · Computer Science 2018-09-26 Aleksandra Faust , James B. Aimone , Conrad D. James , Lydia Tapia

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to overcome the knowledge limitations of Large Language Models (LLMs) by integrating external retrieval with language generation. While early RAG systems based on…

Artificial Intelligence · Computer Science 2025-06-13 Jintao Liang , Gang Su , Huifeng Lin , You Wu , Rui Zhao , Ziyue Li

Time series analysis underpins many real-world applications, yet existing time-series-specific methods and pretrained large-model-based approaches remain limited in integrating intuitive visual reasoning and generalizing across tasks with…

Artificial Intelligence · Computer Science 2026-02-04 Weilin Ruan , Yuxuan Liang

Multistage stochastic programming provides a modeling framework for sequential decision-making problems that involve uncertainty. One typically overlooked aspect of this methodology is how uncertainty is incorporated into modeling.…

Optimization and Control · Mathematics 2021-09-24 Juyoung Wang , Mucahit Cevik , Merve Bodur