English
Related papers

Related papers: Cast-R1: Learning Tool-Augmented Sequential Decisi…

200 papers

Deep learning has achieved strong performance in Time Series Forecasting (TSF). However, we identify a critical representation paradox, termed Latent Chaos: models with accurate predictions often learn latent representations that are…

Machine Learning · Computer Science 2026-05-13 Jie Yang , Yifan Hu , Yuante Li , Kexin Zhang , Kaize Ding , Philip S. Yu

While modern recommender systems are instrumental in navigating information abundance, they remain fundamentally limited by static user modeling and reactive decision-making paradigms. Current large language model (LLM)-based agents inherit…

Artificial Intelligence · Computer Science 2025-08-27 Chenghao Wu , Ruiyang Ren , Junjie Zhang , Ruirui Wang , Zhongrui Ma , Qi Ye , Wayne Xin Zhao

Agentic search has recently emerged as a powerful paradigm, where an agent interleaves multi-step reasoning with on-demand retrieval to solve complex questions. Despite its success, how to design a retriever for agentic search remains…

Information Retrieval · Computer Science 2026-01-22 Wenhan Liu , Xinyu Ma , Yutao Zhu , Yuchen Li , Daiting Shi , Dawei Yin , Zhicheng Dou

Catastrophic forgetting means that a trained neural network model gradually forgets the previously learned tasks when being retrained on new tasks. Overcoming the forgetting problem is a major problem in machine learning. Numerous continual…

Machine Learning · Computer Science 2021-07-19 Yujiang He , Bernhard Sick

Recent studies on long-term time series forecasting have shown that simple linear models and MLP-based predictors can achieve strong performance without increasingly complex architectures. However, many competitive baselines still rely on…

Machine Learning · Computer Science 2026-05-14 Zhenan Yu , Guangxin Jiang , Jin Yang

Time series forecasting has always been a thought-provoking topic in the field of machine learning. Machine learning scientists define a time series as a set of observations recorded over consistent time steps. And, time series forecasting…

Quantum Physics · Physics 2022-07-19 Payal Kaushik , Sayantan Pramanik , M Girish Chandra , C V Sridhar

The prediction of time series is a challenging task relevant in such diverse applications as analyzing financial data, forecasting flow dynamics or understanding biological processes. Especially chaotic time series that depend on a long…

Machine Learning · Computer Science 2024-12-06 Johannes Viehweg , Dominik Walther , Patrick Mäder

When developing reinforcement learning agents, the standard approach is to train an agent to converge to a fixed policy that is as close to optimal as possible for a single fixed reward function. If different agent behaviour is required in…

Multiagent Systems · Computer Science 2021-01-29 David O'Callaghan , Patrick Mannion

Particle accelerators are complex facilities that produce large amounts of structured data and have clear optimization goals as well as precisely defined control requirements. As such they are naturally amenable to data-driven research…

Accelerator Physics · Physics 2023-03-01 Sichen Li , Andreas Adelmann

Reinforcement learning (RL) for large language models (LLMs) increasingly relies on sparse, outcome-level rewards -- yet determining which actions within a long trajectory caused the outcome remains difficult. This credit assignment (CA)…

Computation and Language · Computer Science 2026-04-14 Chenchen Zhang

The rapid evolution of agentic AI marks a new phase in artificial intelligence, where Large Language Models (LLMs) no longer merely respond but act, reason, and adapt. This survey traces the paradigm shift in building agentic AI: from…

Artificial Intelligence · Computer Science 2025-10-28 Jitao Sang , Jinlin Xiao , Jiarun Han , Jilin Chen , Xiaoyi Chen , Shuyu Wei , Yongjie Sun , Yuhang Wang

Although Transformer has made breakthrough success in widespread domains especially in Natural Language Processing (NLP), applying it to time series forecasting is still a great challenge. In time series forecasting, the autoregressive…

Machine Learning · Computer Science 2021-06-01 Kai Chen , Guang Chen , Dan Xu , Lijun Zhang , Yuyao Huang , Alois Knoll

Recent studies have demonstrated the great power of Transformer models for time series forecasting. One of the key elements that lead to the transformer's success is the channel-independent (CI) strategy to improve the training robustness.…

Machine Learning · Computer Science 2024-02-19 Wang Xue , Tian Zhou , Qingsong Wen , Jinyang Gao , Bolin Ding , Rong Jin

Although the rise of large language models (LLMs) has introduced new opportunities for time series forecasting, existing LLM-based solutions require excessive training and exhibit limited transferability. In view of these challenges, we…

Artificial Intelligence · Computer Science 2024-12-24 Silin Yang , Dong Wang , Haoqi Zheng , Ruochun Jin

Time series models aim for accurate predictions of the future given the past, where the forecasts are used for important downstream tasks like business decision making. In practice, deep learning based time series models come in many forms,…

Machine Learning · Computer Science 2022-06-01 Kashif Rasul , Young-Jin Park , Max Nihlén Ramström , Kyung-Min Kim

Time series data widely exist in real-world cyber-physical systems. Though analyzing and interpreting them contributes to significant values, e.g, disaster prediction and financial risk control, current workflows mainly rely on human data…

Machine Learning · Computer Science 2026-01-21 Xingjian Wu , Junkai Lu , Zhengyu Li , Xiangfei Qiu , Jilin Hu , Chenjuan Guo , Christian S. Jensen , Bin Yang

Problems which require both long-horizon planning and continuous control capabilities pose significant challenges to existing reinforcement learning agents. In this paper we introduce a novel hierarchical reinforcement learning agent which…

Machine Learning · Computer Science 2023-07-25 Jan Achterhold , Markus Krimmel , Joerg Stueckler

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

Temporal point process is an expressive tool for modeling event sequences over time. In this paper, we take a reinforcement learning view whereby the observed sequences are assumed to be generated from a mixture of latent policies. The…

Machine Learning · Computer Science 2019-07-01 Weichang Wu , Junchi Yan , Xiaokang Yang , Hongyuan Zha

Enabling agentic AI systems to adapt their problem-solving approaches based on post-training interactions remains a fundamental challenge. While systems that update and maintain a memory at inference time have been proposed, existing…

Artificial Intelligence · Computer Science 2025-11-17 Adam Stein , Matthew Trager , Benjamin Bowman , Michael Kleinman , Aditya Chattopadhyay , Wei Xia , Stefano Soatto