English
Related papers

Related papers: Next Embedding Prediction Makes World Models Stron…

200 papers

Model-based reinforcement learning (MBRL) has been used to efficiently solve vision-based control tasks in highdimensional image observations. Although recent MBRL algorithms perform well in trained observations, they fail when faced with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Jeongsoo Ha , Kyungsoo Kim , Yusung Kim

To generate coherent responses, language models infer unobserved meaning from their input text sequence. One potential explanation for this capability arises from theories of delay embeddings in dynamical systems, which prove that…

Machine Learning · Computer Science 2024-06-19 Mitchell Ostrow , Adam Eisen , Ila Fiete

People navigating in unfamiliar buildings take advantage of myriad visual, spatial and semantic cues to efficiently achieve their navigation goals. Towards equipping computational agents with similar capabilities, we introduce Pathdreamer,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Jing Yu Koh , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

Neural Radiance Field (NeRF) and its variants have recently emerged as successful methods for novel view synthesis and 3D scene reconstruction. However, most current NeRF models either achieve high accuracy using large model sizes, or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Shiran Yuan , Hao Zhao

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

This study proposes a novel approach that combines theory and data-driven choice models using Artificial Neural Networks (ANNs). In particular, we use continuous vector representations, called embeddings, for encoding categorical or…

Machine Learning · Statistics 2021-10-01 Ioanna Arkoudi , Carlos Lima Azevedo , Francisco C. Pereira

Neural Architecture Representation Learning aims to transform network models into feature representations for predicting network attributes, playing a crucial role in deploying and designing networks for real-world applications. Recently,…

Machine Learning · Computer Science 2025-06-10 Haizhao Jing , Haokui Zhang , Zhenhao Shang , Rong Xiao , Peng Wang , Yanning Zhang

Model-based reinforcement learning (MBRL) has been a primary approach to ameliorating the sample efficiency issue as well as to make a generalist agent. However, there has not been much effort toward enhancing the strategy of dreaming…

Machine Learning · Computer Science 2024-06-05 Hany Hamed , Subin Kim , Dongyeong Kim , Jaesik Yoon , Sungjin Ahn

Traditionally, reinforcement learning (RL) agents learn to solve new tasks by updating their neural network parameters through interactions with the task environment. However, recent works demonstrate that some RL agents, after certain…

Machine Learning · Computer Science 2025-02-26 Jiuqi Wang , Ethan Blaser , Hadi Daneshmand , Shangtong Zhang

Deep reinforcement learning (DRL) agents are often sensitive to visual changes that were unseen in their training environments. To address this problem, we leverage the sequential nature of RL to learn robust representations that encode…

Artificial Intelligence · Computer Science 2022-07-15 Jiameng Fan , Wenchao Li

In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an explicit planning…

In reinforcement learning (RL), state representations are key to dealing with large or continuous state spaces. While one of the promises of deep learning algorithms is to automatically construct features well-tuned for the task they try to…

Machine Learning · Computer Science 2023-06-21 Charline Le Lan , Stephen Tu , Mark Rowland , Anna Harutyunyan , Rishabh Agarwal , Marc G. Bellemare , Will Dabney

To ensure safe clinical integration, deep learning models must provide more than just high accuracy; they require dependable uncertainty quantification. While current Medical Vision Transformers perform well, they frequently struggle with…

Image and Video Processing · Electrical Eng. & Systems 2026-04-13 Mohammed Maaz Sibhai , Abedalrhman Alkhateeb , Saad B. Ahmed

Dynamic representation learning plays a pivotal role in understanding the evolution of linguistic content over time. On this front both context and time dynamics as well as their interplay are of prime importance. Current approaches model…

Computation and Language · Computer Science 2024-10-23 Talia Tseriotou , Adam Tsakalidis , Maria Liakata

Recent studies show that deep reinforcement learning (DRL) agents tend to overfit to the task on which they were trained and fail to adapt to minor environment changes. To expedite learning when transferring to unseen tasks, we propose a…

Artificial Intelligence · Computer Science 2024-02-22 Guy Azran , Mohamad H. Danesh , Stefano V. Albrecht , Sarah Keren

Real-world time series are often governed by complex nonlinear dynamics. Understanding these underlying dynamics is crucial for precise future prediction. While deep learning has achieved major success in time series forecasting, many…

Machine Learning · Computer Science 2026-05-26 Abrar Majeedi , Viswanatha Reddy Gajjala , Satya Sai Srinath Namburi GNVV , Nada Magdi Elkordi , Yin Li

In neuroscience, one of the key behavioral tests for determining whether a subject of study exhibits model-based behavior is to study its adaptiveness to local changes in the environment. In reinforcement learning, however, recent studies…

Machine Learning · Computer Science 2024-05-28 Safa Alver , Ali Rahimi-Kalahroudi , Doina Precup

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

The real world is inherently non-stationary, with ever-changing factors, such as weather conditions and traffic flows, making it challenging for agents to adapt to varying environmental dynamics. Non-Stationary Reinforcement Learning (NSRL)…

Machine Learning · Computer Science 2025-10-07 Min Wang , Xin Li , Ye He , Yao-Hui Li , Hasnaa Bennis , Riashat Islam , Mingzhong Wang

Time series forecasting is a crucial challenge with significant applications in areas such as weather prediction, stock market analysis, and scientific simulations. This paper introduces an embedded decomposed transformer, 'EDformer', for…

Machine Learning · Computer Science 2024-12-18 Sanjay Chakraborty , Ibrahim Delibasoglu , Fredrik Heintz