English
Related papers

Related papers: State Chrono Representation for Enhancing Generali…

200 papers

Market regime shifts induce distribution shifts that can degrade the performance of portfolio rebalancing policies. We propose macro-conditioned scenario-context rollout (SCR) that generates plausible next-day multivariate return scenarios…

Artificial Intelligence · Computer Science 2026-03-02 Vanya Priscillia Bendatu , Yao Lu

Many real-world applications require an agent to make robust and deliberate decisions with multimodal information (e.g., robots with multi-sensory inputs). However, it is very challenging to train the agent via reinforcement learning (RL)…

Machine Learning · Computer Science 2023-02-21 Jinming Ma , Feng Wu , Yingfeng Chen , Xianpeng Ji , Yu Ding

Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Robert Lee , Serena Mou , Jake Bruce , Niko Sünderhauf , Jürgen Leitner

The electromagnetic inverse problem has long been a research hotspot. This study aims to reverse radar view angles in synthetic aperture radar (SAR) images given a target model. Nonetheless, the scarcity of SAR data, combined with the…

Machine Learning · Computer Science 2024-01-03 Yanni Wang , Hecheng Jia , Shilei Fu , Huiping Lin , Feng Xu

Deep Reinforcement Learning (RL) has demonstrated success in solving complex sequential decision-making problems by integrating neural networks with the RL framework. However, training deep RL models poses several challenges, such as the…

Machine Learning · Computer Science 2025-09-30 Sooraj Sathish , Keshav Goyal , Raghuram Bharadwaj Diddigi

Reinforcement learning has long struggled with poor sample efficiency. One promising approach to mitigate this problem is leveraging group-invariant Markov Decision Processes ($G$-invariant MDPs). Existing works in this direction have…

Machine Learning · Computer Science 2026-05-25 Shuai Zhen , Yifan Zhang , Yuling Wang , Yanhua Yu

The ability to autonomously learn behaviors via direct interactions in uninstrumented environments can lead to generalist robots capable of enhancing productivity or providing care in unstructured settings like homes. Such uninstrumented…

Robotics · Computer Science 2021-11-15 Rutav Shah , Vikash Kumar

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

Both animals and artificial agents benefit from state representations that support rapid transfer of learning across tasks and which enable them to efficiently traverse their environments to reach rewarding states. The successor…

Machine Learning · Computer Science 2021-11-09 Ted Moskovitz , Spencer R. Wilson , Maneesh Sahani

Continuous-time reinforcement learning (CTRL) provides a principled framework for sequential decision-making in environments where interactions evolve continuously over time. Despite its empirical success, the theoretical understanding of…

Machine Learning · Computer Science 2025-05-22 Runze Zhao , Yue Yu , Adams Yiyue Zhu , Chen Yang , Dongruo Zhou

State-space models (SSMs) offer a powerful framework for dynamical system analysis, wherein the temporal dynamics of the system are assumed to be captured through the evolution of the latent states, which govern the values of the…

Machine Learning · Statistics 2024-12-17 Jiahe Lin , George Michailidis

Effective exploration in reinforcement learning requires not only tracking where an agent has been, but also understanding how the agent perceives and represents the world. To learn powerful representations, an agent should actively explore…

Machine Learning · Computer Science 2026-04-21 Faisal Mohamed , Catherine Ji , Benjamin Eysenbach , Glen Berseth

Reinforcement Learning (RL) is a well-established framework for sequential decision-making in complex environments. However, state-of-the-art Deep RL (DRL) algorithms typically require large training datasets and often struggle to…

Artificial Intelligence · Computer Science 2026-04-13 Celeste Veronese , Alessandro Farinelli , Daniele Meli

We propose Continuous Scene Representations (CSR), a scene representation constructed by an embodied agent navigating within a space, where objects and their relationships are modeled by continuous valued embeddings. Our method captures…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Samir Yitzhak Gadre , Kiana Ehsani , Shuran Song , Roozbeh Mottaghi

Recent studies show that deep reinforcement learning (DRL) agents tend to overfit to the task on which they were trained and fail to adapt to minor environment changes. To expedite learning when transferring to unseen tasks, we propose a…

Artificial Intelligence · Computer Science 2024-02-22 Guy Azran , Mohamad H. Danesh , Stefano V. Albrecht , Sarah Keren

To operate effectively in the real world, agents should be able to act from high-dimensional raw sensory input such as images and achieve diverse goals across long time-horizons. Current deep reinforcement and imitation learning methods can…

Machine Learning · Computer Science 2020-11-16 Scott Emmons , Ajay Jain , Michael Laskin , Thanard Kurutach , Pieter Abbeel , Deepak Pathak

A major challenge in reinforcement learning (RL) is the design of agents that are able to generalize across tasks that share common dynamics. A viable solution is meta-reinforcement learning, which identifies common structures among past…

Machine Learning · Computer Science 2019-10-24 Sephora Madjiheurem , Laura Toni

Offline reinforcement learning (RL) struggles in environments with rich and noisy inputs, where the agent only has access to a fixed dataset without environment interactions. Past works have proposed common workarounds based on the…

Machine Learning · Computer Science 2023-03-01 Hongyu Zang , Xin Li , Jie Yu , Chen Liu , Riashat Islam , Remi Tachet Des Combes , Romain Laroche

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the high computational…

Machine Learning · Computer Science 2018-11-09 Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

Episodic tasks in Reinforcement Learning (RL) often pose challenges due to sparse reward signals and high-dimensional state spaces, which hinder efficient learning. Additionally, these tasks often feature hidden "trap states" --…

Machine Learning · Computer Science 2025-05-23 Yuxuan Li , Yicheng Gao , Ning Yang , Stephen Xia