English
Related papers

Related papers: Hi-DARTS: Hierarchical Dynamically Adapting Reinfo…

200 papers

Advanced Persistent Threats (APTs) represent a growing menace to modern digital infrastructure. Unlike traditional cyberattacks, APTs are stealthy, adaptive, and long-lasting, often bypassing signature-based detection systems. This paper…

Cryptography and Security · Computer Science 2025-08-27 Sidahmed Benabderrahmane , Talal Rahwan

Hierarchical agents have the potential to solve sequential decision making tasks with greater sample efficiency than their non-hierarchical counterparts because hierarchical agents can break down tasks into sets of subtasks that only…

Artificial Intelligence · Computer Science 2019-09-05 Andrew Levy , George Konidaris , Robert Platt , Kate Saenko

Hierarchical Reinforcement Learning (HRL) agents often struggle with long-horizon visual planning due to their reliance on error-prone distance metrics. We propose Discrete Hierarchical Planning (DHP), a method that replaces continuous…

Robotics · Computer Science 2025-12-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

We present a long-horizon, hierarchical deep research (DR) agent designed for complex materials and device discovery problems that exceed the scope of existing Machine Learning (ML) surrogates and closed-source commercial agents. Our…

Machine Learning · Computer Science 2025-12-04 Rui Ding , Rodrigo Pires Ferreira , Yuxin Chen , Junhong Chen

In the highly volatile and uncertain global financial markets, traditional quantitative trading models relying on statistical modeling or empirical rules often fail to adapt to dynamic market changes and black swan events due to rigid…

Portfolio Management · Quantitative Finance 2026-04-22 Jingfeng Pan , Jiahao Chen

LLM-based trading agents are increasingly deployed in real-world financial markets to perform autonomous analysis and execution. However, their reliability and robustness under adversarial or faulty conditions remain largely unexamined,…

Artificial Intelligence · Computer Science 2025-12-03 Lewen Yan , Jilin Mei , Tianyi Zhou , Lige Huang , Jie Zhang , Dongrui Liu , Jing Shao

High-frequency trading (HFT) accounts for almost half of equity trading volume, yet it is not identified in public data. We develop novel data-driven measures of HFT activity that separate strategies that supply and demand liquidity. We…

Computational Finance · Quantitative Finance 2025-03-24 G. Ibikunle , B. Moews , D. Muravyev , K. Rzayev

Dynamic hedging is the practice of periodically transacting financial instruments to offset the risk caused by an investment or a liability. Dynamic hedging optimization can be framed as a sequential decision problem; thus, Reinforcement…

Computational Finance · Quantitative Finance 2024-02-26 Andrei Neagu , Frédéric Godin , Clarence Simard , Leila Kosseim

Deep Reinforcement Learning (DRL) algorithms can scale to previously intractable problems. The automation of profit generation in the stock market is possible using DRL, by combining the financial assets price "prediction" step and the…

Trading and Market Microstructure · Quantitative Finance 2022-09-20 Taylan Kabbani , Ekrem Duman

Nearly one-half of all trades in financial markets are executed by high-speed, autonomous computer programs -- a type of trading often called high-frequency trading (HFT). Although evidence suggests that HFT increases the efficiency of…

Trading and Market Microstructure · Quantitative Finance 2013-11-19 Benjamin Myers , Austin Gerig

Vision-language model (VLM) based GUI agents show promise for automating complex desktop and mobile tasks, but face significant challenges in applying reinforcement learning (RL): (1) slow multi-turn interactions with GUI environments for…

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

Machine Learning · Computer Science 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

High Power Laser's (HPL) optimal performance is essential for the success of a wide variety of experimental tasks related to light-matter interactions. Traditionally, HPL parameters are optimised in an automated fashion relying on black-box…

This paper proposes a novel adaptive guidance system developed using reinforcement meta-learning with a recurrent policy and value function approximator. The use of recurrent network layers allows the deployed policy to adapt real time to…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Brian Gaudet , Richard Linares

Early-exit deep neural networks enable adaptive inference by terminating computation when sufficient confidence is achieved, reducing cost for edge AI accelerators in resource-constrained settings. Existing methods, however, rely on…

Hardware Architecture · Computer Science 2026-03-16 Parth Patne , Mahdi Taheri , Christian Herglotz , Maksim Jenihhin , Milos Krstic , Michael Hübner

Reinforcement learning (RL) under changing environment models many real-world applications via nonstationary Markov Decision Processes (MDPs), and hence gains considerable interest. However, theoretical studies on nonstationary MDPs in the…

Machine Learning · Computer Science 2023-08-11 Yuan Cheng , Jing Yang , Yingbin Liang

Large Reasoning Models (LRMs) face two fundamental limitations: excessive token consumption when overanalyzing simple information processing tasks, and inability to access up-to-date knowledge beyond their training data. We introduce MARS…

Artificial Intelligence · Computer Science 2026-02-03 Guoxin Chen , Zile Qiao , Wenqing Wang , Donglei Yu , Xuanzhong Chen , Hao Sun , Minpeng Liao , Kai Fan , Yong Jiang , Penguin Xie , Wayne Xin Zhao , Ruihua Song , Fei Huang

The complex transmission mechanism of cross-packet hybrid automatic repeat request (XP-HARQ) hinders its optimal system design. To overcome this difficulty, this letter attempts to use the deep reinforcement learning (DRL) to solve the rate…

Information Theory · Computer Science 2023-08-07 Da Wu , Jiahui Feng , Zheng Shi , Hongjiang Lei , Guanghua Yang , Shaodan Ma

Deep or reinforcement learning (RL) approaches have been adapted as reactive agents to quickly learn and respond with new investment strategies for portfolio management under the highly turbulent financial market environments in recent…

Portfolio Management · Quantitative Finance 2024-09-11 Zhenglong Li , Vincent Tam , Kwan L. Yeung

Decentralized Multi-Agent Reinforcement Learning (MARL) methods allow for learning scalable multi-agent policies, but suffer from partial observability and induced non-stationarity. These challenges can be addressed by introducing…

Machine Learning · Computer Science 2025-08-01 Tommaso Marzi , Cesare Alippi , Andrea Cini