English
Related papers

Related papers: Regime-Based Portfolio Allocation Using Hidden Mar…

200 papers

We propose a reinforcement learning (RL) framework for multi-objective decision-making, where the agent seeks to optimize a vector of rewards rather than a single scalar value. The objective is to ensure that the time-averaged reward vector…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Rahul Misra , Manuela L. Bujorianu , Rafał Wisniewski

In this paper, we propose a navigation algorithm oriented to multi-agent environment. This algorithm is expressed as a hierarchical framework that contains a Hidden Markov Model (HMM) and a Deep Reinforcement Learning (DRL) structure. For…

Robotics · Computer Science 2018-07-18 Wenhao Ding , Shuaijun Li , Huihuan Qian

It is of some interest to understand how statistically based mechanisms for signal processing might be integrated with biologically motivated mechanisms such as neural networks. This paper explores a novel hybrid approach for classifying…

Neural and Evolutionary Computing · Computer Science 2016-07-22 Amirhossein Tavanaei , Anthony S Maida

This work introduces a regime-aware in-context learning framework that leverages large language models (LLMs) for financial volatility forecasting under nonstationary market conditions. The proposed approach deploys pretrained LLMs to…

Machine Learning · Computer Science 2026-03-12 Saba Asaad , Shayan Mohajer Hamidi , Ali Bereyhi

Reinforcement learning (RL) is an innovative approach to financial decision making, offering specialized solutions to complex investment problems where traditional methods fail. This review analyzes 167 articles from 2017--2025, focusing on…

Computational Finance · Quantitative Finance 2025-12-12 Mohammad Rezoanul Hoque , Md Meftahul Ferdaus , M. Kabir Hassan

During initial iterations of training in most Reinforcement Learning (RL) algorithms, agents perform a significant number of random exploratory steps. In the real world, this can limit the practicality of these algorithms as it can lead to…

Machine Learning · Computer Science 2022-10-17 Ashish Kumar Jayant , Shalabh Bhatnagar

Cyber threat intelligence is one of the emerging areas of focus in information security. Much of the recent work has focused on rule-based methods and detection of network attacks using Intrusion Detection algorithms. In this paper we…

Machine Learning · Computer Science 2024-09-05 Soham Deshmukh , Rahul Rade , Faruk Kazi

We consider penalized estimation in hidden Markov models (HMMs) with multivariate Normal observations. In the moderate-to-large dimensional setting, estimation for HMMs remains challenging in practice, due to several concerns arising from…

Methodology · Statistics 2014-01-09 Nicolas Städler , Sach Mukherjee

There is an increase in interest to model driving maneuver patterns via the automatic unsupervised clustering of naturalistic sequential kinematic driving data. The patterns learned are often used in transportation research areas such as…

Machine Learning · Statistics 2023-11-14 Matthew Aguirre , Wenbo Sun , Jionghua , Jin , Yang Chen

Many control tasks exhibit similar dynamics that can be modeled as having common latent structure. Hidden-Parameter Markov Decision Processes (HiP-MDPs) explicitly model this structure to improve sample efficiency in multi-task settings.…

Machine Learning · Computer Science 2021-02-15 Amy Zhang , Shagun Sodhani , Khimya Khetarpal , Joelle Pineau

As Large Language Models (LLMs) continue to progress toward more advanced forms of intelligence, Reinforcement Learning from Human Feedback (RLHF) is increasingly seen as a key pathway toward achieving Artificial General Intelligence (AGI).…

Machine Learning · Computer Science 2024-10-17 Yuzi Yan , Xingzhou Lou , Jialian Li , Yiping Zhang , Jian Xie , Chao Yu , Yu Wang , Dong Yan , Yuan Shen

Reinforcement learning with verifiable rewards has significantly advanced the reasoning capabilities of large language models, yet how to explicitly steer training toward exploration or exploitation remains an open problem. We introduce…

Machine Learning · Computer Science 2026-02-17 Wenlong Deng , Yi Ren , Yushu Li , Boying Gong , Danica J. Sutherland , Xiaoxiao Li , Christos Thrampoulidis

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-10-04 Viktoriya Krakovna , Finale Doshi-Velez

Time series of conformational dynamics in proteins are usually evaluated with hidden Markov models (HMMs). This approach works well if the number of states and their connectivity is known. However, for the multi-domain protein Hsp90, a…

Over the last decade, hidden Markov models (HMMs) have become increasingly popular in statistical ecology, where they constitute natural tools for studying animal behavior based on complex sensor data. Corresponding analyses sometimes…

Methodology · Statistics 2025-10-15 Jan-Ole Koslik , Carlina C. Feldmann , Sina Mews , Rouven Michels , Roland Langrock

The optimal asset allocation between risky and risk-free assets is a persistent challenge due to the inherent volatility in financial markets. Conventional methods rely on strict distributional assumptions or non-additive reward ratios,…

Portfolio Management · Quantitative Finance 2026-01-06 Rongwei Liu , Jin Zheng , John Cartlidge

Aligning Large Language Models (LLMs) with human preferences typically relies on external supervision, which faces critical limitations: human annotations are scarce and subjective, reward models are vulnerable to reward hacking, and…

Computation and Language · Computer Science 2025-12-03 Yixuan Tang , Yi Yang

We investigate a novel modeling approach for end-to-end neural network training using hidden Markov models (HMM) where the transition probabilities between hidden states are modeled and learned explicitly. Most contemporary…

Machine Learning · Computer Science 2023-10-10 Daniel Mann , Tina Raissi , Wilfried Michel , Ralf Schlüter , Hermann Ney

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

This article explores dynamic factor allocation by analyzing the cyclical performance of factors through regime analysis. The authors focus on a U.S. equity investment universe comprising seven long-only indices representing the market and…

Portfolio Management · Quantitative Finance 2024-10-22 Yizhan Shu , John M. Mulvey