English
Related papers

Related papers: Doubly Outlier-Robust Online Infinite Hidden Marko…

200 papers

We propose DenseHMM - a modification of Hidden Markov Models (HMMs) that allows to learn dense representations of both the hidden states and the observables. Compared to the standard HMM, transition probabilities are not atomic but composed…

Machine Learning · Computer Science 2020-12-18 Joachim Sicking , Maximilian Pintz , Maram Akila , Tim Wirtz

Non-Intrusive Load Monitoring (NILM) is a field of research focused on segregating constituent electrical loads in a system based only on their aggregated signal. Significant computational resources and research time are spent training…

Artificial Intelligence · Computer Science 2020-09-17 Richard Jones , Christoph Klemenjak , Stephen Makonin , Ivan V. Bajic

Recent work has shown that it is possible to train deep neural networks that are provably robust to norm-bounded adversarial perturbations. Most of these methods are based on minimizing an upper bound on the worst-case loss over all…

A popular way to estimate the parameters of a hidden Markov model (HMM) is direct numerical maximization (DNM) of the (log-)likelihood function. The advantages of employing the TMB (Kristensen et al., 2016) framework in R for this purpose…

Computation · Statistics 2023-05-16 Timothée Bacri , Geir D. Berentsen , Jan Bulla , Bård Støve

This study deals with the problem of outliers in ordinal response model, which is a regression on ordered categorical data as the response variable. ``Outlier" means that the combination of ordered categorical data and its covariates is…

Methodology · Statistics 2022-12-29 Tomotaka Momozaki , Tomoyuki Nakagawa

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

Class imbalance remains a fundamental challenge in machine learning, where standard classifiers exhibit severe performance degradation in minority classes. Although existing approaches address imbalance through resampling or cost-sensitive…

Machine Learning · Computer Science 2026-02-10 Zahir Alsulaimawi

Despite the success of Reinforcement Learning from Human Feedback (RLHF) in aligning language models with human values, reward hacking-or reward over-optimization-remains a major challenge. We identify two key obstacles to its mitigation:…

Machine Learning · Computer Science 2025-10-16 Yuchun Miao , Liang Ding , Sen Zhang , Rong Bao , Lefei Zhang , Dacheng Tao

Accurate loss reserving is crucial in Property and Casualty (P&C) insurance for financial stability, regulatory compliance, and effective risk management. We propose a novel micro-level Cox model based on hidden Markov models (HMMs).…

Applications · Statistics 2026-01-14 Hassan Abdelrahman , Andrei Badescu , Radu Craiu , Sheldon Lin

There is a large body of evidence that decision makers frequently depart from Bayesian updating. This paper introduces a model, robust maximum likelihood (RML) updating, where deviations from Bayesian updating are due to multiple…

Theoretical Economics · Economics 2025-12-17 Elchin Suleymanov

This paper deals with parameter estimation in pair hidden Markov models (pair-HMMs). We first provide a rigorous formalism for these models and discuss possible definitions of likelihoods. The model being biologically motivated, some…

Statistics Theory · Mathematics 2010-12-09 Ana Arribas-Gil , Elisabeth Gassiat , Catherine Matias

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

The hidden Markov model (HMM) has been a workhorse of single molecule data analysis and is now commonly used as a standalone tool in time series analysis or in conjunction with other analyses methods such as tracking. Here we provide a…

Data Analysis, Statistics and Probability · Physics 2017-06-28 Ioannis Sgouralis , Steve Presse

[This paper was initially published in PHME conference in 2016, selected for further publication in International Journal of Prognostics and Health Management.] This paper describes an Autoregressive Partially-hidden Markov model (ARPHMM)…

Machine Learning · Statistics 2021-05-04 Pablo Juesas , Emmanuel Ramasso , Sébastien Drujont , Vincent Placet

We propose a new model for augmenting algorithms with predictions by requiring that they are formally learnable and instance robust. Learnability ensures that predictions can be efficiently constructed from a reasonable amount of past data.…

Machine Learning · Computer Science 2021-07-05 Thomas Lavastida , Benjamin Moseley , R. Ravi , Chenyang Xu

In the recent years, the desire and need to understand sequential data has been increasing, with particular interest in sequential contexts such as patient monitoring, understanding daily activities, video surveillance, stock market and the…

Machine Learning · Statistics 2015-03-16 Ava Bargi , Richard Yi Da Xu , Massimo Piccardi

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

Machine Learning · Computer Science 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

Offline (or batch) reinforcement learning (RL) algorithms seek to learn an optimal policy from a fixed dataset without active data collection. Based on the composition of the offline dataset, two main categories of methods are used:…

Machine Learning · Computer Science 2023-07-04 Paria Rashidinejad , Banghua Zhu , Cong Ma , Jiantao Jiao , Stuart Russell

Factorial hidden Markov models (FHMMs) are powerful tools of modeling sequential data. Learning FHMMs yields a challenging simultaneous model selection issue, i.e., selecting the number of multiple Markov chains and the dimensionality of…

Machine Learning · Statistics 2015-06-29 Shaohua Li , Ryohei Fujimaki , Chunyan Miao