English
Related papers

Related papers: Best-first Model Merging for Hidden Markov Model I…

200 papers

The hidden Markov model (HMM) provides a powerful framework for inference in time-varying environments, where the underlying state evolves according to a Markov chain. To address the optimal filtering problem in general dynamic settings, we…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Dongyan Sui , Haotian Pu , Siyang Leng , Stefan Vlaski

Cyber threat intelligence is one of the emerging areas of focus in information security. Much of the recent work has focused on rule-based methods and detection of network attacks using Intrusion Detection algorithms. In this paper we…

Machine Learning · Computer Science 2024-09-05 Soham Deshmukh , Rahul Rade , Faruk Kazi

Given a nonparametric Hidden Markov Model (HMM) with two states, the question of constructing efficient multiple testing procedures is considered, treating one of the states as an unknown null hypothesis. A procedure is introduced, based on…

Statistics Theory · Mathematics 2021-01-12 Kweku Abraham , Ismael Castillo , Elisabeth Gassiat

De-interleaving of the mixtures of Hidden Markov Processes (HMPs) generally depends on its representation model. Existing representation models consider Markov chain mixtures rather than hidden Markov, resulting in the lack of robustness to…

Machine Learning · Statistics 2024-06-04 Jiadi Bao , Mengtao Zhu , Yunjie Li , Shafei Wang

Model merging combines multiple models into a single model with aggregated capabilities, making it a powerful tool for large language model (LLM) development. However, scaling model merging is challenging: performance depends on the choice…

Machine Learning · Computer Science 2026-02-03 Oliver Bolton , Aakanksha , Arash Ahmadian , Sara Hooker , Marzieh Fadaee , Beyza Ermis

In this work we propose a Bayesian framework for fully automated image fusion and their joint segmentation. More specifically, we consider the case where we have observed images of the same object through different image processes or…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Olivier Feron , Ali Mohammad-Djafari

We investigate a novel modeling approach for end-to-end neural network training using hidden Markov models (HMM) where the transition probabilities between hidden states are modeled and learned explicitly. Most contemporary…

Machine Learning · Computer Science 2023-10-10 Daniel Mann , Tina Raissi , Wilfried Michel , Ralf Schlüter , Hermann Ney

Model merging is a technique that combines multiple large pretrained models into a single model with enhanced performance and broader task adaptability. It has gained popularity in large pretrained model development due to its ability to…

Machine Learning · Computer Science 2024-09-30 Yu Zhou , Xingyu Wu , Jibin Wu , Liang Feng , Kay Chen Tan

Hybrid Autoregressive Transducer (HAT) is a recently proposed end-to-end acoustic model that extends the standard Recurrent Neural Network Transducer (RNN-T) for the purpose of the external language model (LM) fusion. In HAT, the blank…

Computation and Language · Computer Science 2021-03-29 Liang Lu , Zhong Meng , Naoyuki Kanda , Jinyu Li , Yifan Gong

An intrinsic problem of classifiers based on machine learning (ML) methods is that their learning time grows as the size and complexity of the training dataset increases. For this reason, it is important to have efficient computational…

Machine Learning · Computer Science 2013-04-16 Khadoudja Ghanem

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

It is of some interest to understand how statistically based mechanisms for signal processing might be integrated with biologically motivated mechanisms such as neural networks. This paper explores a novel hybrid approach for classifying…

Neural and Evolutionary Computing · Computer Science 2016-07-22 Amirhossein Tavanaei , Anthony S Maida

We demonstrate the application of pattern recognition algorithms via hidden Markov models (HMM) for qubit readout. This scheme provides a state-path trajectory approach capable of detecting qubit state transitions and makes for a robust…

Quantum Physics · Physics 2021-01-04 Luis A. Martinez , Yaniv J. Rosen , Jonathan L. DuBois

Deriving a good model for multitalker babble noise can facilitate different speech processing algorithms, e.g. noise reduction, to reduce the so-called cocktail party difficulty. In the available systems, the fact that the babble waveform…

Sound · Computer Science 2017-09-19 Nasser Mohammadiha , Arne Leijon

State Space Models (SSMs) and Hidden Markov Models (HMMs) are foundational frameworks for modeling sequential data with latent variables and are widely used in signal processing, control theory, and machine learning. Despite their shared…

Machine Learning · Computer Science 2026-01-21 Aydin Ghojogh , M. Hadi Sepanj , Benyamin Ghojogh

We consider the use of language models whose size and accuracy are intermediate between different order n-gram models. Two types of models are studied in particular. Aggregate Markov models are class-based bigram models in which the mapping…

cmp-lg · Computer Science 2008-02-03 Lawrence Saul , Fernando Pereira

The Hidden Markov Model (HMM) is one of the most widely used statistical models for sequential data analysis. One of the key reasons for this versatility is the ability of HMM to deal with missing data. However, standard HMM learning…

Machine Learning · Statistics 2023-07-04 Binyamin Perets , Mark Kozdoba , Shie Mannor

In this paper, second-order hidden Markov model (HMM2) has been used and implemented to improve the recognition performance of text-dependent speaker identification systems under neutral talking condition. Our results show that HMM2…

Sound · Computer Science 2017-07-03 Ismail Shahin

We propose to model the acoustic space of deep neural network (DNN) class-conditional posterior probabilities as a union of low-dimensional subspaces. To that end, the training posteriors are used for dictionary learning and sparse coding.…

Computation and Language · Computer Science 2017-09-07 Pranay Dighe , Gil Luyet , Afsaneh Asaei , Herve Bourlard

The study of animal behavioural states inferred through hidden Markov models and similar state switching models has seen a significant increase in popularity in recent years. The ability to account for varying levels of behavioural scale…

Computation · Statistics 2021-05-06 Giada Sacchi , Ben Swallow