English
Related papers

Related papers: A Simple HMM with Self-Supervised Representations …

200 papers

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

We propose the segmented iHMM (siHMM), a hierarchical infinite hidden Markov model (iHMM) that supports a simple, efficient inference scheme. The siHMM is well suited to segmentation problems, where the goal is to identify points at which a…

Machine Learning · Statistics 2016-02-23 Ardavan Saeedi , Matthew Hoffman , Matthew Johnson , Ryan Adams

We explore self-supervised models that can be potentially deployed on mobile devices to learn general purpose audio representations. Specifically, we propose methods that exploit the temporal context in the spectrogram domain. One method…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-29 Marco Tagliasacchi , Beat Gfeller , Félix de Chaumont Quitry , Dominik Roblek

In this work, we propose a novel straightforward method for medical volume and sequence segmentation with limited annotations. To avert laborious annotating, the recent success of self-supervised learning(SSL) motivates the pre-training on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Zejian Chen , Wei Zhuo , Tianfu Wang , Wufeng Xue , Dong Ni

Learning phone types from phone instances has been a long-standing problem, while still being open. In this work, we revisit this problem in the context of self-supervised learning, and pose it as the problem of matching cluster centroids…

Computation and Language · Computer Science 2023-10-27 Gene-Ping Yang , Hao Tang

Recent segmentation methods leveraging Multi-modal Large Language Models (MLLMs) have shown reliable object-level segmentation and enhanced spatial perception. However, almost all previous methods predominantly rely on specialist mask…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Anqi Zhang , Xiaokang Ji , Guangyu Gao , Jianbo Jiao , Chi Harold Liu , Yunchao Wei

Systems based on automatic speech recognition (ASR) technology can provide important functionality in computer assisted language learning applications. This is a young but growing area of research motivated by the large number of students…

Sound · Computer Science 2016-02-29 Zhenhao Ge , Sudhendu R. Sharma , Mark J. T. Smith

Subtle hand differences make sign language recognition challenging, yet many existing methods rely on encoders pretrained on generic action datasets that poorly capture such fine-grained cues. We propose a self-supervised pretraining method…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Kunyuan Xie , Zhixi Cai , Kalin Stefanov

Learning and understanding the typical patterns in the daily activities and routines of people from low-level sensory data is an important problem in many application domains such as building smart environments, or providing intelligent…

Machine Learning · Computer Science 2014-08-14 Truyen Tran , Hung Bui , Svetha Venkatesh

Recognizing handwritten mathematical expressions (HMER) is a challenging task due to the inherent two-dimensional structure, varying symbol scales, and complex spatial relationships among symbols. In this paper, we present a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Shree Mitra , Ritabrata Chakraborty , Nilkanta Sahu

Labeling of sequential data is a prevalent meta-problem for a wide range of real world applications. While the first-order Hidden Markov Models (HMM) provides a fundamental approach for unsupervised sequential labeling, the basic model does…

Machine Learning · Computer Science 2019-04-08 Maoying Qiao , Wei Bian , Richard Yida Xu , Dacheng Tao

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

Denoising diffusion probabilistic models have recently received much research attention since they outperform alternative approaches, such as GANs, and currently provide state-of-the-art generative performance. The superior performance of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Dmitry Baranchuk , Ivan Rubachev , Andrey Voynov , Valentin Khrulkov , Artem Babenko

Typically, unsupervised segmentation of speech into the phone and word-like units are treated as separate tasks and are often done via different methods which do not fully leverage the inter-dependence of the two tasks. Here, we unify them…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-12 Saurabhchand Bhati , Jesús Villalba , Piotr Żelasko , Laureano Moro-Velazquez , Najim Dehak

Objective: This paper considers challenges in developing algorithms for accurate segmentation and classification of heart sound (HS) signals. Methods: We propose an approach based on Markov switching autoregressive model (MSAR) to…

Signal Processing · Electrical Eng. & Systems 2020-04-27 Fuad Noman , Sh-Hussain Salleh , Chee-Ming Ting , S. Balqis Samdin , Hernando Ombao , Hadri Hussain

This research work is about recent development made in speech recognition. In this research work, analysis of isolated digit recognition in the presence of different bit rates and at different noise levels has been performed. This research…

Computation and Language · Computer Science 2022-08-30 Muskan Garg , Naveen Aggarwal

This paper proposes a new hyperspectral unmixing method for nonlinearly mixed hyperspectral data using a semantic representation in a semi-supervised fashion, assuming the availability of a spectral reference library. Existing…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Yuki Itoh , Siwei Feng , Marco F. Duarte , Mario Parente

Self-supervised depth estimation has shown its great effectiveness in producing high quality depth maps given only image sequences as input. However, its performance usually drops when estimating on border areas or objects with thin…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Rui Li , Qing Mao , Pei Wang , Xiantuo He , Yu Zhu , Jinqiu Sun , Yanning Zhang

Phoneme boundary detection plays an essential first step for a variety of speech processing applications such as speaker diarization, speech science, keyword spotting, etc. In this work, we propose a neural architecture coupled with a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Felix Kreuk , Yaniv Sheena , Joseph Keshet , Yossi Adi