English
Related papers

Related papers: Unsupervised Scalable Representation Learning for …

200 papers

A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are…

Machine Learning · Computer Science 2022-08-22 William T. Ng , K. Siu , Albert C. Cheung , Michael K. Ng

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

For the challenging task of modeling multivariate time series, we propose a new class of models that use dependent Mat\'ern processes to capture the underlying structure of data, explain their interdependencies, and predict their unknown…

Machine Learning · Statistics 2015-02-13 Alexander Vandenberg-Rodes , Babak Shahbaba

In many real-world application, e.g., speech recognition or sleep stage classification, data are captured over the course of time, constituting a Time-Series. Time-Series often contain temporal dependencies that cause two otherwise…

Machine Learning · Computer Science 2017-01-10 John Cristian Borges Gamboa

This work introduces a novel, simple, and flexible method to quantify irreversibility in generic high-dimensional time series based on the well-known mapping to a binary classification problem. Our approach utilizes gradient boosting for…

Statistical Mechanics · Physics 2025-01-09 Michele Vodret , Cristiano Pacini , Christian Bongiorno

The recent tremendous success of unsupervised word embeddings in a multitude of applications raises the obvious question if similar methods could be derived to improve embeddings (i.e. semantic representations) of word sequences as well. We…

Computation and Language · Computer Science 2018-12-31 Matteo Pagliardini , Prakhar Gupta , Martin Jaggi

The analysis of physiological processes over time are often given by spectrometric or gene expression profiles over time with only few time points but a large number of measured variables. The analysis of such temporal sequences is…

Machine Learning · Computer Science 2011-10-12 F. -M. Schleif , A. Gisbrecht , B. Hammer

Sparse coding approximates the data sample as a sparse linear combination of some basic codewords and uses the sparse codes as new presentations. In this paper, we investigate learning discriminative sparse codes by sparse coding in a…

Machine Learning · Statistics 2015-01-19 Jim Jing-Yan Wang , Xin Gao

Deep neural networks are efficient learning machines which leverage upon a large amount of manually labeled data for learning discriminative features. However, acquiring substantial amount of supervised data, especially for videos can be a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Sujoy Paul , Sourya Roy , Amit K. Roy-Chowdhury

We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or…

Machine Learning · Computer Science 2016-01-05 Nitish Srivastava , Elman Mansimov , Ruslan Salakhutdinov

Event time series are sequences of discrete events occurring at irregular time intervals, each associated with a domain-specific observational modality. They are common in domains such as high-energy astrophysics, computational social…

Machine Learning · Computer Science 2025-10-14 Steven Dillmann , Juan Rafael Martínez-Galarza

Unsupervised learning has grown in popularity because of the difficulty of collecting annotated data and the development of modern frameworks that allow us to learn from unlabeled data. Existing studies, however, either disregard variations…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yi-Zhan Xu , Chih-Yao Chen , Cheng-Te Li

We propose a scalable method for semi-supervised (transductive) learning from massive network-structured datasets. Our approach to semi-supervised learning is based on representing the underlying hypothesis as a graph signal with small…

Machine Learning · Computer Science 2016-11-03 Alexander Jung , Alfred O. Hero , Alexandru Mara , Sabeur Aridhi

Event detection in time series is a challenging task due to the prevalence of imbalanced datasets, rare events, and time interval-defined events. Traditional supervised deep learning methods primarily employ binary classification, where…

Machine Learning · Statistics 2024-09-16 Menouar Azib , Benjamin Renard , Philippe Garnier , Vincent Génot , Nicolas André

Medical time series are often irregular and face significant missingness, posing challenges for data analysis and clinical decision-making. Existing methods typically adopt a single modeling perspective, either treating series data as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Liuqing Chen , Shuhong Xiao , Shixian Ding , Shanhai Hu , Lingyun Sun

Machine learning has emerged as a powerful tool for time series analysis. Existing methods are usually customized for different analysis tasks and face challenges in tackling practical problems such as partial labeling and domain shift. To…

Machine Learning · Computer Science 2024-08-20 Zhiyu Liang , Chen Liang , Zheng Liang , Hongzhi Wang , Bo Zheng

The robustness of machine learning algorithms to distributions shift is primarily discussed in the context of supervised learning (SL). As such, there is a lack of insight on the robustness of the representations learned from unsupervised…

Machine Learning · Computer Science 2022-12-19 Yuge Shi , Imant Daunhawer , Julia E. Vogt , Philip H. S. Torr , Amartya Sanyal

Self-supervised representation learning of Multivariate Time Series (MTS) is a challenging task and attracts increasing research interests in recent years. Many previous works focus on the pretext task of self-supervised learning and…

Machine Learning · Computer Science 2022-03-10 Yijiang Chen , Xiangdong Zhou , Zhen Xing , Zhidan Liu , Minyang Xu

In current research, machine and deep learning solutions for the classification of temporal data are shifting from single-channel datasets (univariate) to problems with multiple channels of information (multivariate). The majority of these…

Machine Learning · Computer Science 2023-04-13 Leonardos Pantiskas , Kees Verstoep , Mark Hoogendoorn , Henri Bal

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer