English
Related papers

Related papers: Leveraging Duration Pseudo-Embeddings in Multileve…

200 papers

Predicting multivariate time series is crucial, demanding precise modeling of intricate patterns, including inter-series dependencies and intra-series variations. Distinctive trend characteristics in each time series pose challenges, and…

Machine Learning · Computer Science 2024-07-08 Guoqi Yu , Jing Zou , Xiaowei Hu , Angelica I. Aviles-Rivero , Jing Qin , Shujun Wang

Time series forecasting is crucial in strategic planning and decision-making across various industries. Traditional forecasting models mainly concentrate on numerical time series data, often overlooking important textual information such as…

Computation and Language · Computer Science 2025-08-07 Chanjuan Liu , Shengzhi Wang , Enqiang Zhu

In many sequential tasks, a model needs to remember relevant events from the distant past to make correct predictions. Unfortunately, a straightforward application of gradient based training requires intermediate computations to be stored…

Machine Learning · Computer Science 2023-08-14 Artyom Sorokin , Nazar Buzun , Leonid Pugachev , Mikhail Burtsev

Since the advent of deep learning, it has been used to solve various problems using many different architectures. The application of such deep architectures to auditory data is also not uncommon. However, these architectures do not always…

Machine Learning · Computer Science 2014-12-25 Kratarth Goel , Raunaq Vohra

Short fixed-length inputs are the main bottleneck of deep learning methods in long time-series forecasting tasks. Prolonging input length causes overfitting, rapidly deteriorating accuracy. Our research indicates that the overfitting is a…

Machine Learning · Computer Science 2025-09-05 Chao Ma , Yikai Hou , Xiang Li , Yinggang Sun , Haining Yu

Unsupervised multivariate time series (MTS) representation learning aims to extract compact and informative representations from raw sequences without relying on labels, enabling efficient transfer to diverse downstream tasks. In this…

Machine Learning · Computer Science 2025-09-22 Yi Xu , Yitian Zhang , Yun Fu

Various methods using machine and deep learning have been proposed to tackle different tasks in predictive process monitoring, forecasting for an ongoing case e.g. the most likely next event or suffix, its remaining time, or an…

Machine Learning · Computer Science 2022-12-14 Jari Peeperkorn , Seppe vanden Broucke , Jochen De Weerdt

Predictive business process monitoring (PBPM) aims to predict future process behavior during ongoing process executions based on event log data. Especially, techniques for the next activity and timestamp prediction can help to improve the…

Machine Learning · Computer Science 2020-11-06 An Nguyen , Srijeet Chatterjee , Sven Weinzierl , Leo Schwinn , Martin Matzner , Bjoern Eskofier

Traditional recurrent neural network architectures, such as long short-term memory neural networks (LSTM), have historically held a prominent role in time series forecasting (TSF) tasks. While the recently introduced sLSTM for Natural…

Machine Learning · Computer Science 2025-02-25 Yaxuan Kong , Zepu Wang , Yuqi Nie , Tian Zhou , Stefan Zohren , Yuxuan Liang , Peng Sun , Qingsong Wen

Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health…

Machine Learning · Computer Science 2021-06-08 Satya Narayan Shukla , Benjamin M. Marlin

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as…

Machine Learning · Statistics 2016-12-07 Tan Nguyen , Wanjia Liu , Ethan Perez , Richard G. Baraniuk , Ankit B. Patel

In recent years, effectively modeling multivariate time series has gained significant popularity, mainly due to its wide range of applications, ranging from healthcare to financial markets and energy management. Transformers, MLPs, and…

Machine Learning · Computer Science 2025-11-04 Asal Meskin , Alireza Mirrokni , Ali Najar , Ali Behrouz

There exists a correlation between geospatial activity temporal patterns and type of land use. A novel self-supervised approach is proposed to stratify landscape based on mobility activity time series. First, the time series signal is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yi Cao , Swetava Ganguli , Vipul Pandey

In this paper, we investigate the feasibility of leveraging large language models (LLMs) for integrating general knowledge and incorporating pseudo-events as priors for temporal content distribution in video moment retrieval (VMR) models.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yiyang Jiang , Wengyu Zhang , Xulu Zhang , Xiaoyong Wei , Chang Wen Chen , Qing Li

Integration of renewable energy sources and emerging loads like electric vehicles to smart grids brings more uncertainty to the distribution system management. Demand Side Management (DSM) is one of the approaches to reduce the uncertainty.…

Machine Learning · Computer Science 2021-09-28 Elahe Khoshbakhti Vaygan , Roozbeh Rajabi , Abouzar Estebsari

In this study, we investigate the application of self-supervised learning via pre-trained Long Short-Term Memory (LSTM) networks for training surface electromyography pattern recognition models (sEMG-PR) using dynamic data with transitions.…

Signal Processing · Electrical Eng. & Systems 2024-09-24 Shriram Tallam Puranam Raghu , Dawn T. MacIsaac , Erik J. Scheme

With the increasing availability of high-dimensional data, analysts often rely on exploratory data analysis to understand complex data sets. A key approach to exploring such data is dimensionality reduction, which embeds high-dimensional…

Machine Learning · Computer Science 2024-12-17 Pavlin G. Poličar , Blaž Zupan

Deep-learning models such as Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) have been successfully used for process-mining tasks. They have achieved better performance for different predictive tasks than traditional…

Machine Learning · Computer Science 2021-05-04 Ishwar Venugopal , Jessica Töllich , Michael Fairbank , Ansgar Scherp

The advantage of recurrent neural networks (RNNs) in learning dependencies between time-series data has distinguished RNNs from other deep learning models. Recently, many advances are proposed in this emerging field. However, there is a…

Neural and Evolutionary Computing · Computer Science 2016-02-16 Hojjat Salehinejad

End-to-end models in NLP rarely encode external world knowledge about length of time. We introduce two effective models for duration prediction, which incorporate external knowledge by reading temporal-related news sentences (time-aware…

Computation and Language · Computer Science 2020-11-06 Zonglin Yang , Xinya Du , Alexander Rush , Claire Cardie