English
Related papers

Related papers: Foundations of Sequence-to-Sequence Modeling for T…

200 papers

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

A longstanding challenge for the Machine Learning community is the one of developing models that are capable of processing and learning from very long sequences of data. The outstanding results of Transformers-based networks (e.g., Large…

Machine Learning · Computer Science 2024-02-15 Matteo Tiezzi , Michele Casoni , Alessandro Betti , Tommaso Guidi , Marco Gori , Stefano Melacci

This paper provides a review of past approaches to the use of deep-learning frameworks for the analysis of discrete irregular-patterned complex sequential datasets. A typical example of such a dataset is financial data where specific events…

Machine Learning · Computer Science 2020-07-23 Kudakwashe Dandajena , Isabella M. Venter , Mehrdad Ghaziasgar , Reg Dodds

Recently, remarkable progress has been made over large language models (LLMs), demonstrating their unprecedented capability in varieties of natural language tasks. However, completely training a large general-purpose model from the scratch…

Machine Learning · Computer Science 2024-02-06 Yushan Jiang , Zijie Pan , Xikun Zhang , Sahil Garg , Anderson Schneider , Yuriy Nevmyvaka , Dongjin Song

In forecasting multiple time series, accounting for the individual features of each sequence can be challenging. To address this, modern deep learning methods for time series analysis combine a shared (global) model with local layers,…

Machine Learning · Computer Science 2025-02-14 Luca Butera , Giovanni De Felice , Andrea Cini , Cesare Alippi

Deep learning models, particularly Transformers, have achieved impressive results in various domains, including time series forecasting. While existing time series literature primarily focuses on model architecture modifications and data…

Machine Learning · Computer Science 2023-12-01 Valentino Assandri , Sam Heshmati , Burhaneddin Yaman , Anton Iakovlev , Ariel Emiliano Repetur

In the last years there has been a considerable increase in the availability of continuous sensor measurements in a wide range of application domains, such as Location-Based Services (LBS), medical monitoring systems, manufacturing plants…

Databases · Computer Science 2015-03-20 Michele Dallachiesa , Besmira Nushi , Katsiaryna Mirylenka , Themis Palpanas

Recurrent and convolutional neural networks are the most common architectures used for time series forecasting in deep learning literature. These networks use parameter sharing by repeating a set of fixed architectures with fixed parameters…

Machine Learning · Computer Science 2020-11-30 Joel Janek Dabrowski , YiFan Zhang , Ashfaqur Rahman

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Machine Learning · Computer Science 2024-08-08 Rares Cristian , Pavithra Harsha , Clemente Ocejo , Georgia Perakis , Brian Quanz , Ioannis Spantidakis , Hamza Zerhouni

Probabilistic forecasting of multivariate time series is essential for various downstream tasks. Most existing approaches rely on the sequences being uniformly spaced and aligned across all variables. However, real-world multivariate time…

Machine Learning · Computer Science 2025-02-18 Yijun Li , Cheuk Hang Leung , Qi Wu

Time series foundational models (TSFM) have gained prominence in time series forecasting, promising state-of-the-art performance across various applications. However, their application in anomaly detection and prediction remains…

Machine Learning · Computer Science 2024-12-30 Chathurangi Shyalika , Harleen Kaur Bagga , Ahan Bhatt , Renjith Prasad , Alaa Al Ghazo , Amit Sheth

Time-series data exists in every corner of real-world systems and services, ranging from satellites in the sky to wearable devices on human bodies. Learning representations by extracting and inferring valuable information from these time…

Machine Learning · Computer Science 2026-05-19 Patara Trirat , Yooju Shin , Junhyeok Kang , Youngeun Nam , Jihye Na , Minyoung Bae , Joeun Kim , Byunghyun Kim , Jae-Gil Lee

Among recent developments in time series forecasting methods, deep forecasting models have gained popularity as they can utilize hidden feature patterns in time series to improve forecasting performance. Nevertheless, the majority of…

Machine Learning · Computer Science 2023-10-13 Zhendong Wang , Ioanna Miliou , Isak Samsten , Panagiotis Papapetrou

Increasingly high-stakes decisions are made using neural networks in order to make predictions. Specifically, meteorologists and hedge funds apply these techniques to time series data. When it comes to prediction, there are certain…

Machine Learning · Computer Science 2022-11-14 Levente Foldesi , Matias Valdenegro-Toro

The task of clustering unlabeled time series and sequences entails a particular set of challenges, namely to adequately model temporal relations and variable sequence lengths. If these challenges are not properly handled, the resulting…

Machine Learning · Statistics 2019-02-19 Daniel J. Trosten , Andreas S. Strauman , Michael Kampffmeyer , Robert Jenssen

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

In real-world scenario, many phenomena produce a collection of events that occur in continuous time. Point Processes provide a natural mathematical framework for modeling these sequences of events. In this survey, we investigate…

Recent advancements in the collection and analysis of sequential educational data have brought time series analysis to a pivotal position in educational research, highlighting its essential role in facilitating data-driven decision-making.…

Machine Learning · Computer Science 2024-08-28 Shengzhong Mao , Chaoli Zhang , Yichi Song , Jindong Wang , Xiao-Jun Zeng , Zenglin Xu , Qingsong Wen

Signal processing traditionally relies on classical statistical modeling techniques. Such model-based methods utilize mathematical formulations that represent the underlying physics, prior information and additional domain knowledge. Simple…

Signal Processing · Electrical Eng. & Systems 2023-06-08 Nir Shlezinger , Yonina C. Eldar

Precise financial series predicting has long been a difficult problem because of unstableness and many noises within the series. Although Traditional time series models like ARIMA and GARCH have been researched and proved to be effective in…

Machine Learning · Computer Science 2018-12-11 Xin-Yao Qian