English
Related papers

Related papers: Foundations of Sequence-to-Sequence Modeling for T…

200 papers

In the last few decades, building regression models for non-scalar variables, including time series, text, image, and video, has attracted increasing interests of researchers from the data analytic community. In this paper, we focus on a…

Machine Learning · Computer Science 2020-12-01 Qiyao Wang , Haiyan Wang , Chetan Gupta , Aniruddha Rajendra Rao , Hamed Khorasgani

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Hierarchical forecasting is a key problem in many practical multivariate forecasting applications - the goal is to simultaneously predict a large number of correlated time series that are arranged in a pre-specified aggregation hierarchy.…

Machine Learning · Computer Science 2021-10-13 Biswajit Paria , Rajat Sen , Amr Ahmed , Abhimanyu Das

Scaling law that rewards large datasets, complex models and enhanced data granularity has been observed in various fields of deep learning. Yet, studies on time series forecasting have cast doubt on scaling behaviors of deep learning…

Machine Learning · Computer Science 2024-11-13 Jingzhe Shi , Qinwei Ma , Huan Ma , Lei Li

Time series prediction with neural networks has been the focus of much research in the past few decades. Given the recent deep learning revolution, there has been much attention in using deep learning models for time series prediction, and…

Machine Learning · Computer Science 2021-06-08 Rohitash Chandra , Shaurya Goyal , Rishabh Gupta

A highly comparative, feature-based approach to time series classification is introduced that uses an extensive database of algorithms to extract thousands of interpretable features from time series. These features are derived from across…

Machine Learning · Computer Science 2017-11-10 Ben D. Fulcher , Nick S. Jones

Researchers have been highly active to investigate the classical machine learning workflow and integrate best practices from the software engineering lifecycle. However, deep learning exhibits deviations that are not yet covered in this…

Software Engineering · Computer Science 2022-08-30 Janosch Baltensperger , Pasquale Salza , Harald C. Gall

Traditional machine learning methods face two main challenges in dealing with healthcare predictive analytics tasks. First, the high-dimensional nature of healthcare data needs labor-intensive and time-consuming processes to select an…

Machine Learning · Computer Science 2022-09-16 Mohammad Amin Morid , Olivia R. Liu Sheng , Joseph Dunbar

Attention mechanism in sequence-to-sequence models is designed to model the alignments between acoustic features and output tokens in speech recognition. However, attention weights produced by models trained end to end do not always…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Gene-Ping Yang , Hao Tang

Many real-life applications involve simultaneously forecasting multiple time series that are hierarchically related via aggregation or disaggregation operations. For instance, commercial organizations often want to forecast inventories…

Machine Learning · Computer Science 2021-02-26 Xing Han , Sambarta Dasgupta , Joydeep Ghosh

Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes"…

Machine Learning · Computer Science 2024-05-06 Qiqi Su , Christos Kloukinas , Artur d'Avila Garcez

Time series are ubiquitous in our data rich world. In what follows I will describe how ideas from dynamical systems and topological data analysis can be combined to gain insights from time-varying data. We will see several applications to…

Algebraic Topology · Mathematics 2018-12-14 Jose A. Perea

Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health…

Machine Learning · Computer Science 2021-06-08 Satya Narayan Shukla , Benjamin M. Marlin

Sequences have become first class citizens in supervised learning thanks to the resurgence of recurrent neural networks. Many complex tasks that require mapping from or to a sequence of observations can now be formulated with the…

Machine Learning · Statistics 2016-02-25 Oriol Vinyals , Samy Bengio , Manjunath Kudlur

Process mining, a data-driven approach for analyzing, visualizing, and improving business processes using event logs, has emerged as a powerful technique in the field of business process management. Process forecasting is a sub-field of…

Machine Learning · Computer Science 2023-12-18 Wenjun Zhou , Artem Polyvyanyy , James Bailey

In the current context of Big Data, the nature of many forecasting problems has changed from predicting isolated time series to predicting many time series from similar sources. This has opened up the opportunity to develop competitive…

Machine Learning · Computer Science 2021-03-23 Hansika Hewamalage , Christoph Bergmeir , Kasun Bandara

We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these…

Machine Learning · Computer Science 2018-04-24 Ali Ziat , Edouard Delasalles , Ludovic Denoyer , Patrick Gallinari

This report first provides a brief overview of a number of supervised learning algorithms for regression tasks. Among those are neural networks, regression trees, and the recently introduced Nexting. Nexting has been presented in the…

Machine Learning · Computer Science 2019-03-19 Michael Koller , Johannes Feldmaier , Klaus Diepold

The key component in forecasting demand and consumption of resources in a supply network is an accurate prediction of real-valued time series. Indeed, both service interruptions and resource waste can be reduced with the implementation of…

Neural and Evolutionary Computing · Computer Science 2018-07-24 Filippo Maria Bianchi , Enrico Maiorino , Michael C. Kampffmeyer , Antonello Rizzi , Robert Jenssen

Accurately predicting the prices of financial time series is essential and challenging for the financial sector. Owing to recent advancements in deep learning techniques, deep learning models are gradually replacing traditional statistical…

Statistical Finance · Quantitative Finance 2023-09-29 Cheng Zhang , Nilam Nur Amir Sjarif , Roslina Ibrahim