English
Related papers

Related papers: Concrete Dense Network for Long-Sequence Time Seri…

200 papers

Time series forecasting poses significant challenges in non-stationary environments where underlying patterns evolve over time. In this work, we propose a novel framework that enhances deep neural network (DNN) performance by leveraging…

Machine Learning · Computer Science 2025-08-12 Amal Saadallah , Abdulaziz Al-Ademi

Time series, as one of the most fundamental representations of sequential data, has been extensively studied across diverse disciplines, including computer science, biology, geology, astronomy, and environmental sciences. The advent of…

Machine Learning · Computer Science 2024-12-31 John Paparrizos , Fan Yang , Haojun Li

Recurrent neural networks (RNNs), temporal convolutions, and neural differential equations (NDEs) are popular families of deep learning models for time-series data, each with unique strengths and tradeoffs in modeling power and…

Machine Learning · Computer Science 2021-10-28 Albert Gu , Isys Johnson , Karan Goel , Khaled Saab , Tri Dao , Atri Rudra , Christopher Ré

Deep learning models are widely used for time series classification (TSC) due to their scalability and efficiency. However, their performance degrades under challenging data conditions such as class similarity, multimodal distributions, and…

Machine Learning · Computer Science 2025-07-30 Yaoyu Zhang , Chi-Guhn Lee

Time series prediction with neural networks has been the focus of much research in the past few decades. Given the recent deep learning revolution, there has been much attention in using deep learning models for time series prediction, and…

Machine Learning · Computer Science 2021-06-08 Rohitash Chandra , Shaurya Goyal , Rishabh Gupta

We present a novel framework that leverages time series clustering to improve internet traffic matrix (TM) prediction using deep learning (DL) models. Traffic flows within a TM often exhibit diverse temporal behaviors, which can hinder…

Machine Learning · Computer Science 2025-09-19 Martha Cash , Alexander Wyglinski

Accurate traffic forecasting is a fundamental problem in intelligent transportation systems and learning long-range traffic representations with key information through spatiotemporal graph neural networks (STGNNs) is a basic assumption of…

Machine Learning · Computer Science 2024-03-26 Qinyao Luo , Silu He , Xing Han , Yuhan Wang , Haifeng Li

Large scale machine learning and deep models are extremely data-hungry. Unfortunately, obtaining large amounts of labeled data is expensive, and training state-of-the-art models (with hyperparameter tuning) requires significant computing…

Machine Learning · Computer Science 2021-06-15 Krishnateja Killamsetty , Durga Sivasubramanian , Ganesh Ramakrishnan , Rishabh Iyer

Deep learning has achieved substantial improvement on single-channel speech enhancement tasks. However, the performance of multi-layer perceptions (MLPs)-based methods is limited by the ability to capture the long-term effective history…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Qiquan Zhang , Aaron Nicolson , Mingjiang Wang , Kuldip K. Paliwal , Chenxu Wang

Now a days, data mining and knowledge discovery methods are applied to a variety of enterprise and engineering disciplines to uncover interesting patterns from databases. The study of Sequential patterns is an important data mining problem…

Databases · Computer Science 2009-06-24 Jigyasa Bisaria , Namita Shrivastava , K. R. Pardasani

In this paper, we consider deep neural networks for solving inverse problems that are robust to forward model mis-specifications. Specifically, we treat sensing problems with model mismatch where one wishes to recover a sparse…

Machine Learning · Computer Science 2021-10-22 Wei Pu , Chao Zhou , Yonina C. Eldar , Miguel R. D. Rodrigues

Time Series Clustering is an important subroutine in many higher-level data mining analyses, including data editing for classifiers, summarization, and outlier detection. It is well known that for similarity search the superiority of…

Machine Learning · Computer Science 2016-12-05 Nurjahan Begum , Liudmila Ulanova , Hoang Anh Dau , Jun Wang , Eamonn Keogh

Solving real-world problems, particularly with deep learning, relies on the availability of abundant, quality data. In this paper we develop a novel framework that maximises the utility of time-series datasets that contain only small…

Machine Learning · Computer Science 2019-06-04 Ivan Kiskin , Udeepa Meepegama , Steven Roberts

Recent works have shown that Deep Recurrent Neural Networks using the LSTM architecture can achieve strong single-channel speech enhancement by estimating time-frequency masks. However, these models do not naturally generalize to…

Sound · Computer Science 2020-12-04 Felix Grezes , Zhaoheng Ni , Viet Anh Trinh , Michael Mandel

Pretrained using large amount of data, autoregressive language models are able to generate high quality sequences. However, these models do not perform well under hard lexical constraints as they lack fine control of content generation…

Computation and Language · Computer Science 2021-03-18 Lee-Hsun Hsieh , Yang-Yin Lee , Ee-Peng Lim

To effectively address the issues of low sensitivity and high time consumption in time series anomaly detection, we propose an anomaly detection method based on cross-modal deep metric learning. A cross-modal deep metric learning feature…

Machine Learning · Computer Science 2025-09-17 Wei Li , Zheze Yang

The attention operator is arguably the key distinguishing factor of transformer architectures, which have demonstrated state-of-the-art performance on a variety of tasks. However, transformer attention operators often impose a significant…

Machine Learning · Computer Science 2024-12-24 Ziyang Wu , Tianjiao Ding , Yifu Lu , Druv Pai , Jingyuan Zhang , Weida Wang , Yaodong Yu , Yi Ma , Benjamin D. Haeffele

The high-resolution time series classification problem is essential due to the increasing availability of detailed temporal data in various domains. To tackle this challenge effectively, it is imperative that the state-of-the-art attention…

Machine Learning · Computer Science 2024-03-11 Aosong Feng , Jialin Chen , Juan Garza , Brooklyn Berry , Francisco Salazar , Yifeng Gao , Rex Ying , Leandros Tassiulas

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

Machine Learning · Computer Science 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

Image clustering is one of the most important computer vision applications, which has been extensively studied in literature. However, current clustering methods mostly suffer from lack of efficiency and scalability when dealing with…

Machine Learning · Computer Science 2017-08-10 Kamran Ghasedi Dizaji , Amirhossein Herandi , Cheng Deng , Weidong Cai , Heng Huang