English
Related papers

Related papers: Temporal Embedding in Convolutional Neural Network…

200 papers

Various deep learning models, especially some latest Transformer-based approaches, have greatly improved the state-of-art performance for long-term time series forecasting.However, those transformer-based models suffer a severe…

Machine Learning · Computer Science 2022-06-27 Tian Zhou , Jianqing Zhu , Xue Wang , Ziqing Ma , Qingsong Wen , Liang Sun , Rong Jin

A major obstacle to building models for effective semantic segmentation, and particularly video semantic segmentation, is a lack of large and well annotated datasets. This bottleneck is particularly prohibitive in highly specialized and…

We study the approximation properties of convolutional architectures applied to time series modelling, which can be formulated mathematically as a functional approximation problem. In the recurrent setting, recent results reveal an…

Machine Learning · Computer Science 2021-07-21 Haotian Jiang , Zhong Li , Qianxiao Li

Recurrent neural networks (RNNs) are state-of-the-art in several sequential learning tasks, but they often require considerable amounts of data to generalise well. For many time series forecasting (TSF) tasks, only a few dozens of…

Machine Learning · Computer Science 2020-03-30 Bernardo Pérez Orozco , Stephen J Roberts

In this work we propose a novel approach to utilize convolutional neural networks for time series forecasting. The time direction of the sequential data with spatial dimensions $D=1,2$ is considered democratically as the input of a…

Machine Learning · Computer Science 2020-01-13 Matthias Weissenbacher

Representing the nodes of continuous-time temporal graphs in a low-dimensional latent space has wide-ranging applications, from prediction to visualization. Yet, analyzing continuous-time relational data with timestamped interactions…

Machine Learning · Computer Science 2024-05-28 Raphaël Romero , Jefrey Lijffijt , Riccardo Rastelli , Marco Corneli , Tijl De Bie

Temporal Graph Neural Networks (TGNNs) aim to capture the evolving structure and timing of interactions in dynamic graphs. Although many models incorporate time through encodings or architectural design, they often compute attention over…

Machine Learning · Computer Science 2026-02-03 Govind Waghmare , Srini Rohan Gujulla Leel , Nikhil Tumbde , Sumedh B G , Sonia Gupta , Srikanta Bedathur

The ability to identify and temporally segment fine-grained human actions throughout a video is crucial for robotics, surveillance, education, and beyond. Typical approaches decouple this problem by first extracting local spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Colin Lea , Michael D. Flynn , Rene Vidal , Austin Reiter , Gregory D. Hager

Despite the success of deep learning for static image understanding, it remains unclear what are the most effective network architectures for the spatial-temporal modeling in videos. In this paper, in contrast to the existing CNN+RNN or…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Dongliang He , Zhichao Zhou , Chuang Gan , Fu Li , Xiao Liu , Yandong Li , Limin Wang , Shilei Wen

Temporal knowledge graph, serving as an effective way to store and model dynamic relations, shows promising prospects in event forecasting. However, most temporal knowledge graph reasoning methods are highly dependent on the recurrence or…

Artificial Intelligence · Computer Science 2022-12-05 Yi Xu , Junjie Ou , Hui Xu , Luoyi Fu

Multivariate time series forecasting poses an ongoing challenge across various disciplines. Time series data often exhibit diverse intra-series and inter-series correlations, contributing to intricate and interwoven dependencies that have…

Machine Learning · Computer Science 2024-01-02 Wanlin Cai , Yuxuan Liang , Xianggen Liu , Jianshuai Feng , Yuankai Wu

We introduce in this paper the principle of Deep Temporal Networks that allow to add time to convolutional networks by allowing deep integration principles not only using spatial information but also increasingly large temporal window. The…

Neural and Evolutionary Computing · Computer Science 2018-11-20 Marco Macanovic , Fabian Chersi , Felix Rutard , Sio-Hoi Ieng , Ryad Benosman

Convolutional Neural Networks (CNNs) have recently emerged as the dominant model in computer vision. If provided with enough training data, they predict almost any visual quantity. In a discrete setting, such as classification, CNNs are not…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Deepak Pathak , Philipp Krähenbühl , Stella X. Yu , Trevor Darrell

In this pilot study, we propose a neuro-inspired approach that compresses temporal sequences into context-tagged chunks, where each tag represents a recurring structural unit or``community'' in the sequence. These tags are generated during…

Machine Learning · Computer Science 2025-07-16 Jayanta Dey , Nicholas Soures , Miranda Gonzales , Itamar Lerner , Christopher Kanan , Dhireesha Kudithipudi

The fast adaptation capability of deep neural networks in non-stationary environments is critical for online time series forecasting. Successful solutions require handling changes to new and recurring patterns. However, training deep neural…

Machine Learning · Computer Science 2022-10-18 Quang Pham , Chenghao Liu , Doyen Sahoo , Steven C. H. Hoi

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

Machine Learning · Statistics 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang

Network embeddings learn to represent nodes as low-dimensional vectors to preserve the proximity between nodes and communities of the network for network analysis. The temporal edges (e.g., relationships, contacts, and emails) in dynamic…

Social and Information Networks · Computer Science 2019-06-25 Chuanchang Chen , Yubo Tao , Hai Lin

Due to the rapid growth of scientific publications, identifying all related reference articles in the literature has become increasingly challenging yet highly demanding. Existing methods primarily assess candidate publications from a…

Information Retrieval · Computer Science 2024-08-29 Junhao Shen , Mohammad Ausaf Ali Haqqani , Beichen Hu , Cheng Huang , Xihao Xie , Tsengdar Lee , Jia Zhang

Much of modern practice in financial forecasting relies on technicals, an umbrella term for several heuristics applying visual pattern recognition to price charts. Despite its ubiquity in financial media, the reliability of its signals…

Computational Finance · Quantitative Finance 2018-07-12 Sid Ghoshal , Stephen J. Roberts

With the recent development and advancement of Transformer and MLP architectures, significant strides have been made in time series analysis. Conversely, the performance of Convolutional Neural Networks (CNNs) in time series analysis has…

Machine Learning · Computer Science 2025-03-12 Chenghan Li , Mingchen Li , Ruisheng Diao