English
Related papers

Related papers: Non-Autoregressive vs Autoregressive Neural Networ…

200 papers

Using a proper model to characterize a time series is crucial in making accurate predictions. In this work we use time-varying autoregressive process (TVAR) to describe non-stationary time series and model it as a mixture of multiple stable…

Machine Learning · Statistics 2016-11-17 Jie Ding , Mohammad Noshad , Vahid Tarokh

Traffic flow prediction is an essential task in constructing smart cities and is a typical Multivariate Time Series (MTS) Problem. Recent research has abandoned Gated Recurrent Units (GRU) and utilized dilated convolutions or temporal…

Artificial Intelligence · Computer Science 2024-04-19 Wenfeng Zhang , Xin Li , Anqi Li , Xiaoting Huang , Ti Wang , Honglei Gao

Interest in automatic people re-identification systems has significantly grown in recent years, mainly for developing surveillance and smart shops software. Due to the variability in person posture, different lighting conditions, and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Victor Uc-Cetina , Laura Alvarez-Gonzalez , Anabel Martin-Gonzalez

Based on the progress of image recognition, video recognition has been extensively studied recently. However, most of the existing methods are focused on short-term but not long-term video recognition, called contextual video recognition.…

Computer Vision and Pattern Recognition · Computer Science 2017-05-25 Minju Jung , Haanvid Lee , Jun Tani

We propose to train a non-autoregressive machine translation model to minimize the energy defined by a pretrained autoregressive model. In particular, we view our non-autoregressive translation system as an inference network (Tu and Gimpel,…

Computation and Language · Computer Science 2020-05-14 Lifu Tu , Richard Yuanzhe Pang , Sam Wiseman , Kevin Gimpel

Reinforcement learning algorithms rely on exploration to discover new behaviors, which is typically achieved by following a stochastic policy. In continuous control tasks, policies with a Gaussian distribution have been widely adopted.…

Machine Learning · Computer Science 2019-03-28 Dmytro Korenkevych , A. Rupam Mahmood , Gautham Vasan , James Bergstra

Recent works have demonstrated the superiority of supervised Convolutional Neural Networks (CNNs) in learning hierarchical representations from time series data for successful classification. These methods require sufficiently large labeled…

Machine Learning · Computer Science 2023-09-12 Fanling Huang , Yangdong Deng

Real-time adaptive control of nonlinear systems with unknown dynamics and time-varying disturbances demands precise modeling and robust parameter adaptation. While existing neural network-based strategies struggle with computational…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Mingcong Li

In this paper we propose an identification method for latent-variable graphical models associated to autoregressive (AR) Gaussian stationary processes. The identification procedure exploits the approximation of AR processes through…

Optimization and Control · Mathematics 2018-09-06 Daniele Alpago , Mattia Zorzi , Augusto Ferrante

In the classic machine learning framework, models are trained on historical data and used to predict future values. It is assumed that the data distribution does not change over time (stationarity). However, in real-world scenarios, the…

Machine Learning · Statistics 2023-06-13 Mansour Zoubeirou A Mayaki , Michel Riveill

Benchmarking the performance of information retrieval (IR) is mostly conducted with a fixed set of documents (static corpora). However, in realistic scenarios, this is rarely the case and the documents to be retrieved are constantly updated…

Information Retrieval · Computer Science 2024-10-08 Chaeeun Kim , Soyoung Yoon , Hyunji Lee , Joel Jang , Sohee Yang , Minjoon Seo

Modeling complex spatial and temporal correlations in the correlated time series data is indispensable for understanding the traffic dynamics and predicting the future status of an evolving traffic system. Recent works focus on designing…

Machine Learning · Computer Science 2020-10-23 Lei Bai , Lina Yao , Can Li , Xianzhi Wang , Can Wang

Wildfire modelling is an attempt to reproduce fire behaviour. Through active fire analysis, it is possible to reproduce a dynamical process, such as wildfires, with limited duration time series data. Recurrent neural networks (RNNs) can…

Machine Learning · Computer Science 2020-05-28 Rylan Perumal , Terence L van Zyl

Spike-based temporal messaging enables SNNs to efficiently process both purely temporal and spatio-temporal time-series or event-driven data. Combining SNNs with Gated Recurrent Units (GRUs), a variant of recurrent neural networks, gives…

Machine Learning · Computer Science 2025-10-30 Yesmine Abdennadher , Eleonora Cicciarella , Michele Rossi

In this work, we propose GLUE (Graph Deviation Network with Local Uncertainty Estimation), building on the recently proposed Graph Deviation Network (GDN). GLUE not only automatically learns complex dependencies between variables and uses…

Machine Learning · Computer Science 2021-12-08 Saswati Ray , Sana Lakdawala , Mononito Goswami , Chufan Gao

Generative Autoregressive Neural Networks (ARNNs) have recently demonstrated exceptional results in image and language generation tasks, contributing to the growing popularity of generative models in both scientific and commercial…

Disordered Systems and Neural Networks · Physics 2024-03-26 Indaco Biazzo

As one of the important tools for spatial feature extraction, graph convolution has been applied in a wide range of fields such as traffic flow prediction. However, current popular works of graph convolution cannot guarantee spatio-temporal…

Machine Learning · Computer Science 2023-09-15 Tianpu Zhang , Weilong Ding , Mengda Xing

A unique feature of Recurrent Neural Networks (RNNs) is that it incrementally processes input sequences. In this research, we aim to uncover the inherent generalization properties, i.e., inductive bias, of RNNs with respect to how…

Machine Learning · Computer Science 2023-05-17 Taiga Ishii , Ryo Ueda , Yusuke Miyao

Autonomous vehicles are controlled today either based on sequences of decoupled perception-planning-action operations, either based on End2End or Deep Reinforcement Learning (DRL) systems. Current deep learning solutions for autonomous…

Robotics · Computer Science 2019-06-27 Sorin Grigorescu , Bogdan Trasnea , Liviu Marina , Andrei Vasilcoi , Tiberiu Cocias

Traffic forecasting is a problem of intelligent transportation systems (ITS) and crucial for individuals and public agencies. Therefore, researches pay great attention to deal with the complex spatio-temporal dependencies of traffic system…

Machine Learning · Computer Science 2021-12-07 Yanjun Qin , Yuchen Fang , Haiyong Luo , Fang Zhao , Chenxing Wang