English
Related papers

Related papers: System Identification with Time-Aware Neural Seque…

200 papers

We consider the general problem of modeling temporal data with long-range dependencies, wherein new observations are fully or partially predictable based on temporally-distant, past observations. A sufficiently powerful temporal model…

We introduce a novel modeling approach for time series imputation and forecasting, tailored to address the challenges often encountered in real-world data, such as irregular samples, missing data, or unaligned measurements from multiple…

Interacting systems are prevalent in nature. It is challenging to accurately predict the dynamics of the system if its constituent components are analyzed independently. We develop a graph-based model that unveils the systemic interactions…

Machine Learning · Computer Science 2024-10-31 Giangiacomo Mercatali , Andre Freitas , Jie Chen

Modeling irregularly sampled multivariate time series is a persistent challenge in domains like healthcare and sensor networks. While recent works have explored a variety of complex learning architectures to solve the prediction problems…

Machine Learning · Computer Science 2026-02-19 Ankitkumar Joshi , Milos Hauskrecht

Typical methods for supervised sequence modeling are built upon the recurrent neural networks to capture temporal dependencies. One potential limitation of these methods is that they only model explicitly information interactions between…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Canmiao Fu , Wenjie Pei , Qiong Cao , Chaopeng Zhang , Yong Zhao , Xiaoyong Shen , Yu-Wing Tai

Event camera has offered promising alternative for visual perception, especially in high speed and high dynamic range scenes. Recently, many deep learning methods have shown great success in providing promising solutions to many event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Ziluo Ding , Rui Zhao , Jiyuan Zhang , Tianxiao Gao , Ruiqin Xiong , Zhaofei Yu , Tiejun Huang

The identification and modeling of time-varying systems is a fundamental challenge in signal processing and system identification. To address this challenge, we propose a class of time-varying state-space model (SSM) based neural networks…

Machine Learning · Computer Science 2026-05-18 Sanja Karilanova , Subhrakanti Dey , Ayça Özçelikkale

Irregularly sampled time series are increasingly prevalent, particularly in medical domains. While various specialized methods have been developed to handle these irregularities, effectively modeling their complex dynamics and pronounced…

Machine Learning · Computer Science 2023-11-01 Zekun Li , Shiyang Li , Xifeng Yan

Gating mechanisms are widely used in neural network models, where they allow gradients to backpropagate more easily through depth or time. However, their saturation property introduces problems of its own. For example, in recurrent models…

Neural and Evolutionary Computing · Computer Science 2020-06-22 Albert Gu , Caglar Gulcehre , Tom Le Paine , Matt Hoffman , Razvan Pascanu

Neural marked temporal point processes have been a valuable addition to the existing toolbox of statistical parametric models for continuous-time event data. These models are useful for sequences where each event is associated with a single…

Machine Learning · Computer Science 2024-03-20 Yuxin Chang , Alex Boyd , Padhraic Smyth

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Learning in the space-time domain remains a very challenging problem in machine learning and computer vision. Current computational models for understanding spatio-temporal visual data are heavily rooted in the classical single-image based…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Andrei Nicolicioiu , Iulia Duta , Marius Leordeanu

We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these…

Machine Learning · Computer Science 2018-04-24 Ali Ziat , Edouard Delasalles , Ludovic Denoyer , Patrick Gallinari

Clinical time series are often irregularly sampled, with varying sensor frequencies, missing observations, and misaligned timestamps. Prior approaches typically address these irregularities by interpolating data into regular sequences,…

Machine Learning · Computer Science 2025-12-18 Arash Hajisafi , Maria Despoina Siampou , Bita Azarijoo , Zhen Xiong , Cyrus Shahabi

Successful Human-Robot collaboration requires a predictive model of human behavior. The robot needs to be able to recognize current goals and actions and to predict future activities in a given context. However, the spatio-temporal sequence…

Computer Vision and Pattern Recognition · Computer Science 2018-09-20 Judith Bütepage , Danica Kragic

Real-world time series data exhibit non-stationary behavior, regime shifts, and temporally varying noise (heteroscedastic) that degrade the robustness of standard regression models. We introduce the Variability-Aware Recursive Neural…

Machine Learning · Computer Science 2025-10-13 Haroon Gharwi , Kai Shu

Modeling multivariate time series as temporal signals over a (possibly dynamic) graph is an effective representational framework that allows for developing models for time series analysis. In fact, discrete sequences of graphs can be…

Machine Learning · Computer Science 2022-10-11 Ivan Marisca , Andrea Cini , Cesare Alippi

Much of the information the brain processes and stores is temporal in nature - a spoken word or a handwritten signature, for example, is defined by how it unfolds in time. However, it remains unclear how neural circuits encode complex…

Neurons and Cognition · Quantitative Biology 2017-08-15 Vishwa Goudar , Dean Buonomano

Modeling the evolution of system with time-series data is a challenging and critical task in a wide range of fields, especially when the time-series data is regularly sampled and partially observable. Some methods have been proposed to…

Machine Learning · Computer Science 2024-12-03 Mengbang Zou , Weisi Guo

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki