English
Related papers

Related papers: Enhancing Continuous Time Series Modelling with a …

200 papers

Machine learning simulations of open quantum dynamics often rely on recursive predictors that accumulate error. We develop a non-recursive convolutional neural networks (CNNs) that maps system parameters and a redundant time encoding…

Chemical Physics · Physics 2025-12-11 Shun-Cai Zhao , Yi-Meng Huang , Yi-Fan Yang , Zi-Ran Zhao

Monitoring network traffic to maintain the quality of service (QoS) and to detect network intrusions in a timely and efficient manner is essential. As network traffic is sequential, recurrent neural networks (RNNs) such as long short-term…

Cryptography and Security · Computer Science 2023-10-04 Muhammad Wasim Nawaz , Rashid Munawar , Ahsan Mehmood , Muhammad Mahboob Ur Rahman , Qammer H. Abbasi

In this paper, we propose a sequential neural encoder with latent structured description (SNELSD) for modeling sentences. This model introduces latent chunk-level representations into conventional sequential neural encoders, i.e., recurrent…

Computation and Language · Computer Science 2017-11-16 Yu-Ping Ruan , Qian Chen , Zhen-Hua Ling

Drawing inspiration from gradient-based meta-learning methods with infinitely small gradient steps, we introduce Continuous-Time Meta-Learning (COMLN), a meta-learning algorithm where adaptation follows the dynamics of a gradient vector…

Machine Learning · Computer Science 2022-03-04 Tristan Deleu , David Kanaa , Leo Feng , Giancarlo Kerg , Yoshua Bengio , Guillaume Lajoie , Pierre-Luc Bacon

We designed a new artificial neural network by modifying the neural ordinary differential equation (NODE) framework to successfully predict the time evolution of the 2D mode profile in both the linear growth and nonlinear saturated stages.…

Plasma Physics · Physics 2024-11-11 Bowen Zhu , Hao Wang , Jian Wu , Haijun Ren

We present a novel model called One Class Minimum Spanning Tree (OCmst) for novelty detection problem that uses a Convolutional Neural Network (CNN) as deep feature extractor and graph-based model based on Minimum Spanning Tree (MST). In a…

Machine Learning · Computer Science 2020-03-31 Riccardo La Grassa , Ignazio Gallo , Nicola Landro

Multivariate time series forecasting is an important machine learning problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. Temporal data arise in these…

Machine Learning · Computer Science 2018-04-20 Guokun Lai , Wei-Cheng Chang , Yiming Yang , Hanxiao Liu

Short-term traffic forecasting based on deep learning methods, especially recurrent neural networks (RNN), has received much attention in recent years. However, the potential of RNN-based models in traffic forecasting has not yet been fully…

Machine Learning · Computer Science 2020-05-26 Zhiyong Cui , Ruimin Ke , Ziyuan Pu , Yinhai Wang

Manually authoring transition animations for a complete locomotion system can be a tedious and time-consuming task, especially for large games that allow complex and constrained locomotion movements, where the number of transitions grows…

Graphics · Computer Science 2021-03-22 Félix G. Harvey , Christopher Pal

Despite the success of deep neural networks (DNNs) for real-world applications over time-series data such as mobile health, little is known about how to train robust DNNs for time-series domain due to its unique characteristics compared to…

Machine Learning · Computer Science 2022-07-14 Taha Belkhouja , Yan Yan , Janardhan Rao Doppa

Automatically describing videos with natural language is a fundamental challenge for computer vision and natural language processing. Recently, progress in this problem has been achieved through two steps: 1) employing 2-D and/or 3-D…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Yuyu Guo , Jingqiu Zhang , Lianli Gao

Recurrent Neural Networks (RNNs), more specifically their Long Short-Term Memory (LSTM) variants, have been widely used as a deep learning tool for tackling sequence-based learning tasks in text and speech. Training of such LSTM…

Machine Learning · Computer Science 2021-06-24 Anup Sarma , Sonali Singh , Huaipan Jiang , Rui Zhang , Mahmut T Kandemir , Chita R Das

Recent advancements in Latent Diffusion Models (LDMs) have propelled them to the forefront of various generative tasks. However, their iterative sampling process poses a significant computational burden, resulting in slow generation speeds…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-10 Huadai Liu , Rongjie Huang , Yang Liu , Hengyuan Cao , Jialei Wang , Xize Cheng , Siqi Zheng , Zhou Zhao

Connectionist temporal classification (CTC) based supervised sequence training of recurrent neural networks (RNNs) has shown great success in many machine learning areas including end-to-end speech and handwritten character recognition. For…

Machine Learning · Computer Science 2017-02-03 Kyuyeon Hwang , Wonyong Sung

Explicit chain-of-thought (CoT) reasoning substantially improves the reasoning ability of large language models (LLMs), but incurs high inference cost due to lengthy autoregressive traces. Existing latent reasoning methods offer a promising…

Computation and Language · Computer Science 2026-05-26 Hui Xie , Jie Liu , Ziyue Qiao , Joaquin Vanschore

Recurrent neural networks (RNNs), temporal convolutions, and neural differential equations (NDEs) are popular families of deep learning models for time-series data, each with unique strengths and tradeoffs in modeling power and…

Machine Learning · Computer Science 2021-10-28 Albert Gu , Isys Johnson , Karan Goel , Khaled Saab , Tri Dao , Atri Rudra , Christopher Ré

Recently, the text-to-3D task has developed rapidly due to the appearance of the SDS method. However, the SDS method always generates 3D objects with poor quality due to the over-smooth issue. This issue is attributed to two factors: 1) the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yiming Zhong , Xiaolin Zhang , Yao Zhao , Yunchao Wei

Nowadays, modern earth observation programs produce huge volumes of satellite images time series (SITS) that can be useful to monitor geographical areas through time. How to efficiently analyze such kind of information is still an open…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Dino Ienco , Raffaele Gaetano , Claire Dupaquier , Pierre Maurel

Combinations of neural ODEs with recurrent neural networks (RNN), like GRU-ODE-Bayes or ODE-RNN are well suited to model irregularly observed time series. While those models outperform existing discrete-time approaches, no theoretical…

Machine Learning · Statistics 2021-05-11 Calypso Herrera , Florian Krach , Josef Teichmann

Smooth dynamics interrupted by discontinuities are known as hybrid systems and arise commonly in nature. Latent ODEs allow for powerful representation of irregularly sampled time series but are not designed to capture trajectories arising…

Machine Learning · Computer Science 2021-06-11 Ruian Shi , Quaid Morris