English
Related papers

Related papers: Spectral Transformer Neural Processes

200 papers

Spiking Neural Networks (SNNs) are biologically inspired machine learning models that build on dynamic neuronal models processing binary and sparse spiking signals in an event-driven, online, fashion. SNNs can be implemented on neuromorphic…

Neural and Evolutionary Computing · Computer Science 2020-12-10 Hyeryung Jang , Nicolas Skatchkovsky , Osvaldo Simeone

A temporal point process (TPP) is a stochastic process where its realization is a sequence of discrete events in time. Recent work in TPPs model the process using a neural network in a supervised learning framework, where a training set is…

Machine Learning · Computer Science 2023-01-31 Wonho Bae , Mohamed Osama Ahmed , Frederick Tung , Gabriel L. Oliveira

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

An effective understanding of the contextual environment and accurate motion forecasting of surrounding agents is crucial for the development of autonomous vehicles and social mobile robots. This task is challenging since the behavior of an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Defu Cao , Jiachen Li , Hengbo Ma , Masayoshi Tomizuka

In this work we propose a unified Fourier Spectral Transformer network that integrates the strengths of classical spectral methods and attention based neural architectures. By transforming the original PDEs into spectral ordinary…

Machine Learning · Computer Science 2025-07-09 Beibei Li

Neuromorphic vision sensors (event cameras) simulate biological visual perception systems and have the advantages of high temporal resolution, less data redundancy, low power consumption, and large dynamic range. Since both events and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Haibo Shen , Juyu Xiao , Yihao Luo , Xiang Cao , Liangqi Zhang , Tianjiang Wang

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more…

Emerging Technologies · Computer Science 2019-05-29 S. R. Nandakumar , Irem Boybat , Manuel Le Gallo , Evangelos Eleftheriou , Abu Sebastian , Bipin Rajendran

Event cameras, with their high dynamic range and temporal resolution, are ideally suited for object detection, especially under scenarios with motion blur and challenging lighting conditions. However, while most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ziming Wang , Ziling Wang , Huaning Li , Lang Qin , Runhao Jiang , De Ma , Huajin Tang

There is an increasing demand to process streams of temporal data in energy-limited scenarios such as embedded devices, driven by the advancement and expansion of Internet of Things (IoT) and Cyber-Physical Systems (CPS). Spiking neural…

Neural and Evolutionary Computing · Computer Science 2020-07-08 Haowen Fang , Amar Shrestha , Qinru Qiu

Spiking Neural Networks (SNNs) are widely regarded as a biologically-inspired and energy-efficient alternative to classical artificial neural networks. Yet, their theoretical foundations remain only partially understood. In this work, we…

Optimization and Control · Mathematics 2025-09-29 Umberto Biccari

Spiking neural networks (SNNs) have received widespread attention as an ultra-low power computing paradigm. Recent studies have shown that SNNs suffer from severe overfitting, which limits their generalization performance. In this paper, we…

Artificial Intelligence · Computer Science 2025-03-11 Lin Zuo , Yongqi Ding , Wenwei Luo , Mengmeng Jing , Kunshan Yang

Transformer-based Spiking Neural Networks (SNNs) suffer from a great performance gap compared to floating-point \mbox{Artificial} Neural Networks (ANNs) due to the binary nature of spike trains. Recent efforts have introduced deep-level…

Neural and Evolutionary Computing · Computer Science 2025-08-12 Zeqi Zheng , Zizheng Zhu , Yingchao Yu , Yanchen Huang , Changze Lv , Junfeng Tang , Zhaofei Yu , Yaochu Jin

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Space-time graph neural networks (ST-GNNs) are recently developed architectures that learn efficient graph representations of time-varying data. ST-GNNs are particularly useful in multi-agent systems, due to their stability properties and…

Machine Learning · Computer Science 2022-10-31 Samar Hadou , Charilaos Kanatsoulis , Alejandro Ribeiro

As industrial systems become more complex and monitoring sensors for everything from surveillance to our health become more ubiquitous, multivariate time series prediction is taking an important place in the smooth-running of our society. A…

Machine Learning · Computer Science 2022-03-03 Fan Jin , Ke Zhang , Yipan Huang , Yifei Zhu , Baiping Chen

We introduce Markov Neural Processes (MNPs), a new class of Stochastic Processes (SPs) which are constructed by stacking sequences of neural parameterised Markov transition operators in function space. We prove that these Markov transition…

Machine Learning · Statistics 2023-05-26 Jin Xu , Emilien Dupont , Kaspar Märtens , Tom Rainforth , Yee Whye Teh

Recurrent neural networks (RNNs) are a vital modeling technique that rely on internal states learned indirectly by optimization of a supervised, unsupervised, or reinforcement training loss. RNNs are used to model dynamic processes that are…

Artificial Neural Networks (ANN) have gained significant popularity thanks to their ability to learn using the well-known backpropagation algorithm. Conversely, Spiking Neural Networks (SNNs), despite having broader capabilities than ANNs,…

Neural and Evolutionary Computing · Computer Science 2024-06-26 Sergio Davies , Andrew Gait , Andrew Rowley , Alessandro Di Nuovo

We develop methodology allowing to simulate a stationary functional time series defined by means of its spectral density operators. Our framework is general, in that it encompasses any such stationary functional time series, whether linear…

Methodology · Statistics 2020-07-17 Tomáš Rubín , Victor M. Panaretos

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, offer a distinctive approach for capturing the complexities of temporal data. However, their potential for spatial modeling in multivariate time-series…

Machine Learning · Computer Science 2025-08-19 Bang Hu , Changze Lv , Mingjie Li , Yunpeng Liu , Xiaoqing Zheng , Fengzhe Zhang , Wei cao , Fan Zhang