English
Related papers

Related papers: New Spiking Architecture for Multi-Modal Decision-…

200 papers

Recent trends have shown that autonomous agents, such as Autonomous Ground Vehicles (AGVs), Unmanned Aerial Vehicles (UAVs), and mobile robots, effectively improve human productivity in solving diverse tasks. However, since these agents are…

Robotics · Computer Science 2024-06-19 Rachmad Vidya Wicaksana Putra , Alberto Marchisio , Muhammad Shafique

Multi-modal fusion is a fundamental task for the perception of an autonomous driving system, which has recently intrigued many researchers. However, achieving a rather good performance is not an easy task due to the noisy raw data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Keli Huang , Botian Shi , Xiang Li , Xin Li , Siyuan Huang , Yikang Li

This paper introduces a novel deep learning-based multimodal fusion architecture aimed at enhancing the perception capabilities of autonomous navigation robots in complex environments. By utilizing innovative feature extraction modules,…

Machine Learning · Computer Science 2025-04-29 Delun Lai , Yeyubei Zhang , Yunchong Liu , Chaojie Li , Huadong Mo

In recent years, Spiking Neural Networks (SNNs) have gathered significant interest due to their temporal understanding capabilities. This work introduces, to the best of our knowledge, the first Cortical Column like hybrid architecture for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Aaron Bateni

Transformer-based architectures have shown remarkable performance in vision and language tasks but pose unique challenges for safety-critical applications. This paper presents a conceptual framework for integrating Transformers into…

Software Engineering · Computer Science 2026-01-28 Sven Kirchner , Nils Purschke , Chengdong Wu , Alois Knoll

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, offer a distinctive approach for capturing the complexities of temporal data. However, their potential for spatial modeling in multivariate time-series…

Machine Learning · Computer Science 2025-08-19 Bang Hu , Changze Lv , Mingjie Li , Yunpeng Liu , Xiaoqing Zheng , Fengzhe Zhang , Wei cao , Fan Zhang

Spiking neural networks (SNNs) that mimic information transmission in the brain can energy-efficiently process spatio-temporal information through discrete and sparse spikes, thereby receiving considerable attention. To improve accuracy and…

Neural and Evolutionary Computing · Computer Science 2022-06-14 Byunggook Na , Jisoo Mok , Seongsik Park , Dongjin Lee , Hyeokjun Choe , Sungroh Yoon

Given the energy constraints in autonomous mobile agents (AMAs), such as unmanned vehicles, spiking neural networks (SNNs) are increasingly favored as a more efficient alternative to traditional artificial neural networks. AMAs employ…

Systems and Control · Electrical Eng. & Systems 2025-01-31 Donghwa Kang , Woojin Shin , Cheol-Ho Hong , Minsuk Koo , Brent ByungHoon Kang , Jinkyu Lee , Hyeongboo Baek

In the realm of heterogeneous mixed autonomy, vehicles experience dynamic spatial correlations and nonlinear temporal interactions in a complex, non-Euclidean space. These complexities pose significant challenges to traditional…

Multiagent Systems · Computer Science 2024-08-19 Xin Gao , Zhaoyang Ma , Xueyuan Li , Xiaoqiang Meng , Zirui Li

Besides performance, efficiency is a key design driver of technologies supporting vehicular perception. Indeed, a well-balanced trade-off between performance and energy consumption is crucial for the sustainability of autonomous vehicles.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Aitor Martinez Seras , Javier Del Ser , Pablo Garcia-Bringas

Trajectory prediction and behavioral decision-making are two important tasks for autonomous vehicles that require good understanding of the environmental context; behavioral decisions are better made by referring to the outputs of…

Machine Learning · Computer Science 2022-06-20 Hongyu Hu , Qi Wang , Zhengguang Zhang , Zhengyi Li , Zhenhai Gao

Predicting multiple plausible future trajectories of the nearby vehicles is crucial for the safety of autonomous driving. Recent motion prediction approaches attempt to achieve such multimodal motion prediction by implicitly regularizing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Yicheng Liu , Jinghuai Zhang , Liangji Fang , Qinhong Jiang , Bolei Zhou

Multimodal human action recognition based on RGB and skeleton data fusion, while effective, is constrained by significant limitations such as high computational complexity, excessive memory consumption, and substantial energy demands,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Naichuan Zheng , Hailun Xia , Zeyu Liang , Yuchen Du

Reinforcement Learning (RL) provides a powerful framework for decision-making in complex environments. However, implementing RL in hardware-efficient and bio-inspired ways remains a challenge. This paper presents a novel Spiking Neural…

Neural and Evolutionary Computing · Computer Science 2023-08-09 Sergio F. Chevtchenko , Yeshwanth Bethi , Teresa B. Ludermir , Saeed Afshar

In recent years, Spiking Neural Networks (SNNs) have achieved remarkable progress, with Spiking Transformers emerging as a promising architecture for energy-efficient sequence modeling. However, existing Spiking Transformers still lack a…

Neural and Evolutionary Computing · Computer Science 2026-01-27 Sicheng Shen , Mingyang Lv , Bing Han , Dongcheng Zhao , Guobin Shen , Feifei Zhao , Yi Zeng

Navigating dense and dynamic environments poses a significant challenge for autonomous driving systems, owing to the intricate nature of multimodal interaction, wherein the actions of various traffic participants and the autonomous vehicle…

Robotics · Computer Science 2024-08-29 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

Spiking Neural Networks (SNNs) offer a biologically inspired alternative to conventional artificial neural networks, with potential advantages in power efficiency due to their event-driven computation. Despite their promise, SNNs have yet…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Wangdan Liao , Weidong Wang

High-level driving behavior decision-making is an open-challenging problem for connected vehicle technology, especially in heterogeneous traffic scenarios. In this paper, a deep reinforcement learning based high-level driving behavior…

Machine Learning · Computer Science 2019-02-27 Zhengwei Bai , Baigen Cai , Wei Shangguan , Linguo Chai

Autonomous driving is an emerging technology that has advanced rapidly over the last decade. Modern transportation is expected to benefit greatly from a wise decision-making framework of autonomous vehicles, including the improvement of…

Artificial Intelligence · Computer Science 2023-12-20 Yuyang Xia , Shuncheng Liu , Quanlin Yu , Liwei Deng , You Zhang , Han Su , Kai Zheng

Spiking neural networks (SNNs) offer a promising path toward energy-efficient speech command recognition (SCR) by leveraging their event-driven processing paradigm. However, existing SNN-based SCR methods often struggle to capture rich…

Sound · Computer Science 2026-01-21 Jiaqi Wang , Liutao Yu , Xiongri Shen , Sihang Guo , Chenlin Zhou , Leilei Zhao , Yi Zhong , Zhiguo Zhang , Zhengyu Ma