English
Related papers

Related papers: Synesthesia of Machines Based Multi-Modal Intellig…

200 papers

Integrated sensing and communications is a key enabler for the 6G wireless communication systems. The multiple sensing modalities will allow the base station to have a more accurate representation of the environment, leading to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Mohammad Farzanullah , Han Zhang , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

Deep learning has been widely used in the perception (e.g., 3D object detection) of intelligent vehicle driving. Due to the beneficial Vehicle-to-Vehicle (V2V) communication, the deep learning based features from other agents can be shared…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Jinlong Li , Runsheng Xu , Xinyu Liu , Jin Ma , Zicheng Chi , Jiaqi Ma , Hongkai Yu

We present a novel method for generating, predicting, and using Spatiotemporal Occupancy Grid Maps (SOGM), which embed future information of dynamic scenes. Our automated generation process creates groundtruth SOGMs from previous navigation…

Robotics · Computer Science 2021-09-17 Hugues Thomas , Matthieu Gallet de Saint Aurin , Jian Zhang , Timothy D. Barfoot

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Stefan Milz , Patrick Mader

The geometry-based stochastic channel models (GSCM), which can describe realistic channel impulse responses, often rely on the existence of both {\em local} and {\em far} scatterers. However, their visibility from both the base station (BS)…

Signal Processing · Electrical Eng. & Systems 2023-08-22 Anish Pradhan , Harpreet S. Dhillon , Fredrik Tufvesson , Andreas F. Molisch

The autonomous car must recognize the driving environment quickly for safe driving. As the Light Detection And Range (LiDAR) sensor is widely used in the autonomous car, fast semantic segmentation of LiDAR point cloud, which is the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Jaehyun Park , Chansoo Kim , Kichun Jo

High-resolution LiDAR data plays a critical role in 3D semantic segmentation for autonomous driving, but the high cost of advanced sensors limits large-scale deployment. In contrast, low-cost sensors such as 16-channel LiDAR produce sparse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Alexandros Gkillas , Nikos Piperigkos , Aris S. Lalos

In autonomous vehicles (AVs), early warning systems rely on collision prediction to ensure occupant safety. However, state-of-the-art methods using deep convolutional networks either fail at modeling collisions or are too expensive/slow,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Arnav V. Malawade , Shih-Yuan Yu , Brandon Hsu , Deepan Muthirayan , Pramod P. Khargonekar , Mohammad A. Al Faruque

A critical requirement for automated driving systems is enabling situational awareness in dynamically changing environments. To that end vehicles will be equipped with diverse sensors, e.g., LIDAR, cameras, mmWave radar, etc. Unfortunately…

Signal Processing · Electrical Eng. & Systems 2018-12-20 Yicong Wang , Gustavo de Veciana , Takayuki Shimizu , Hongsheng Lu

To meet the evolving demands of sixth-generation (6G) wireless channel modeling, such as precise prediction capability, extension capabilities, and system participation capability, multi-modal intelligent channel modeling (MMICM) has been…

Signal Processing · Electrical Eng. & Systems 2026-03-12 Lu Bai , Zengrui Han , Mingran Sun , Xiang Cheng

Recent research has begun exploring novel view synthesis (NVS) for LiDAR point clouds, aiming to generate realistic LiDAR scans from unseen viewpoints. However, most existing approaches do not reconstruct semantic labels, which are crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Yi Chen , Tianchen Deng , Wentao Zhao , Xiaoning Wang , Wenqian Xi , Weidong Chen , Jingchuan Wang

Accurate motion state estimation of Vulnerable Road Users (VRUs), is a critical requirement for autonomous vehicles that navigate in urban environments. Due to their computational efficiency, many traditional autonomy systems perform…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Shivam Gautam , Gregory P. Meyer , Carlos Vallespi-Gonzalez , Brian C. Becker

Autonomous driving requires an understanding of the static environment from sensor data. Learned Bird's-Eye View (BEV) encoders are commonly used to fuse multiple inputs, and a vector decoder predicts a vectorized map representation from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Thomas Monninger , Zihan Zhang , Zhipeng Mo , Md Zafar Anwar , Steffen Staab , Sihao Ding

This paper constructs a novel multi-modal sensing-communication digital-twin dataset, named SynthSoM-Twin, which is spatio-temporally consistent with the real world, for Sim2Real transfer via Synesthesia of Machines (SoM). To construct the…

Signal Processing · Electrical Eng. & Systems 2025-11-17 Junlong Chen , Ziwei Huang , Xuesong Cai , Xiang Cheng , Liuqing Yang

Vehicle-to-Infrastructure (V2I) collaborative perception leverages data collected by infrastructure's sensors to enhance vehicle perceptual capabilities. LiDAR, as a commonly used sensor in cooperative perception, is widely equipped in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Xinxin Feng , Haoran Sun , Haifeng Zheng

As wireless communication technology progresses towards the sixth generation (6G), high-frequency millimeter-wave (mmWave) communication has emerged as a promising candidate for enabling vehicular networks. It offers high data rates and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Ghazi Gharsallah , Georges Kaddoum

The emergence of 6G wireless networks promises to revolutionize vehicular communications by enabling ultra-reliable, low-latency, and high-capacity data exchange. In this context, collaborative perception techniques, where multiple vehicles…

Signal Processing · Electrical Eng. & Systems 2025-06-26 Soheyb Ribouh , Osama Saleem , Mohamed Ababsa

Large driving datasets are a key component in the current development and safeguarding of automated driving functions. Various methods can be used to collect such driving data records. In addition to the use of sensor equipped research…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Laurent Kloeker , Christian Geller , Amarin Kloeker , Lutz Eckstein

Upsampling LiDAR point clouds in autonomous driving scenarios remains a significant challenge due to the inherent sparsity and complex 3D structures of the data. Recent studies have attempted to address this problem by converting the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Chuang Chen , Xiaolin Qin , Jing Hu , Wenyi Ge

Vehicles are no longer isolated entities in traffic environments, thanks to the development of IoV powered by 5G networks and their evolution into 6G. However, it is not enough for vehicles in a highly dynamic and complex traffic…

Networking and Internet Architecture · Computer Science 2024-01-11 Kan Zheng , Jie Mei , Haojun Yang , Lu Hou , Siwei Ma