Related papers: Long-range depth imaging using a single-photon det…
There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…
Superconducting nanowire single photon detectors (SNSPDs) are the highest-performing technology for time-resolved single-photon counting from the UV to the near-infrared. The recent discovery of single-photon sensitivity in micrometer-scale…
This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…
This paper considers the problem of single image depth estimation. The employment of convolutional neural networks (CNNs) has recently brought about significant advancements in the research of this problem. However, most existing methods…
Deploying 3D single-photon Lidar imaging in real world applications faces multiple challenges including imaging in high noise environments. Several algorithms have been proposed to address these issues based on statistical or learning-based…
The realization of a high-efficiency microwave single photon detector is a long-standing problem in the field of microwave quantum optics. Here we propose a quantum non-demolition, high-efficiency photon detector that can readily be…
Simulation of detecting photoelectrons using multi-level multi-electron (MLME) finite-difference time-domain (FDTD) method with an application to near-field subwavelength imaging based on semiconductor nanophotodetector (NPD) array is…
3D Lidar imaging can be a challenging modality when using multiple wavelengths, or when imaging in high noise environments (e.g., imaging through obscurants). This paper presents a hierarchical Bayesian algorithm for the robust…
Event stereo matching is an emerging technique to estimate depth from neuromorphic cameras; however, events are unlikely to trigger in the absence of motion or the presence of large, untextured regions, making the correspondence problem…
An efficient linear self-attention fusion model is proposed in this paper for the task of hyperspectral image (HSI) and LiDAR data joint classification. The proposed method is comprised of a feature extraction module, an attention module,…
Spectral vision task plays a pivotal role in extracting discriminative spectral-spatial features from high-dimensional data, enabling fine-grained identification beyond human vision. Traditional methods usually involve first collecting rich…
Light detection and ranging (LiDAR) is widely used in autonomous systems and industrial metrology; however, the simultaneous acquisition of three-dimensional (3D) structure and broadband spectral information remains challenging, as…
We present an experimental realization of a 16 element, temporal-array, photon-number-resolving (PNR) detector, which is a multiplexed single-photon detector that splits an input signal over multiple time-bins, and the time-bins are…
This study explores the use of photometric techniques (shape-from-shading and uncalibrated photometric stereo) for upsampling the low-resolution depth map from an RGB-D sensor to the higher resolution of the companion RGB image. A…
In this paper, we propose a novel training strategy called SupFusion, which provides an auxiliary feature level supervision for effective LiDAR-Camera fusion and significantly boosts detection performance. Our strategy involves a data…
Traditional CMOS sensors suffer from restricted dynamic range and sub optimal performance under extreme lighting conditions. They are affected by electronic noise in low light conditions and pixel saturation while capturing high…
Conventional LiDAR uses time-of-flight data from laser pulses scanned across a scene to provide accurate multi-meter-scale three-dimensional models at cm precision, limited by the tens-of-picoseconds precision of time-tagging electronics.…
We propose a new approach called LiDAR-Flow to robustly estimate a dense scene flow by fusing a sparse LiDAR with stereo images. We take the advantage of the high accuracy of LiDAR to resolve the lack of information in some regions of…
3D scene reconstruction from a single measurement is challenging, especially in the presence of occluded regions and specular materials, such as mirrors. We address these challenges by leveraging single-photon lidars. These lidars estimate…
More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…