English
Related papers

Related papers: Calib-Anything: Zero-training LiDAR-Camera Extrins…

200 papers

Today's autonomous vehicles rely on a multitude of sensors to perceive their environment. To improve the perception or create redundancy, the sensor's alignment relative to each other must be known. With Multi-LiCa, we present a novel…

Robotics · Computer Science 2025-04-23 Dominik Kulmer , Ilir Tahiraj , Andrii Chumak , Markus Lienkamp

Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is challenged by images…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Wei-Ting Chen , Yu-Jiet Vong , Sy-Yen Kuo , Sizhuo Ma , Jian Wang

Estimating camera intrinsic parameters without prior scene knowledge is a fundamental challenge in computer vision. This capability is particularly important for applications such as autonomous driving and vehicle platooning, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Gregory Schroeder , Mohamed Sabry , Cristina Olaverri-Monreal

The Segment Anything Model (SAM) is a promptable segmentation model recently introduced by Meta AI that has demonstrated its prowess across various fields beyond just image segmentation. SAM can accurately segment images across diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junzhang Chen , Xiangzhi Bai

This paper presents a novel semantic-based online extrinsic calibration approach, SOIC (so, I see), for Light Detection and Ranging (LiDAR) and camera sensors. Previous online calibration methods usually need prior knowledge of rough…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Weimin Wang , Shohei Nobuhara , Ryosuke Nakamura , Ken Sakurada

The emergence of large models, also known as foundation models, has brought significant advancements to AI research. One such model is Segment Anything (SAM), which is designed for image segmentation tasks. However, as with other foundation…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Tianrun Chen , Lanyun Zhu , Chaotao Ding , Runlong Cao , Yan Wang , Zejian Li , Lingyun Sun , Papa Mao , Ying Zang

In this paper, we propose a novel online self-calibration approach for Light Detection and Ranging (LiDAR) and camera sensors. Compared to the previous CNN-based methods that concatenate the feature maps of the RGB image and decalibrated…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Xudong Lv , Boya Wang , Dong Ye , Shuo Wang

We propose CAL (Complete Anything in Lidar) for Lidar-based shape-completion in-the-wild. This is closely related to Lidar-based semantic/panoptic scene completion. However, contemporary methods can only complete and recognize objects from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Ayca Takmaz , Cristiano Saltori , Neehar Peri , Tim Meinhardt , Riccardo de Lutio , Laura Leal-Taixé , Aljoša Ošep

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

As neuromorphic technology is maturing, its application to robotics and autonomous vehicle systems has become an area of active research. In particular, event cameras have emerged as a compelling alternative to frame-based cameras in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Kevin Ta , David Bruggemann , Tim Brödermann , Christos Sakaridis , Luc Van Gool

We propose a generic event camera calibration framework using image reconstruction. Instead of relying on blinking LED patterns or external screens, we show that neural-network-based image reconstruction is well suited for the task of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Manasi Muglikar , Mathias Gehrig , Daniel Gehrig , Davide Scaramuzza

Motivated by the increasing application of low-resolution LiDAR recently, we target the problem of low-resolution LiDAR-camera calibration in this work. The main challenges are two-fold: sparsity and noise in point clouds. To address the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Zhikang Zhang , Zifan Yu , Suya You , Raghuveer Rao , Sanjeev Agarwal , Fengbo Ren

Camera-to-robot (also known as eye-to-hand) calibration is a critical component of vision-based robot manipulation. Traditional marker-based methods often require human intervention for system setup. Furthermore, existing autonomous…

Robotics · Computer Science 2025-03-20 Podshara Chanrungmaneekul , Yiting Chen , Joshua T. Grace , Aaron M. Dollar , Kaiyu Hang

The Segment Anything Model (SAM) is a foundation model for general image segmentation. Although it exhibits impressive performance predominantly on natural images, understanding its robustness against various image perturbations and domains…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yuqing Wang , Yun Zhao , Linda Petzold

Multimodal image fusion and semantic segmentation are critical for autonomous driving. Despite advancements, current models often struggle with segmenting densely packed elements due to a lack of comprehensive fusion features for guidance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Daixun Li , Weiying Xie , Mingxiang Cao , Yunke Wang , Yusi Zhang , Leyuan Fang , Yunsong Li , Chang Xu

Background: The segment-anything model (SAM), introduced in April 2023, shows promise as a benchmark model and a universal solution to segment various natural images. It comes without previously-required re-training or fine-tuning specific…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Sheng He , Rina Bao , Jingpeng Li , Jeffrey Stout , Atle Bjornerud , P. Ellen Grant , Yangming Ou

Multiple lidars are prevalently used on mobile vehicles for rendering a broad view to enhance the performance of localization and perception systems. However, precise calibration of multiple lidars is challenging since the feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Jianhao Jiao , Qinghai Liao , Yilong Zhu , Tianyu Liu , Yang Yu , Rui Fan , Lujia Wang , Ming Liu

Targetless IMU-LiDAR extrinsic calibration methods are gaining significant attention as the importance of the IMU-LiDAR fusion system increases. Notably, existing calibration methods derive calibration parameters under the assumption that…

Robotics · Computer Science 2024-05-27 TaeYoung Kim , Gyuhyeon Pak , Euntai Kim

Recent progress in the automated driving system (ADS) and advanced driver assistant system (ADAS) has shown that the combined use of 3D light detection and ranging (LiDAR) and the camera is essential for an intelligent vehicle to perceive…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Yecheng Lyu , Lin Bai , Mahdi Elhousni , Xinming Huang