English
Related papers

Related papers: BlabberSeg: Real-Time Embedded Open-Vocabulary Aer…

200 papers

Open-vocabulary semantic segmentation aims to segment images into distinct semantic regions for both seen and unseen categories at the pixel level. Current methods utilize text embeddings from pre-trained vision-language models like CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Ziyu Zhao , Xiaoguang Li , Linjia Shi , Nasrin Imanpour , Song Wang

Open-vocabulary image segmentation is attracting increasing attention due to its critical applications in the real world. Traditional closed-vocabulary segmentation methods are not able to characterize novel objects, whereas several recent…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Xi Chen , Shuang Li , Ser-Nam Lim , Antonio Torralba , Hengshuang Zhao

Audio-visual speech enhancement (AVSE) is a task that uses visual auxiliary information to extract a target speaker's speech from mixed audio. In real-world scenarios, there often exist complex acoustic environments, accompanied by various…

Sound · Computer Science 2025-11-03 Jiarong Du , Zhan Jin , Peijun Yang , Juan Liu , Zhuo Li , Xin Liu , Ming Li

The global rise in the number of people with physical disabilities, in part due to improvements in post-trauma survivorship and longevity, has amplified the demand for advanced assistive technologies to improve mobility and independence.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yifan Xu , Vineet Kamat , Carol Menassa

In this paper, we address the challenge of performing open-vocabulary video instance segmentation (OV-VIS) in real-time. We analyze the computational bottlenecks of state-of-the-art foundation models that performs OV-VIS, and propose a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Bin Yan , Martin Sundermeyer , David Joseph Tan , Huchuan Lu , Federico Tombari

In this paper, we propose a novel memory-enabled non-uniform sampling-based bumblebee foraging algorithm (MEB) designed for optimal channel selection in a distributed Vehicular Dynamic Spectrum Access (VDSA) framework employed in a platoon…

Networking and Internet Architecture · Computer Science 2023-02-02 Kuldeep S. Gill , Pawel Kryszkiewicz , Pawel Sroka , Adrian Kliks , Alexander M. Wyglinski

Medical image segmentation plays a critical role in clinical decision-making, treatment planning, and disease monitoring. However, accurate segmentation of medical images is challenging due to several factors, such as the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zihan Li , Yuan Zheng , Xiangde Luo , Dandan Shan , Qingqi Hong

We propose OpenVoxel, a training-free algorithm for grouping and captioning sparse voxels for the open-vocabulary 3D scene understanding tasks. Given the sparse voxel rasterization (SVR) model obtained from multi-view images of a 3D scene,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Sheng-Yu Huang , Jaesung Choe , Yu-Chiang Frank Wang , Cheng Sun

Real-time semantic segmentation is of significant importance for mobile and robotics related applications. We propose a computationally efficient segmentation network which we term as ShuffleSeg. The proposed architecture is based on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Mostafa Gamal , Mennatullah Siam , Moemen Abdel-Razek

Safe landing is essential in robotics applications, from industrial settings to space exploration. As artificial intelligence advances, we have developed PEACE (Prompt Engineering Automation for CLIPSeg Enhancement), a system that…

Robotics · Computer Science 2025-07-01 Haechan Mark Bong , Rongge Zhang , Antoine Robillard , Giovanni Beltrame

Safe UAV emergency landing requires more than just identifying flat terrain; it demands understanding complex semantic risks (e.g., crowds, temporary structures) invisible to traditional geometric sensors. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chunliang Hua , Zeyuan Yang , Lei Zhang , Jiayang Sun , Fengwen Chen , Chunlan Zeng , Xiao Hu

Free space ground segmentation is essential to navigate autonomous robots, recognize drivable zones, and traverse efficiently. Fine-grained features remain challenging for existing segmentation models, particularly for robots in indoor,…

Robotics · Computer Science 2026-03-09 Narendhiran Vijayakumar , Sridevi. M

Visual bird's eye view (BEV) semantic segmentation helps autonomous vehicles understand the surrounding environment only from images, including static elements (e.g., roads) and dynamic elements (e.g., vehicles, pedestrians). However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Junyu Zhu , Lina Liu , Yu Tang , Feng Wen , Wanlong Li , Yong Liu

Bird's-eye-view (BEV) is a powerful and widely adopted representation for road scenes that captures surrounding objects and their spatial locations, along with overall context in the scene. In this work, we focus on bird's eye semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Mong H. Ng , Kaahan Radia , Jianfei Chen , Dequan Wang , Ionel Gog , Joseph E. Gonzalez

Autonomous aerial navigation in dense natural environments remains challenging due to limited visibility, thin and irregular obstacles, GNSS-denied operation, and frequent perceptual degradation. This work presents an improved deep…

Robotics · Computer Science 2025-12-22 Guglielmo Del Col , Väinö Karjalainen , Teemu Hakala , Yibo Zhang , Eija Honkavaara

Existing aerial Vision-Language Navigation (VLN) methods predominantly adopt a detection-and-planning pipeline, which converts open-vocabulary detections into discrete textual scene graphs. These approaches are plagued by inadequate spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Haoyu Tong , Xiangyu Dong , Xiaoguang Ma , Haoran Zhao , Yaoming Zhou , Chenghao Lin

We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed for real-world vision and language understanding applications. Our approach is structured around three key dimensions: We strive to ensure our data is diverse,…

Artificial Intelligence · Computer Science 2024-03-12 Haoyu Lu , Wen Liu , Bo Zhang , Bingxuan Wang , Kai Dong , Bo Liu , Jingxiang Sun , Tongzheng Ren , Zhuoshu Li , Hao Yang , Yaofeng Sun , Chengqi Deng , Hanwei Xu , Zhenda Xie , Chong Ruan

Semantic segmentation plays a crucial role in enabling machines to understand and interpret visual scenes at a pixel level. While traditional segmentation methods have achieved remarkable success, their generalization to diverse scenes and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Philip Hughes , Larry Burns , Luke Adams

Semantic scene segmentation from a bird's-eye-view (BEV) perspective plays a crucial role in facilitating planning and decision-making for mobile robots. Although recent vision-only methods have demonstrated notable advancements in…

Advancements in deep learning and voice-activated technologies have driven the development of human-vehicle interaction. Distributed microphone arrays are widely used in in-car scenarios because they can accurately capture the voices of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-16 Ziqian Wang , Jiayao Sun , Zihan Zhang , Xingchen Li , Jie Liu , Lei Xie