English
Related papers

Related papers: Investigating the Effect of Spatial Context on Mul…

200 papers

Spatial information is a critical clue for multi-channel multi-speaker target speech recognition. Most state-of-the-art multi-channel Automatic Speech Recognition (ASR) systems extract spatial features only during the speech separation…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Yiwen Shao , Yong Xu , Sanjeev Khudanpur , Dong Yu

Underwater acoustic target detection in remote marine sensing operations is challenging due to complex sound wave propagation. Despite the availability of reliable sonar systems, target recognition remains a difficult problem. Various…

Sound · Computer Science 2023-07-27 Jarin Ritu , Ethan Barnes , Riley Martell , Alexandra Van Dine , Joshua Peeples

Obtaining pixel-level annotations over large spatial extents remains a major bottleneck for deploying machine learning in ecological applications. Here we present a multi-scale weakly supervised semantic segmentation (WSSS) framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Matteo Contini , Victor Illien , Sylvain Poulain , Serge Bernard , Julien Barde , Sylvain Bonhommeau , Alexis Joly

Spatial reasoning in large-scale 3D environments such as warehouses remains a significant challenge for vision-language systems due to scene clutter, occlusions, and the need for precise spatial understanding. Existing models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Tanner Muturi , Blessing Agyei Kyem , Joshua Kofi Asamoah , Neema Jakisa Owor , Richard Dyzinela , Andrews Danyo , Yaw Adu-Gyamfi , Armstrong Aboah

In the field of SLAM (Simultaneous Localization And Mapping) for robot navigation, mapping the environment is an important task. In this regard the Lidar sensor can produce near accurate 3D map of the environment in the format of point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Aritra Mukherjee , Sourya Dipta Das , Jasorsi Ghosh , Ananda S. Chowdhury , Sanjoy Kumar Saha

The use of spatial information with multiple microphones can improve far-field automatic speech recognition (ASR) accuracy. However, conventional microphone array techniques degrade speech enhancement performance when there is an array…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-23 Kenichi Kumatani , Minhua Wu , Shiva Sundaram , Nikko Strom , Bjorn Hoffmeister

Urban-scene Image segmentation is an important and trending topic in computer vision with wide use cases like autonomous driving [1]. Starting with the breakthrough work of Long et al. [2] that introduces Fully Convolutional Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Shorya Sharma

Multi-channel speech enhancement utilizes spatial information from multiple microphones to extract the target speech. However, most existing methods do not explicitly model spatial cues, instead relying on implicit learning from…

Sound · Computer Science 2023-09-20 Jiahui Pan , Shulin He , Hui Zhang , Xueliang Zhang

Semantic segmentation is a fundamental task in computer vision that involves dense pixel-wise classification for scene understanding. Despite significant progress, achieving high accuracy while maintaining real-time performance remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Abhinav Sagar

Existing research suggests that automatic speech recognition (ASR) models can benefit from additional contexts (e.g., contact lists, user specified vocabulary). Rare words and named entities can be better recognized with contexts. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-16 Ruizhe Huang , Mahsa Yarmohammadi , Sanjeev Khudanpur , Daniel Povey

Automatic speech recognition (ASR) models make fewer errors when more surrounding speech information is presented as context. Unfortunately, acquiring a larger future context leads to higher latency. There exists an inevitable trade-off…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Kwangyoun Kim , Felix Wu , Prashant Sridhar , Kyu J. Han , Shinji Watanabe

The ambiguity at the boundaries of different semantic classes in point cloud semantic segmentation often leads to incorrect decisions in intelligent perception systems, such as autonomous driving. Hence, accurate delineation of the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Jiale Chen , Fei Xia , Jianliang Mao , Haoping Wang , Chuanlin Zhang

Multimodal large language models~(MLLMs) have demonstrated promising spatial understanding capabilities, such as referencing and grounding object descriptions. Despite their successes, MLLMs still fall short in fine-grained spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Han Qiu , Peng Gao , Lewei Lu , Xiaoqin Zhang , Ling Shao , Shijian Lu

Point cloud semantic segmentation plays an essential role in autonomous driving, providing vital information about drivable surfaces and nearby objects that can aid higher level tasks such as path planning and collision avoidance. While…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Ozan Unal , Luc Van Gool , Dengxin Dai

This paper investigates the impact of LiDAR configuration shifts on the performance of 3D LiDAR point cloud semantic segmentation models, a topic not extensively studied before. We explore the effect of using different LiDAR channels when…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Jinhee Yu , Jingdao Chen , Lalitha Dabbiru , Christopher T. Goodin

Existing self-supervised learning (SSL) methods primarily learn object-invariant representations but often neglect the spatial structure and relationships among object parts. To address this limitation, we introduce Spatial Prediction (SP),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yang Shen , Yusen Cai , Weronika Hryniewska-Guzik , Qing Lin , Mengmi Zhang

Contextual Partitioning introduces an innovative approach to enhancing the architectural design of large-scale computational models through the dynamic segmentation of parameters into context-aware regions. This methodology emphasizes the…

Computation and Language · Computer Science 2025-08-11 Offa Kingsleigh , Alfred Abercrombie , David Woolstencroft , Beorhtric Meadowcroft , Marcus Irvin

Automatic speech recognition (ASR) on multi-talker recordings is challenging. Current methods using 3D spatial data from multi-channel audio and visual cues focus mainly on direct waves from the target speaker, overlooking reflection wave…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yiwen Shao , Shi-Xiong Zhang , Dong Yu

The growing popularity of robotic minimally invasive surgeries has made deep learning-based surgical training a key area of research. A thorough understanding of the surgical scene components is crucial, which semantic segmentation models…

Image and Video Processing · Electrical Eng. & Systems 2025-10-31 Muraam Abdel-Ghani , Mahmoud Ali , Mohamed Ali , Fatmaelzahraa Ahmed , Muhammad Arsalan , Abdulaziz Al-Ali , Shidin Balakrishnan

In recent years, Multimodal Large Language Models (MLLMs) have made significant progress in visual question answering tasks. However, directly applying existing fine-tuning methods to remote sensing (RS) images often leads to issues such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Qigan Sun , Chaoning Zhang , Jianwei Zhang , Xudong Wang , Jiehui Xie , Pengcheng Zheng , Haoyu Wang , Sungyoung Lee , Chi-lok Andy Tai , Yang Yang , Heng Tao Shen