English
Related papers

Related papers: Sig2text, a Vision-language model for Non-cooperat…

200 papers

We propose a weakly supervised approach for creating maps using free-form textual descriptions. We refer to this work of creating textual maps as zero-shot mapping. Prior works have approached mapping tasks by developing models that predict…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Aayush Dhakal , Adeel Ahmad , Subash Khanal , Srikumar Sastry , Hannah Kerner , Nathan Jacobs

Reliable perception is essential for autonomous driving systems to operate safely under diverse real-world traffic conditions. However, camera- and LiDAR-based perception systems suffer from performance degradation under adverse weather and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Sun , Yeqiang Qian , Zhe Wang , Tianhui Li , Chunxiang Wang , Ming Yang

The recognition or understanding of the scenes observed with a SAR system requires a broader range of cues, beyond the spatial context. These encompass but are not limited to: imaging geometry, imaging mode, properties of the Fourier…

Image and Video Processing · Electrical Eng. & Systems 2023-01-11 Mihai Datcu , Zhongling Huang , Andrei Anghel , Juanping Zhao , Remus Cacoveanu

We consider a joint radar estimation and communication system using orthogonal time frequency space (OTFS) modulation. The scenario is motivated by vehicular applications where a vehicle equipped with a mono-static radar wishes to…

Information Theory · Computer Science 2019-10-07 Lorenzo Gaudio , Mari Kobayashi , Giuseppe Caire , Giulio Colavolpe

Object detection in radar imagery with neural networks shows great potential for improving autonomous driving. However, obtaining annotated datasets from real radar images, crucial for training these networks, is challenging, especially in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Oded Bialer , Yuval Haitman

Integrated sensing and communication (ISAC) is widely recognized as a fundamental enabler for future wireless communications. In this paper, we present a joint communication and radar beamforming framework for maximizing a sum spectral…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Jinseok Choi , Jeonghun Park , Namyoon Lee , Ahmed Alkhateeb

Silent speech recognition (SSR) is a technology that recognizes speech content from non-acoustic speech-related biosignals. This paper utilizes an attention-enhanced temporal convolutional network architecture for contactless IR-UWB…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-01 Sunghwa Lee , Jaewon Yu

The performance of perception systems developed for autonomous driving vehicles has seen significant improvements over the last few years. This improvement was associated with the increasing use of LiDAR sensors and point cloud data to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yahia Dalbah , Jean Lahoud , Hisham Cholakkal

Radar detection and communication can be operated simultaneously in joint radar-communication (JRC) system. In this paper, we propose a bistatic JRC system which is applicable in multi-path environments. Basing on a novel joint waveform, a…

Signal Processing · Electrical Eng. & Systems 2020-07-01 Yuan Quan , Longfei Shi , Jialei Liu , Jiazhi Ma

The problem of data-driven joint design of transmitted waveform and detector in a radar system is addressed in this paper. We propose two novel learning-based approaches to waveform and detector design based on end-to-end training of the…

Signal Processing · Electrical Eng. & Systems 2021-02-22 Wei Jiang , Alexander M. Haimovich , Osvaldo Simeone

Videos provide a rich source of information, but it is generally hard to extract dynamical parameters of interest. Inferring those parameters from a video stream would be beneficial for physical reasoning. Robots performing tasks in dynamic…

Text detection is frequently used in vision-based mobile robots when they need to interpret texts in their surroundings to perform a given task. For instance, delivery robots in multilingual cities need to be capable of doing multilingual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Hsin-Ju Lin , Tsu-Chun Chung , Ching-Chun Hsiao , Pin-Yu Chen , Wei-Chen Chiu , Ching-Chun Huang

Semantic segmentation and change detection are two fundamental challenges in remote sensing, requiring models to capture either spatial semantics or temporal differences from satellite imagery. Existing deep learning models often struggle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Ali Shibli , Andrea Nascetti , Yifang Ban

One of the primary challenges in Synthetic Aperture Radar (SAR) object detection lies in the pervasive influence of coherent noise. As a common practice, most existing methods, whether handcrafted approaches or deep learning-based methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Kang Ni , Minrui Zou , Yuxuan Li , Xiang Li , Kehua Guo , Ming-Ming Cheng , Yimian Dai

In this work, we investigate the potential of a large language model (LLM) to directly comprehend visual signals without the necessity of fine-tuning on multi-modal datasets. The foundational concept of our method views an image as a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Lei Zhu , Fangyun Wei , Yanye Lu

Radiological services are experiencing unprecedented demand, leading to increased interest in automating radiology report generation. Existing Vision-Language Models (VLMs) suffer from hallucinations, lack interpretability, and require…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Ahmed Abdulaal , Hugo Fry , Nina Montaña-Brown , Ayodeji Ijishakin , Jack Gao , Stephanie Hyland , Daniel C. Alexander , Daniel C. Castro

Evaluating L2 speech intelligibility is crucial for effective computer-assisted language learning (CALL). Conventional ASR-based methods often focus on native-likeness, which may fail to capture the actual intelligibility perceived by human…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Haopeng Geng , Daisuke Saito , Nobuaki Minematsu

Dual-function radar-communication (DFRC), which can simultaneously perform both radar and communication functionalities using the same hardware platform, spectral resource and transmit waveform, is a promising technique for realizing…

Signal Processing · Electrical Eng. & Systems 2022-05-31 R. Liu , M. Li , Q. Liu , A. L. Swindlehurst

Integrating sensing and communication (ISAC) has emerged as a cornerstone technology for predictive beamforming in 6G-enabled vehicle-to-everything (V2X) networks. However, existing ISAC paradigms rely solely on radio frequency (RF) signal,…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Chen Shang , Dinh Thai Hoang , Jiadong Yu

Sign language to spoken language audio translation is important to connect the hearing- and speech-challenged humans with others. We consider sign language videos with isolated sign sequences rather than continuous grammatical signing. Such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Harsh Kavediya , Vighnesh Nayak , Bheeshm Sharma , Balamurugan Palaniappan