English
Related papers

Related papers: A cross-modal pre-training framework with video da…

200 papers

Remote sensing image interpretation plays a critical role in environmental monitoring, urban planning, and disaster assessment. However, acquiring high-quality labeled data is often costly and time-consuming. To address this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tong Wang , Guanzhou Chen , Xiaodong Zhang , Chenxi Liu , Jiaqi Wang , Xiaoliang Tan , Wenchao Guo , Qingyuan Yang , Kaiqi Zhang

Advances in surgical video analysis are transforming operating rooms into intelligent, data-driven environments. Computer-assisted systems support full surgical workflow, from preoperative planning to intraoperative guidance and…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Sahar Nasirihaghighi

Masked video modeling~(MVM) has emerged as a highly effective pre-training strategy for visual foundation models, whereby the model reconstructs masked spatiotemporal tokens using information from visible tokens. However, a key challenge in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Ayush K. Rai , Kyle Min , Tarun Krishna , Feiyan Hu , Alan F. Smeaton , Noel E. O'Connor

Multimodal pre-training for audio-and-text has recently been proved to be effective and has significantly improved the performance of many downstream speech understanding tasks. However, these state-of-the-art pre-training audio-text models…

Sound · Computer Science 2022-04-12 Yu Kang , Tianqiao Liu , Hang Li , Yang Hao , Wenbiao Ding

We introduce DAS (Domain Adaptation with Synthetic data), a novel domain adaptation framework for pre-trained ASR model, designed to efficiently adapt to various language-defined domains without requiring any real data. In particular, DAS…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Minh Tran , Yutong Pang , Debjyoti Paul , Laxmi Pandey , Kevin Jiang , Jinxi Guo , Ke Li , Shun Zhang , Xuedong Zhang , Xin Lei

The goal of video anomaly detection is tantamount to performing spatio-temporal localization of abnormal events in the video. The multiscale temporal dependencies, visual-semantic heterogeneity, and the scarcity of labeled data exhibited by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dezhi An , Wenqiang Liu , Kefan Wang , Zening Chen , Jun Lu , Shengcai Zhang

Distributed acoustic sensing (DAS) is a novel enabling technology that can turn existing fibre optic networks to distributed acoustic sensors. However, it faces the challenges of transmitting, storing, and processing massive streams of data…

Signal Processing · Electrical Eng. & Systems 2023-01-02 Xingliang Shen , Huan Wu , Kun Zhu , Yujia Li , Hua Zheng , Jialong Li , Liyang Shao , Perry Ping Shum , Chao Lu

Distributed Acoustic Sensing (DAS) technology is advancing seismic monitoring by providing dense observations near earthquake sources. However, the resulting data volumes often limit real-time processing capability, with most seismological…

Distributed acoustic sensor (DAS) technology leverages optical fiber cables to detect acoustic signals, providing cost-effective and dense monitoring capabilities. It offers several advantages including resistance to extreme conditions,…

Optical fibers have long been employed as sensors in a wide range of commercial systems. Distributed Acoustic Sensing (DAS) extends this concept by enabling the detection and localization of acoustic sources along the fiber, using…

Signal Processing · Electrical Eng. & Systems 2025-09-25 Knut H. Grythe , Jan Erik Håkegård

It is often desirable to generalize medical imaging AI models trained with dense annotations to data acquired from different ultrasound scanners or clinical sites; however, retraining these models with new annotations is often difficult and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yuyue Zhou , Shrimanti Ghosh , Michael , Xie , Justin JY Kim , Jessica Knight , Steel McDonald , Vincent Man , Jacob L. Jaremko , Abhilash Hareendranathan

We introduce a modular software framework designed to integrate distributed acoustic sensing (DAS) data into operational earthquake monitoring systems. Building on the infrastructure of the Advanced National Seismic System (ANSS) and the…

IoT devices generating enormous data and state-of-the-art machine learning techniques together will revolutionize cyber-physical systems. In many diverse fields, from autonomous driving to augmented reality, distributed IoT devices compute…

Machine Learning · Computer Science 2023-05-02 Yashas Malur Saidutta , Afshin Abdi , Faramarz Fekri

Change detection visual question answering (CDVQA) requires answering text queries by reasoning about semantic changes in bi-temporal remote sensing images. A straightforward approach is to boost CDVQA performance with generic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Fuyu Dong , Ke Li , Di Wang , Nan Luo , Yiming Zhang , Kaiyu Li , Jianfei Yang , Quan Wang

In extreme scenarios such as nighttime or low-visibility environments, achieving reliable perception is critical for applications like autonomous driving, robotics, and surveillance. Multi-modality image fusion, particularly integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yuchen Guo , Ruoxiang Xu , Rongcheng Li , Weifeng Su

Large-scale multimodal pre-trained models like CLIP rely heavily on high-quality training data, yet raw web-crawled datasets are often noisy, misaligned, and redundant, leading to inefficient training and suboptimal generalization. Existing…

Machine Learning · Computer Science 2026-02-06 Guanjie Cheng , Boyi Li , Lingyu Sun , Mengying Zhu , Yangyang Wu , Xinkui Zhao , Shuiguang Deng

Intrusion detection in IoT and industrial networks requires models that can detect rare attacks at low false-positive rates while remaining reliable under evolving traffic and limited labels. Existing IDS solutions often report strong…

Cryptography and Security · Computer Science 2026-03-03 Srikumar Nayak

This paper demonstrates the potential of vibration-based Foundation Models (FMs), pre-trained with unlabeled sensing data, to improve the robustness of run-time inference in (a class of) IoT applications. A case study is presented featuring…

Face anti-spoofing (FAS) or presentation attack detection is an essential component of face recognition systems deployed in security-critical applications. Existing FAS methods have poor generalizability to unseen spoof types, camera…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Koushik Srivatsan , Muzammal Naseer , Karthik Nandakumar

Federated learning is proposed as an alternative to centralized machine learning since its client-server structure provides better privacy protection and scalability in real-world applications. In many applications, such as smart homes with…

Machine Learning · Computer Science 2022-02-21 Yuchen Zhao , Payam Barnaghi , Hamed Haddadi