English
Related papers

Related papers: A cross-modal pre-training framework with video da…

200 papers

Spoofed audio, i.e. audio that is manipulated or AI-generated deepfake audio, is difficult to detect when only using acoustic features. Some recent innovative work involving AI-spoofed audio detection models augmented with phonetic and…

Sound · Computer Science 2024-10-22 Zahra Khanjani , Christine Mallinson , James Foulds , Vandana P Janeja

Humans possess a remarkable ability to integrate auditory and visual information, enabling a deeper understanding of the surrounding environment. This early fusion of audio and visual cues, demonstrated through cognitive psychology and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shentong Mo , Pedro Morgado

Fine-tuning speech representation models can enhance performance on specific tasks but often compromises their cross-task generalization ability. This degradation is often caused by excessive changes in the representations, making it…

Computation and Language · Computer Science 2026-04-28 Tzu-Quan Lin , Wei-Ping Huang , Hao Tang , Hung-yi Lee

Multimodal large language models (MLLMs) have shown strong capability in semantic understanding and visual reasoning, yet their use on continuous video streams in bandwidth-constrained edge-cloud systems incurs prohibitive computation and…

Multimedia · Computer Science 2026-04-08 Qi Guo , Zheming Yang , Yunqing Hu , Chang Zhao , Wen Ji

Internet of Things (IoT) sensors are ubiquitous technologies deployed across smart cities, industrial sites, and healthcare systems. They continuously generate time series data that enable advanced analytics and automation in industries.…

Machine Learning · Computer Science 2025-09-24 Muhammad Sakib Khan Inan , Kewen Liao

Dynamic vision sensors (DVS) are bio-inspired devices that capture visual information in the form of asynchronous events, which encode changes in pixel intensity with high temporal resolution and low latency. These events provide rich…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jingkai Sun , Qiang Zhang , Jiaxu Wang , Jiahang Cao , Renjing Xu

While Wi-Fi sensing offers a compelling, privacy-preserving alternative to cameras, its practical utility has been fundamentally undermined by a lack of robustness across domains. Models trained in one setup fail to generalize to new…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Cheng Jiang , Yihe Yan , Yanxiang Wang , Chun Tung Chou , Wen Hu

We investigated the adaptation and performance of Masked Autoencoders (MAEs) with Vision Transformer (ViT) architectures for self-supervised representation learning on one-dimensional (1D) ultrasound signals. Although MAEs have demonstrated…

Machine Learning · Computer Science 2025-08-29 Immanuel Roßteutscher , Klaus S. Drese , Thorsten Uphues

Domain adaptation (DA) is the topical problem of adapting models from labelled source datasets so that they perform well on target datasets where only unlabelled or partially labelled data is available. Many methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Da Li , Timothy Hospedales

The human voice is a promising non-invasive digital biomarker, yet deep learning for voice-based health analysis is hindered by data scarcity and domain mismatch, where models pre-trained on general audio fail to capture the subtle…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-02 Weixin Liu , Bowen Qu , Matthew Pontell , Maria Powell , Bradley Malin , Zhijun Yin

The landscape of deep learning research is moving towards innovative strategies to harness the true potential of data. Traditionally, emphasis has been on scaling model architectures, resulting in large and complex neural networks, which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Sofia Casarin , Cynthia I. Ugwu , Sergio Escalera , Oswald Lanz

In modern multimedia systems, efficient video processing is critical, especially in resource-constrained environments such as IoT-based camera networks, autonomous platforms, and wireless sensor multimedia systems. A key bottleneck in video…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Kakia Panagidi , Stathes Hadjieftymiadis

Wireless sensor networks (WSN) acts as the backbone of Internet of Things (IoT) technology. In WSN, field sensing and fusion are the most commonly seen problems, which involve collecting and processing of a huge volume of spatial samples in…

Signal Processing · Electrical Eng. & Systems 2019-06-19 Hui Wu , Zhaoyang Zhang , Chunxu Jiao , Chunguang Li , Tony Q. S. Quek

Wireless sensor networks are often designed to perform two tasks: sensing a physical field and transmitting the data to end-users. A crucial aspect of the design of a WSN is the minimization of the overall energy consumption. Previous…

Information Theory · Computer Science 2014-01-07 Zichong Chen , Juri Ranieri , Runwei Zhang , Martin Vetterli

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Accurate automated segmentation of tibial plateau fractures (TPF) from computed tomography (CT) requires large amounts of annotated data to train deep learning models, but obtaining such annotations presents unique challenges. The process…

Image and Video Processing · Electrical Eng. & Systems 2025-04-10 Peiyan Yue , Die Cai , Chu Guo , Mengxing Liu , Jun Xia , Yi Wang

Accurate and interpretable bearing fault classification is critical for ensuring the reliability of rotating machinery, particularly under variable operating conditions where domain shifts can significantly degrade model performance. This…

Machine Learning · Computer Science 2025-08-12 Tasfiq E. Alam , Md Manjurul Ahsan , Shivakumar Raman

The scarcity of labelled data is specifically an urgent challenge in the field of quantum machine learning (QML). Two transfer fusion frameworks are proposed in this paper to predict the labels of a target domain data by aligning its…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xi He , Feiyu Du , Xiaohan Yu , Yang Zhao , Tao Lei

Smartphones, wearables, and Internet of Things (IoT) devices produce a wealth of data that cannot be accumulated in a centralized repository for learning supervised models due to privacy, bandwidth limitations, and the prohibitive cost of…

Machine Learning · Computer Science 2020-07-28 Aaqib Saeed , Flora D. Salim , Tanir Ozcelebi , Johan Lukkien

Nowadays, long distance optical fibre transmission systems use polarization diversity multiplexed signals to enhance transmission performance. Distributed acoustic sensors (DAS) use the same propagation medium ie. single mode optical fibre,…

Signal Processing · Electrical Eng. & Systems 2020-07-03 Sterenn Guerrier , Christian Dorize , Elie Awwad , Jérémie Renaudier