English
Related papers

Related papers: Self-supervised Contrastive Video-Speech Represent…

200 papers

Recently, the robotic ultrasound system has become an emerging topic owing to the widespread use of medical ultrasound. However, it is still a challenging task to model and to transfer the ultrasound skill from an ultrasound physician. In…

Artificial Intelligence · Computer Science 2023-07-27 Xutian Deng , Ziwei Lei , Yi Wang , Miao Li

Self-supervised pre-training paradigm has gained increasing prominence for learning transferable representations in medical imaging, yet existing methods for ultrasound (US) images operate at the image or frame level, overlooking the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chunzheng Zhu , Yijun Wang , Jianxin Lin , Feng Wang , Hongwei Wang , Lei Zhao , Shengli Li , Kenli Li

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Recent advances suggest the advantage of multi-modal training in comparison with single-modal methods. In contrast to this view, in our work we find that similar gain can be obtained from training with different formats of a single…

Sound · Computer Science 2021-03-25 Luyu Wang , Aaron van den Oord

Multimodal deep learning utilizing imaging and diagnostic reports has made impressive progress in the field of medical imaging diagnostics, demonstrating a particularly strong capability for auxiliary diagnosis in cases where sufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Hao Yang , Hong-Yu Zhou , Cheng Li , Weijian Huang , Jiarun Liu , Yong Liang , Guangming Shi , Hairong Zheng , Qiegen Liu , Shanshan Wang

The self-supervised ultrasound (US) video model pretraining can use a small amount of labeled data to achieve one of the most promising results on US diagnosis. However, it does not take full advantage of multi-level knowledge for learning…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Chunhui Zhang , Yixiong Chen , Li Liu , Qiong Liu , Xi Zhou

Robust detection of moving vehicles is a critical task for any autonomously operating outdoor robot or self-driving vehicle. Most modern approaches for solving this task rely on training image-based detectors using large-scale vehicle…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Jannik Zürn , Wolfram Burgard

Ultrasound imaging is challenging to interpret due to non-uniform intensities, low contrast, and inherent artifacts, necessitating extensive training for non-specialists. Advanced representation with clear tissue structure separation could…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Oleksandra Tmenova , Yordanka Velikova , Mahdi Saleh , Nassir Navab

There is a growing literature demonstrating the feasibility of using Radio Frequency (RF) signals to enable key computer vision tasks in the presence of occlusions and poor lighting. It leverages that RF signals traverse walls and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Tianhong Li , Lijie Fan , Yuan Yuan , Dina Katabi

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis

Training Transformer-based models demands a large amount of data, while obtaining aligned and labelled data in multimodality is rather cost-demanding, especially for audio-visual speech recognition (AVSR). Thus it makes a lot of sense to…

Sound · Computer Science 2022-03-29 Xichen Pan , Peiyu Chen , Yichen Gong , Helong Zhou , Xinbing Wang , Zhouhan Lin

State-of-the-art speaker verification systems are inherently dependent on some kind of human supervision as they are trained on massive amounts of labeled data. However, manually annotating utterances is slow, expensive and not scalable to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Théo Lepage , Réda Dehak

Although supervised deep learning has revolutionized speech and audio processing, it has necessitated the building of specialist models for individual tasks and application scenarios. It is likewise difficult to apply this to dialects and…

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Rich temporal information and variations in viewpoints make video data an attractive choice for learning image representations using unsupervised contrastive learning (UCL) techniques. State-of-the-art (SOTA) contrastive learning techniques…

Image and Video Processing · Electrical Eng. & Systems 2022-07-28 Soumen Basu , Somanshu Singla , Mayank Gupta , Pratyaksha Rana , Pankaj Gupta , Chetan Arora

Unsupervised representation learning aims at finding methods that learn representations from data without annotation-based signals. Abstaining from annotations not only leads to economic benefits but may - and to some extent already does -…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Bonifaz Stuhr

Large scale databases with high-quality manual annotations are scarce in audio domain. We thus explore a self-supervised graph approach to learning audio representations from highly limited labelled data. Considering each audio sample as a…

Machine Learning · Computer Science 2022-11-23 Amir Shirian , Krishna Somandepalli , Tanaya Guha

Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have been proposed in the…

Computation and Language · Computer Science 2022-01-10 Panagiotis Koromilas , Theodoros Giannakopoulos

Spoken question answering (SQA) requires fine-grained understanding of both spoken documents and questions for the optimal answer prediction. In this paper, we propose novel training schemes for spoken question answering with a…

Computation and Language · Computer Science 2021-09-09 Chenyu You , Nuo Chen , Yuexian Zou

Video is an essential imaging modality for diagnostics, e.g. in ultrasound imaging, for endoscopy, or movement assessment. However, video hasn't received a lot of attention in the medical image analysis community. In the clinical practice,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Tianrui Liu , Qingjie Meng , Athanasios Vlontzos , Jeremy Tan , Daniel Rueckert , Bernhard Kainz