English
Related papers

Related papers: OTCXR: Rethinking Self-supervised Alignment using …

200 papers

Selecting input features of top relevance has become a popular method for building self-explaining models. In this work, we extend this selective rationalization approach to text matching, where the goal is to jointly select and align text…

Machine Learning · Computer Science 2020-05-28 Kyle Swanson , Lili Yu , Tao Lei

Transferring linguistic knowledge from a pretrained language model (PLM) to an acoustic model has been shown to greatly improve the performance of automatic speech recognition (ASR). However, due to the heterogeneous feature distributions…

Sound · Computer Science 2024-09-06 Xugang Lu , Peng Shen , Yu Tsao , Hisashi Kawai

Training automatic speech recognition (ASR) systems requires large amounts of well-curated paired data. However, human annotators usually perform "non-verbatim" transcription, which can result in poorly trained models. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-28 Dongji Gao , Hainan Xu , Desh Raj , Leibny Paola Garcia Perera , Daniel Povey , Sanjeev Khudanpur

The role of chest X-ray (CXR) imaging, due to being more cost-effective, widely available, and having a faster acquisition time compared to CT, has evolved during the COVID-19 pandemic. To improve the diagnostic performance of CXR imaging a…

Image and Video Processing · Electrical Eng. & Systems 2022-08-04 Xiao Qi , David J. Foran , John L. Nosher , Ilker Hacihaliloglu

Handwritten Text Recognition (HTR) is a task of central importance in the field of document image understanding. State-of-the-art methods for HTR require the use of extensive annotated sets for training, making them impractical for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Petros Georgoulas Wraight , Giorgos Sfikas , Ioannis Kordonis , Petros Maragos , George Retsinas

We propose a novel continual self-supervised learning (CSSL) framework for simultaneously learning diverse features from multi-window-obtained chest computed tomography (CT) images and ensuring data privacy. Achieving a robust and highly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Ren Tasai , Guang Li , Ren Togo , Takahiro Ogawa , Kenji Hirata , Minghui Tang , Takaaki Yoshimura , Hiroyuki Sugimori , Noriko Nishioka , Yukie Shimizu , Kohsuke Kudo , Miki Haseyama

Few-Shot Remote Sensing Scene Classification (FS-RSSC) presents the challenge of classifying remote sensing images with limited labeled samples. Existing methods typically emphasize single-modal feature learning, neglecting the potential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zhong Ji , Ci Liu , Jingren Liu , Chen Tang , Yanwei Pang , Xuelong Li

The promise of self-supervised learning (SSL) is to leverage large amounts of unlabeled data to solve complex tasks. While there has been excellent progress with simple, image-level learning, recent methods have shown the advantage of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Olivier J. Hénaff , Skanda Koppula , Evan Shelhamer , Daniel Zoran , Andrew Jaegle , Andrew Zisserman , João Carreira , Relja Arandjelović

A major limitation in applying deep learning to artificial intelligence (AI) systems is the scarcity of high-quality curated datasets. We investigate strong augmentation based self-supervised learning (SSL) techniques to address this…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 John D. Miller , Vignesh A. Arasu , Albert X. Pu , Laurie R. Margolies , Weiva Sieh , Li Shen

Large numbers of labeled medical images are essential for the accurate detection of anomalies, but manual annotation is labor-intensive and time-consuming. Self-supervised learning (SSL) is a training method to learn data-specific features…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Junya Sato , Yuki Suzuki , Tomohiro Wataya , Daiki Nishigaki , Kosuke Kita , Kazuki Yamagata , Noriyuki Tomiyama , Shoji Kido

Purpose: Interpreting chest radiographs (CXR) remains challenging due to the ambiguity of overlapping structures such as the lungs, heart, and bones. To address this issue, we propose a novel method for extracting fine-grained anatomical…

Image and Video Processing · Electrical Eng. & Systems 2023-06-08 Constantin Seibold , Alexander Jaus , Matthias A. Fink , Moon Kim , Simon Reiß , Ken Herrmann , Jens Kleesiek , Rainer Stiefelhagen

This dissertation relates to the transition of the state of the art of swept source optical coherence tomography (SS-OCT) systems to a new realm in which the image acquisition speed is improved by an order of magnitude. With the aid of a…

Image and Video Processing · Electrical Eng. & Systems 2020-02-21 Amir Tofighi Zavareh

Automated interpretation of chest X-rays (CXR) is a critical task with the potential to significantly improve clinical workflow and patient care. While recent advances in multimodal foundation models have shown promise, effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Alexander Davis , Rafael Souza , Jia-Hao Lim

Self-supervised learning (SSL) has advanced medical image analysis be enabling learning form large unlabelled data. However, in brain magnetic resonance imaging (MRI), most 3D models remain specialized for either segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Amy Makawana , Abhijeet Parida , Marius George Linguraru , Julia Ive , Syed Muhammad Anwar

Background: Cervical cancer seriously affects the health of the female reproductive system. Optical coherence tomography (OCT) emerged as a non-invasive, high-resolution imaging technology for cervical disease detection. However, OCT image…

Image and Video Processing · Electrical Eng. & Systems 2022-06-14 Kaiyi Chen , Qingbin Wang , Yutao Ma

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning…

Vision transformers, with their ability to more efficiently model long-range context, have demonstrated impressive accuracy gains in several computer vision and medical image analysis tasks including segmentation. However, such methods need…

Image and Video Processing · Electrical Eng. & Systems 2022-09-27 Jue Jiang , Neelam Tyagi , Kathryn Tringale , Christopher Crane , Harini Veeraraghavan

Radiology report generation represents a significant application within medical AI, and has achieved impressive results. Concurrently, large language models (LLMs) have demonstrated remarkable performance across various domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Haifeng Zhao , Yufei Zhang , Leilei Ma , Shuo Xu , Dengdi Sun

3D medical image segmentation methods have been successful, but their dependence on large amounts of voxel-level annotated data is a disadvantage that needs to be addressed given the high cost to obtain such annotation. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yuyuan Liu , Yu Tian , Chong Wang , Yuanhong Chen , Fengbei Liu , Vasileios Belagiannis , Gustavo Carneiro

Self-supervised learning (SSL) methods have achieved remarkable success in learning image representations allowing invariances in them - but therefore discarding transformation information that some computer vision tasks actually require.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Qin Wang , Alessio Quercia , Benjamin Bruns , Abigail Morrison , Hanno Scharr , Kai Krajsek