中文
相关论文

相关论文: Learning Visual-Semantic Embeddings for Reporting …

200 篇论文

Obtaining ground truth data in medical imaging has difficulties due to the fact that it requires a lot of annotating time from the experts in the field. Also, when trained with supervised learning, it detects only the cases included in the…

计算机视觉与模式识别 · 计算机科学 2022-12-26 Inha Kang , Jinah Park

Self-supervised learning provides an opportunity to explore unlabeled chest X-rays and their associated free-text reports accumulated in clinical routine without manual supervision. This paper proposes a Joint Image Text Representation…

机器学习 · 计算机科学 2021-09-07 Zhanghexuan Ji , Mohammad Abuzar Shaikh , Dana Moukheiber , Sargur Srihari , Yifan Peng , Mingchen Gao

The use of supervised deep learning techniques to detect pathologies in brain MRI scans can be challenging due to the diversity of brain anatomy and the need for annotated data sets. An alternative approach is to use unsupervised anomaly…

图像与视频处理 · 电气工程与系统科学 2023-03-08 Finn Behrendt , Debayan Bhattacharya , Julia Krüger , Roland Opfer , Alexander Schlaefer

While medical image segmentation is an important task for computer aided diagnosis, the high expertise requirement for pixelwise manual annotations makes it a challenging and time consuming task. Since conventional data augmentations do not…

图像与视频处理 · 电气工程与系统科学 2021-06-21 Dwarikanath Mahapatra , Ankur Singh

Deep generative models have significantly advanced medical imaging analysis by enhancing dataset size and quality. Beyond mere data augmentation, our research in this paper highlights an additional, significant capacity of deep generative…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Xiaodan Xing , Junzhi Ning , Yang Nan , Guang Yang

In this study, a new Anomaly Detection (AD) approach for industrial and medical images is proposed. This method leverages the theoretical strengths of unsupervised learning and the data availability of both normal and abnormal classes.…

计算机视觉与模式识别 · 计算机科学 2024-01-24 Arnaud Bougaham , Valentin Delchevalerie , Mohammed El Adoui , Benoît Frénay

Training audio-to-image generative models requires an abundance of diverse audio-visual pairs that are semantically aligned. Such data is almost always curated from in-the-wild videos, given the cross-modal semantic correspondence that is…

声音 · 计算机科学 2025-01-10 Darius Petermann , Mahdi M. Kalayeh

Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. However, existing report generation…

计算与语言 · 计算机科学 2021-04-14 Yasuhide Miura , Yuhao Zhang , Emily Bao Tsai , Curtis P. Langlotz , Dan Jurafsky

With the increasingly complex and changeable electromagnetic environment, wireless communication systems are facing jamming and abnormal signal injection, which significantly affects the normal operation of a communication system. In…

信号处理 · 电气工程与系统科学 2022-05-31 Tingyan Kuang , Huichao Chen , Lu Han , Rong He , Wei Wang , Guoru Ding

Medical imaging analysis plays a critical role in the diagnosis and treatment of various medical conditions. This paper focuses on chest X-ray images and their corresponding radiological reports. It presents a new model that learns a joint…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Gefen Dawidowicz , Elad Hirsch , Ayellet Tal

Confounding pathology with normal anatomical variation remains a significant challenge in unsupervised medical-image anomaly detection, resulting in numerous false positives. To enhance integration of healthy variation, we augment the…

定量方法 · 定量生物学 2026-03-09 P. Bilha Githinji , Xi Yuan , Ijaz Gul , Lian Zhang , Jinhao Xu , Zhenglin Chen , Peiwu Qin , Dongmei Yu

Two modalities are often used to convey information in a complementary and beneficial manner, e.g., in online news, videos, educational resources, or scientific publications. The automatic understanding of semantic correlations between text…

多媒体 · 计算机科学 2019-06-21 Christian Otto , Matthias Springstein , Avishek Anand , Ralph Ewerth

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

Deep learning has shown recent success in classifying anomalies in chest x-rays, but datasets are still small compared to natural image datasets. Supervision of abnormality localization has been shown to improve trained models, partially…

We introduce a radiology-focused visual language model designed to generate radiology reports from chest X-rays. Building on previous findings that large language models (LLMs) can acquire multimodal capabilities when aligned with…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Xi Zhang , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

The way we analyse clinical texts has undergone major changes over the last years. The introduction of language models such as BERT led to adaptations for the (bio)medical domain like PubMedBERT and ClinicalBERT. These models rely on large…

计算与语言 · 计算机科学 2023-09-15 Tom van Sonsbeek , Xiantong Zhen , Marcel Worring

Through training on unlabeled data, anomaly detection has the potential to impact computer-aided diagnosis by outlining suspicious regions. Previous work on deep-learning-based anomaly detection has primarily focused on the reconstruction…

图像与视频处理 · 电气工程与系统科学 2019-12-03 David Zimmerer , Jens Petersen , Simon A. A. Kohl , Klaus H. Maier-Hein

Radiology reports are an important means of communication between radiologists and other physicians. These reports express a radiologist's interpretation of a medical imaging examination and are critical in establishing a diagnosis and…

计算机视觉与模式识别 · 计算机科学 2017-09-14 Hojjat Salehinejad , Shahrokh Valaee , Aren Mnatzakanian , Tim Dowdell , Joseph Barfett , Errol Colak

Automated radiographic report generation is a challenging cross-domain task that aims to automatically generate accurate and semantic-coherence reports to describe medical images. Despite the recent progress in this field, there are still…

计算机视觉与模式识别 · 计算机科学 2022-08-23 Zhanyu Wang , Mingkang Tang , Lei Wang , Xiu Li , Luping Zhou

Increasing the semantic understanding and contextual awareness of machine learning models is important for improving robustness and reducing susceptibility to data shifts. In this work, we leverage contextual awareness for the anomaly…

机器学习 · 计算机科学 2022-03-22 Nathan Vaska , Kevin Leahy , Victoria Helus