English
Related papers

Related papers: Learning A Multi-Task Transformer Via Unified And …

200 papers

Lung cancer has the highest mortality rate of deadly cancers in the world. Early detection is essential to treatment of lung cancer. However, detection and accurate diagnosis of pulmonary nodules depend heavily on the experiences of…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Chenglong Wang , Yun Liu , Fen Wang , Chengxiu Zhang , Yida Wang , Mei Yuan , Guang Yang

Large-scale vision-language pre-trained models have shown promising transferability to various downstream tasks. As the size of these foundation models and the number of downstream tasks grow, the standard full fine-tuning paradigm becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Haoyu Lu , Yuqi Huo , Guoxing Yang , Zhiwu Lu , Wei Zhan , Masayoshi Tomizuka , Mingyu Ding

Semi-supervised learning via learning from limited quantities of labeled data has been investigated as an alternative to supervised counterparts. Maximizing knowledge gains from copious unlabeled data benefit semi-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ayaan Haque , Abdullah-Al-Zubaer Imran , Adam Wang , Demetri Terzopoulos

Multimodal learning is an emerging research topic across multiple disciplines but has rarely been applied to planetary science. In this contribution, we propose a single, unified transformer architecture trained to learn shared…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tom Sander , Moritz Tenthoff , Kay Wohlfarth , Christian Wöhler

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Chest X-rays are widely used to diagnose thoracic diseases, but the lack of detailed information about these abnormalities makes it challenging to develop accurate automated diagnosis systems, which is crucial for early detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 S. M. Nabil Ashraf , Md. Adyelullahil Mamun , Hasnat Md. Abdullah , Md. Golam Rabiul Alam

Chest X-ray (CXR) is the most common X-ray examination performed in daily clinical practice for the diagnosis of various heart and lung abnormalities. The large amount of data to be read and reported, with 100+ studies per day for a single…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Sebastian Guendel , Florin C. Ghesu , Sasa Grbic , Eli Gibson , Bogdan Georgescu , Andreas Maier , Dorin Comaniciu

Deep Learning (DL) can predict biomarkers directly from digitized cancer histology in a weakly-supervised setting. Recently, the prediction of continuous biomarkers through regression-based DL has seen an increasing interest. Nonetheless,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Omar S. M. El Nahhas , Georg Wölflein , Marta Ligero , Tim Lenz , Marko van Treeck , Firas Khader , Daniel Truhn , Jakob Nikolas Kather

Chest X-ray radiography is one of the earliest medical imaging technologies and remains one of the most widely-used for diagnosis, screening, and treatment follow up of diseases related to lungs and heart. The literature in this field of…

Image and Video Processing · Electrical Eng. & Systems 2020-05-06 Mohammad Eslami , Solale Tabarestani , Shadi Albarqouni , Ehsan Adeli , Nassir Navab , Malek Adjouadi

We present a novel multimodal deep learning framework for cardiac resynchronisation therapy (CRT) response prediction from 2D echocardiography and cardiac magnetic resonance (CMR) data. The proposed method first uses the `nnU-Net'…

Image and Video Processing · Electrical Eng. & Systems 2021-07-23 Esther Puyol-Antón , Baldeep S. Sidhu , Justin Gould , Bradley Porter , Mark K. Elliott , Vishal Mehta , Christopher A. Rinaldi , Andrew P. King

Self-supervised learning has emerged as a powerful tool for pretraining deep networks on unlabeled data, prior to transfer learning of target tasks with limited annotation. The relevance between the pretraining pretext and target tasks is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tianwei Zhang , Dong Wei , Mengmeng Zhu , Shi Gu , Yefeng Zheng

Medical vision-language pre-training (Med-VLP) models have recently accelerated the fast-growing medical diagnostics application. However, most Med-VLP models learn task-specific representations independently from scratch, thereby leading…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Chenlu Zhan , Yufei Zhang , Yu Lin , Gaoang Wang , Hongwei Wang

Transfer learning has become a standard practice to mitigate the lack of labeled data in medical classification tasks. Whereas finetuning a downstream task using supervised ImageNet pretrained features is straightforward and extensively…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Tuan Truong , Sadegh Mohammadi , Matthias Lenga

Multi-modal brain functional connectivity (FC) data have shown great potential for providing insights into individual variations in behavioral and cognitive traits. The joint learning of multi-modal imaging data can utilize the intrinsic…

Quantitative Methods · Quantitative Biology 2019-01-18 Li Xiao , Julia M. Stephen , Tony W. Wilson , Vince D. Calhoun , Yu-Ping Wang

Although there have been several recent advances in the application of deep learning algorithms to chest x-ray interpretation, we identify three major challenges for the translation of chest x-ray algorithms to the clinical setting. We…

Image and Video Processing · Electrical Eng. & Systems 2020-03-12 Pranav Rajpurkar , Anirudh Joshi , Anuj Pareek , Phil Chen , Amirhossein Kiani , Jeremy Irvin , Andrew Y. Ng , Matthew P. Lungren

Radiology is essential to modern healthcare, yet rising demand and staffing shortages continue to pose major challenges. Recent advances in artificial intelligence have the potential to support radiologists and help address these…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Phillip Sloan , Edwin Simpson , Majid Mirmehdi

The recent advances in neural language models have also been successfully applied to the field of chemistry, offering generative solutions for classical problems in molecular design and synthesis planning. These new methods have the…

Machine Learning · Computer Science 2023-05-19 Dimitrios Christofidellis , Giorgio Giannone , Jannis Born , Ole Winther , Teodoro Laino , Matteo Manica

Digital hematopathology requires cell-level analysis across diverse disease categories, including malignant disorders (e.g., leukemia), infectious conditions (e.g., malaria), and non-malignant red blood cell disorders (e.g., sickle cell…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Abdul Rehman , Iqra Rasool , Ayisha Imran , Mohsen Ali , Waqas Sultani

Unified and scalable Transformers have recently achieved remarkable success in modeling diverse phenomena traditionally associated with computer graphics, such as 3D visual effects, rendering processes, and motion in videos. In this work,…

Graphics · Computer Science 2026-05-28 Yu Zhang , Yidi Shao , Wenqi Ouyang , Yushi Lan , Zhexin Liang , Chengrui Wu , Xudong Xu , Xingang Pan

Building accurate and robust artificial intelligence systems for medical image assessment requires not only the research and design of advanced deep learning models but also the creation of large and curated sets of annotated training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Florin C. Ghesu , Bogdan Georgescu , Awais Mansoor , Youngjin Yoo , Dominik Neumann , Pragneshkumar Patel , R. S. Vishwanath , James M. Balter , Yue Cao , Sasa Grbic , Dorin Comaniciu