中文
相关论文

相关论文: Translating Imaging to Genomics: Leveraging Transf…

200 篇论文

Accurate volumetric image registration is highly relevant for clinical routines and computer-aided medical diagnosis. Recently, researchers have begun to use transformers in learning-based methods for medical image registration, and have…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Ahsan Raza Siyal , Astrid Ellen Grams , Markus Haltmeier

As more deep learning models are being applied in real-world applications, there is a growing need for modeling and learning the representations of neural networks themselves. An efficient representation can be used to predict target…

机器学习 · 计算机科学 2023-10-17 Yun Yi , Haokui Zhang , Rong Xiao , Nannan Wang , Xiaoyu Wang

Transformer-based models have achieved remarkable success in natural language and vision tasks, but their application to gene expression analysis remains limited due to data sparsity, high dimensionality, and missing values. We present…

机器学习 · 计算机科学 2025-04-15 Shuai Jiang , Saeed Hassanpour

Deep generative models have significantly advanced medical imaging analysis by enhancing dataset size and quality. Beyond mere data augmentation, our research in this paper highlights an additional, significant capacity of deep generative…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Xiaodan Xing , Junzhi Ning , Yang Nan , Guang Yang

With the advancements in self-supervised learning (SSL), transformer-based computer vision models have recently demonstrated superior results compared to convolutional neural networks (CNNs) and are poised to dominate the field of…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Solha Kang , Joris Vankerschaver , Utku Ozbulak

The extraction of structured clinical information from free-text radiology reports in the form of radiology graphs has been demonstrated to be a valuable approach for evaluating the clinical correctness of report-generation methods.…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Yiheng Xiong , Jingsong Liu , Kamilia Zaripova , Sahand Sharifzadeh , Matthias Keicher , Nassir Navab

Recently, learned image compression methods have outperformed traditional hand-crafted ones including BPG. One of the keys to this success is learned entropy models that estimate the probability distribution of the quantized latent…

图像与视频处理 · 电气工程与系统科学 2022-07-22 Jun-Hyuk Kim , Byeongho Heo , Jong-Seok Lee

Transcriptomic data is a treasure-trove in modern molecular biology, as it offers a comprehensive viewpoint into the intricate nuances of gene expression dynamics underlying biological systems. This genetic information must be utilised to…

分子网络 · 定量生物学 2023-12-13 Vikram Singh , Vikram Singh

The extraction of a scene graph with objects as nodes and mutual relationships as edges is the basis for a deep understanding of image content. Despite recent advances, such as message passing and joint classification, the detection of…

计算机视觉与模式识别 · 计算机科学 2021-07-22 Rajat Koner , Suprosanna Shit , Volker Tresp

Designed to learn long-range interactions on sequential data, transformers continue to show state-of-the-art results on a wide variety of tasks. In contrast to CNNs, they contain no inductive bias that prioritizes local interactions. This…

计算机视觉与模式识别 · 计算机科学 2021-06-24 Patrick Esser , Robin Rombach , Björn Ommer

Region proposal based methods like R-CNN and Faster R-CNN models have proven to be extremely successful in object detection and segmentation tasks. Recently, Transformers have also gained popularity in the domain of Computer Vision, and are…

计算机视觉与模式识别 · 计算机科学 2021-10-07 Deepanshu Pandey , Pradyumna Gupta , Sumit Bhattacharya , Aman Sinha , Rohit Agarwal

From a visual perception perspective, modern graphical user interfaces (GUIs) comprise a complex graphics-rich two-dimensional visuospatial arrangement of text, images, and interactive objects such as buttons and menus. While existing…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Yue Jiang , Zixin Guo , Hamed Rezazadegan Tavakoli , Luis A. Leiva , Antti Oulasvirta

Medical imaging modalities have revolutionized health-care approaches by offering a better understanding of the human anatomy. Discovery of x-rays allowed the exploiting of the micro-scaled information of human anatomy. Computed tomography…

医学物理 · 物理学 2018-09-18 Sanam Assili

Objective: Transformers, born to remedy the inadequate receptive fields of CNNs, have drawn explosive attention recently. However, the daunting computational complexity of global representation learning, together with rigid window…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Xian Lin , Li Yu , Kwang-Ting Cheng , Zengqiang Yan

Multimodal approaches that integrate histology and genomics hold strong potential for precision oncology. However, phenotypic and genotypic heterogeneity limits the quality of intra-modal representations and hinders effective inter-modal…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Yupei Zhang , Yating Huang , Wanming Hu , Lequan Yu , Hujun Yin , Chao Li

Transformer-based detectors have shown success in computer vision tasks with natural images. These models, exemplified by the Deformable DETR, are optimized through complex engineering strategies tailored to the typical characteristics of…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yanqi Xu , Yiqiu Shen , Carlos Fernandez-Granda , Laura Heacock , Krzysztof J. Geras

Specialised transformers-based models (such as BioBERT and BioMegatron) are adapted for the biomedical domain based on publicly available biomedical corpora. As such, they have the potential to encode large-scale biological knowledge. We…

计算与语言 · 计算机科学 2022-12-22 Oskar Wysocki , Zili Zhou , Paul O'Regan , Deborah Ferreira , Magdalena Wysocka , Dónal Landers , André Freitas

Predicting protein secondary structures such as alpha helices, beta sheets, and coils from amino acid sequences is essential for understanding protein function. This work presents a transformer-based model that applies attention mechanisms…

人工智能 · 计算机科学 2025-12-10 Manzi Kevin Maxime

Automated lesion segmentation from computed tomography (CT) is an important and challenging task in medical image analysis. While many advancements have been made, there is room for continued improvements. One hurdle is that CT images can…

计算机视觉与模式识别 · 计算机科学 2018-07-20 Youbao Tang , Jinzheng Cai , Le Lu , Adam P. Harrison , Ke Yan , Jing Xiao , Lin Yang , Ronald M. Summers

Transformer models have recently attracted much interest from computer vision researchers and have since been successfully employed for several problems traditionally addressed with convolutional neural networks. At the same time, image…

计算机视觉与模式识别 · 计算机科学 2021-07-13 Ricard Durall , Stanislav Frolov , Jörn Hees , Federico Raue , Franz-Josef Pfreundt , Andreas Dengel , Janis Keupe