English
Related papers

Related papers: Mix-Geneformer: Unified Representation Learning fo…

200 papers

Retrieving gene functional networks from knowledge databases presents a challenge due to the mismatch between disease networks and subtype-specific variations. Current solutions, including statistical and deep learning methods, often fail…

Machine Learning · Computer Science 2025-02-25 Ziwei Yang , Zheng Chen , Xin Liu , Rikuto Kotoge , Peng Chen , Yasuko Matsubara , Yasushi Sakurai , Jimeng Sun

We introduce GENomic Encoding REpresentation with Language Model (GENEREL), a framework designed to bridge genetic and biomedical knowledge bases. What sets GENEREL apart is its ability to fine-tune language models to infuse biological…

Machine Learning · Computer Science 2024-10-15 Hongyi Yuan , Suqi Liu , Kelly Cho , Katherine Liao , Alexandre Pereira , Tianxi Cai

Deep learning methods are widely applied in digital pathology to address clinical challenges such as prognosis and diagnosis. As one of the most recent applications, deep models have also been used to extract molecular features from whole…

Image and Video Processing · Electrical Eng. & Systems 2022-03-29 Amir Safarpoor , Jason D. Hipp , H. R. Tizhoosh

Cellular differentiation is governed by gene regulatory networks, the high-dimensional stochastic biochemical systems that determine the transcriptional landscape and mediate cellular responses to signals and perturbations. Although…

Molecular Networks · Quantitative Biology 2026-04-29 Suryanarayana Maddu , Victor Chardès , Michael J. Shelley

In this paper, we propose a novel data augmentation technique called GenMix, which combines generative and mixture approaches to leverage the strengths of both methods. While generative models excel at creating new data patterns, they face…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Hansang Lee , Haeil Lee , Helen Hong

Self-supervised learning can be used for mitigating the greedy needs of Vision Transformer networks for very large fully-annotated datasets. Different classes of self-supervised learning offer representations with either good contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Spyros Gidaris , Andrei Bursuc , Oriane Simeoni , Antonin Vobecky , Nikos Komodakis , Matthieu Cord , Patrick Pérez

We propose a method to facilitate exploration and analysis of new large data sets. In particular, we give an unsupervised deep learning approach to learning a latent representation that captures semantic similarity in the data set. The core…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Gary B Huang , Huei-Fang Yang , Shin-ya Takemura , Pat Rivlin , Stephen M Plaza

Individuals with suspected rare genetic disorders often undergo multiple clinical evaluations, imaging studies, laboratory tests and genetic tests, to find a possible answer over a prolonged period of time. Addressing this "diagnostic…

Single-cell RNA sequencing (scRNA-seq) has revealed complex cellular heterogeneity, but recent studies emphasize that understanding biological function also requires modeling cell-cell communication (CCC), the signaling interactions…

Machine Learning · Computer Science 2025-12-29 Cong Qi , Yeqing Chen , Zhi Wei

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu

Deciphering complex gene-gene interactions remains challenging in transcriptomics as traditional methods often miss higher-order and nonlinear dependencies. This study introduces a quantum-inspired framework leveraging tensor networks (TNs)…

Molecular Networks · Quantitative Biology 2025-09-09 Olatz Sanz Larrarte , Borja Aizpurua , Reza Dastbasteh , Ruben M. Otxoa , Josu Etxezarreta Martinez

As a fundamental task in Information Retrieval and Computational Linguistics, sentence representation has profound implications for a wide range of practical applications such as text clustering, content analysis, question-answering…

Computation and Language · Computer Science 2025-05-02 Bowen Zhang , Zixin Song , Chunping Li

Background: This research aims to improve glioblastoma survival prediction by integrating MR images, clinical and molecular-pathologic data in a transformer-based deep learning model, addressing data heterogeneity and performance…

Biomedical research increasingly relies on integrating diverse data modalities, including gene expression profiles, medical images, and clinical metadata. While medical images and clinical metadata are routinely collected in clinical…

Artificial Intelligence · Computer Science 2026-01-23 Francesca Pia Panaccione , Carlo Sgaravatti , Pietro Pinoli

Genomic (DNA) sequences encode an enormous amount of information for gene regulation and protein synthesis. Similar to natural language models, researchers have proposed foundation models in genomics to learn generalizable features from…

Currently, this paper is under review in IEEE. Transformers have intrigued the vision research community with their state-of-the-art performance in natural language processing. With their superior performance, transformers have found their…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Preetam Ghosh , Swalpa Kumar Roy , Bikram Koirala , Behnood Rasti , Paul Scheunders

Given the increasing volume and quality of genomics data, extracting new insights requires interpretable machine-learning models. This work presents Genomic Interpreter: a novel architecture for genomic assay prediction. This model…

Machine Learning · Computer Science 2023-06-29 Zehui Li , Akashaditya Das , William A V Beardall , Yiren Zhao , Guy-Bart Stan

Genomic signal processing has been used successfully in bioinformatics to analyze biomolecular sequences and gain varied insights into DNA structure, gene organization, protein binding, sequence evolution, etc. But challenges remain in…

Genomics · Quantitative Biology 2022-11-04 Saish Jaiswal , Shreya Nema , Hema A Murthy , Manikandan Narayanan

We present the use of single-cell entropy (scEntropy) to measure the order of the cellular transcriptome profile from single-cell RNA-seq data, which leads to a method of unsupervised cell type classification through scEntropy followed by…

Quantitative Methods · Quantitative Biology 2020-02-18 Jingxin Liu , You Song , Jinzhi Lei

Multimodal alignment of histopathology encoders with transcriptomic and genomic data has been shown to significantly improve performance in downstream diagnostic tasks. Hematological cytology is unique in that visual single-cell evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Muhammed Furkan Dasdelen , Fatih Ozlugedik , Ilaria Looser , Rao Muhammad Umer , Christian Pohlkamp , Carsten Marr