English
Related papers

Related papers: Multi-modal Transfer Learning between Biological F…

200 papers

Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 David Mizrahi , Roman Bachmann , Oğuzhan Fatih Kar , Teresa Yeo , Mingfei Gao , Afshin Dehghan , Amir Zamir

The visual world offers a critical axis for advancing foundation models beyond language. Despite growing interest in this direction, the design space for native multimodal models remains opaque. We provide empirical clarity through…

The editing of transcribed RNA by other molecules such that the form of the final product differs from that specified in the corresponding DNA sequence is ubiquitous. This paper uses an abstract, tunable Boolean genetic regulatory network…

Neural and Evolutionary Computing · Computer Science 2015-05-11 Larry Bull

Diffusion-based generative modeling has been achieving state-of-the-art results on various generation tasks. Most diffusion models, however, are limited to a single-generation modeling. Can we generalize diffusion models with the ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Changyou Chen , Han Ding , Bunyamin Sisman , Yi Xu , Ouye Xie , Benjamin Z. Yao , Son Dinh Tran , Belinda Zeng

Foundation models have made significant strides in understanding the genomic language of DNA sequences. However, previous models typically adopt the tokenization methods designed for natural language, which are unsuitable for DNA sequences…

Genomics · Quantitative Biology 2024-12-19 Lifeng Qiao , Peng Ye , Yuchen Ren , Weiqiang Bai , Chaoqi Liang , Xinzhu Ma , Nanqing Dong , Wanli Ouyang

Gene regulation is a dynamic process that connects genotype and phenotype. Given the difficulty of physically mapping mammalian gene circuitry, we require new computational methods to learn regulatory rules. Natural language is a valuable…

Quantitative Methods · Quantitative Biology 2022-10-27 William Connell , Umair Khan , Michael J. Keiser

Genomic (DNA) sequences encode an enormous amount of information for gene regulation and protein synthesis. Similar to natural language models, researchers have proposed foundation models in genomics to learn generalizable features from…

Cellular differentiation is governed by gene regulatory networks, the high-dimensional stochastic biochemical systems that determine the transcriptional landscape and mediate cellular responses to signals and perturbations. Although…

Molecular Networks · Quantitative Biology 2026-04-29 Suryanarayana Maddu , Victor Chardès , Michael J. Shelley

Deep learning methods are widely applied in digital pathology to address clinical challenges such as prognosis and diagnosis. As one of the most recent applications, deep models have also been used to extract molecular features from whole…

Image and Video Processing · Electrical Eng. & Systems 2022-03-29 Amir Safarpoor , Jason D. Hipp , H. R. Tizhoosh

We introduce Transfusion, a recipe for training a multi-modal model over discrete and continuous data. Transfusion combines the language modeling loss function (next token prediction) with diffusion to train a single transformer over…

Artificial Intelligence · Computer Science 2024-08-21 Chunting Zhou , Lili Yu , Arun Babu , Kushal Tirumala , Michihiro Yasunaga , Leonid Shamis , Jacob Kahn , Xuezhe Ma , Luke Zettlemoyer , Omer Levy

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

Modeling genomic sequences faces two unsolved challenges: the information density varies widely across different regions, while there is no clearly defined minimum vocabulary unit. Relying on either four primitive bases or independently…

Genomics · Quantitative Biology 2025-11-20 Siyuan Li , Kai Yu , Anna Wang , Zicheng Liu , Chang Yu , Jingbo Zhou , Qirong Yang , Yucheng Guo , Xiaoming Zhang , Stan Z. Li

In the rapidly evolving landscape of genomics, deep learning has emerged as a useful tool for tackling complex computational challenges. This review focuses on the transformative role of Large Language Models (LLMs), which are mostly based…

RNA's diverse biological functions stem from its structural versatility, yet accurately predicting and designing RNA sequences given a 3D conformation (inverse folding) remains a challenge. Here, I introduce a deep learning framework that…

Quantitative Methods · Quantitative Biology 2026-01-06 Annabelle Yao

The Human Genome Project has led to an exponential increase in data related to the sequence, structure, and function of biomolecules. Bioinformatics is an interdisciplinary research field that primarily uses computational methods to analyze…

Biomolecules · Quantitative Biology 2024-05-14 Yanlin Zhou , Tong Zhan , Yichao Wu , Bo Song , Chenxi Shi

Recent technological advancements in data acquisition tools allowed life scientists to acquire multimodal data from different biological application domains. Broadly categorized in three types (i.e., sequences, images, and signals), these…

Quantitative Methods · Quantitative Biology 2020-03-03 Mufti Mahmud , M Shamim Kaiser , Amir Hussain

Understanding the biological mechanisms of disease is crucial for medicine, and in particular, for drug discovery. AI-powered analysis of genome-scale biological data holds great potential in this regard. The increasing availability of…

Structure-based drug design (SBDD) is a critical task in drug discovery, requiring the generation of molecular information across two distinct modalities: discrete molecular graphs and continuous 3D coordinates. However, existing SBDD…

Computational Engineering, Finance, and Science · Computer Science 2025-03-28 Xiuyuan Hu , Guoqing Liu , Can Chen , Yang Zhao , Hao Zhang , Xue Liu

Leveraging information across diverse modalities is known to enhance performance on multimodal segmentation tasks. However, effectively fusing information from different modalities remains challenging due to the unique characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Large-scale pre-training methodologies for chemical language models represent a breakthrough in cheminformatics. These methods excel in tasks such as property prediction and molecule generation by learning contextualized representations of…

Machine Learning · Computer Science 2025-07-18 Eduardo Soares , Victor Shirasuna , Emilio Vital Brazil , Renato Cerqueira , Dmitry Zubarev , Kristin Schmidt
‹ Prev 1 4 5 6 7 8 10 Next ›