English
Related papers

Related papers: Multi-modal Self-supervised Pre-training for Regul…

200 papers

Cell type identification from single-cell transcriptomic data is a common goal of single-cell RNA sequencing (scRNAseq) data analysis. Neural networks have been employed to identify cell types from scRNAseq data with high performance.…

Genomics · Quantitative Biology 2020-05-11 Xishuang Dong , Shanta Chowdhury , Uboho Victor , Xiangfang Li , Lijun Qian

The day we understand the time evolution of subcellular elements at a level of detail comparable to physical systems governed by Newton's laws of motion seems far away. Even so, quantitative approaches to cellular dynamics add to our…

Given the increasing availability of RNA-seq data and its complex and heterogeneous nature, there has been growing interest in applying AI/machine learning methodologies to work with such data modalities. However, because omics data is…

Genomics · Quantitative Biology 2023-11-22 Kevin Li , Danko Nikolić , Vjekoslav Nikolić , Davor Andrić , Lauren M. Sanders , Sylvain V. Costes

Supervised learning is limited both by the quantity and quality of the labeled data. In the field of medical record tagging, writing styles between hospitals vary drastically. The knowledge learned from one hospital might not transfer well…

Computation and Language · Computer Science 2018-11-30 Yuhui Zhang , Allen Nie , James Zou

Multimodal single-cell technologies enable the simultaneous collection of diverse data types from individual cells, enhancing our understanding of cellular states. However, the integration of these datatypes and modeling the…

Machine Learning · Computer Science 2023-11-22 Bhavya Mehta , Nirmit Deliwala , Madhav Chandane

Inspired by the success of unsupervised pre-training paradigms, researchers have applied these approaches to DNA pre-training. However, we argue that these approaches alone yield suboptimal results because pure DNA sequences lack sufficient…

Machine Learning · Computer Science 2025-06-03 Zhao Yang , Jiwei Zhu , Bing Su

Antibodies comprise the most versatile class of binding molecules, with numerous applications in biomedicine. Computational design of antibodies involves generating novel and diverse sequences, while maintaining structural consistency.…

Biomolecules · Quantitative Biology 2023-06-21 Igor Melnyk , Vijil Chenthamarakshan , Pin-Yu Chen , Payel Das , Amit Dhurandhar , Inkit Padhi , Devleena Das

This dissertation explores the application of machine learning in molecular biology, focusing on gene expression regulation and cellular behavior at the single-cell level. Using modern neural networks, the research addresses key challenges…

Quantitative Methods · Quantitative Biology 2024-10-01 Yongjian Yang

Optimizing a neural network's performance is a tedious and time taking process, this iterative process does not have any defined solution which can work for all the problems. Optimization can be roughly categorized into - Architecture and…

Machine Learning · Computer Science 2019-12-16 Siddhartha Dhar Choudhury , Shashank Pandey , Kunal Mehrotra

Recent deep learning models for tabular data currently compete with the traditional ML models based on decision trees (GBDT). Unlike GBDT, deep models can additionally benefit from pretraining, which is a workhorse of DL for vision and NLP.…

Machine Learning · Computer Science 2022-07-13 Ivan Rubachev , Artem Alekberov , Yury Gorishniy , Artem Babenko

We consider the problem of predicting gene expressions from DNA sequences. A key challenge of this task is to find the regulatory elements that control gene expressions. Here, we introduce Seq2Exp, a Sequence to Expression network…

Genomics · Quantitative Biology 2025-02-21 Xingyu Su , Haiyang Yu , Degui Zhi , Shuiwang Ji

Tabular data is prevalent across diverse domains in machine learning. With the rapid progress of deep tabular prediction methods, especially pretrained (foundation) models, there is a growing need to evaluate these methods systematically…

Machine Learning · Computer Science 2025-11-10 Han-Jia Ye , Si-Yang Liu , Hao-Run Cai , Qi-Le Zhou , De-Chuan Zhan

A systematic analysis of the cell behavior requires automated approaches for cell segmentation and tracking. While deep learning has been successfully applied for the task of cell segmentation, there are few approaches for simultaneous cell…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Katharina Löffler , Ralf Mikut

Due to recent breakthroughs in state-of-the-art DNA sequencing technology, genomics data sets have become ubiquitous. The emergence of large-scale data sets provides great opportunities for better understanding of genomics, especially gene…

Genomics · Quantitative Biology 2020-12-18 Wei Cheng , Ghulam Murtaza , Aaron Wang

We study whether in-domain pretraining of Bidirectional Encoder Representations from Transformer (BERT) model improves subdomain-level detection of exfiltration at low false positive rates. While previous work mostly examines fine-tuned…

Cryptography and Security · Computer Science 2026-04-14 Miloš Tomić , Aleksa Cvetanović , Predrag Tadić

Transferring the weights of a pre-trained model to assist another task has become a crucial part of modern deep learning, particularly in data-scarce scenarios. Pre-training refers to the initial step of training models outside the current…

Machine Learning · Computer Science 2024-04-29 Houtan Ghaffari , Paul Devos

A great deal of effort has been devoted to discovering a particular genetic disorder, but its classification across a broad spectrum of disorder classes and types remains elusive. Early diagnosis of genetic disorders enables timely…

Artificial Intelligence · Computer Science 2024-12-04 Abu Bakar Siddik , Faisal R. Badal , Afroza Islam

Genetic Programming is an evolutionary algorithm that generates computer programs, or mathematical expressions, to solve complex problems. In this Guide, we demonstrate how to use Genetic Programming to develop surrogate models to mitigate…

Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called…

Machine Learning · Computer Science 2023-10-05 Tianyu Liu , Yuge Wang , Rex Ying , Hongyu Zhao

Despite tremendous progress, machine learning and deep learning still suffer from incomprehensible predictions. Incomprehensibility, however, is not an option for the use of (deep) reinforcement learning in the real world, as unpredictable…

Artificial Intelligence · Computer Science 2024-07-23 Manuel Eberhardinger , Florian Rupp , Johannes Maucher , Setareh Maghsudi