English
Related papers

Related papers: Multi-modal Self-supervised Pre-training for Regul…

200 papers

Learning representations of molecular structures using deep learning is a fundamental problem in molecular property prediction tasks. Molecules inherently exist in the real world as three-dimensional structures; furthermore, they are not…

Machine Learning · Computer Science 2024-01-22 Daiki Koge , Naoaki Ono , Shigehiko Kanaya

Motivation: Laboratory gene regulatory data for a species are sporadic. Despite the abundance of gene regulatory network algorithms that employ single data sets, few algorithms can combine the vast but disperse sources of data and extract…

Genomics · Quantitative Biology 2020-08-17 Mehrzad Saremi , Maryam Amirmazlaghani

A multi-modal machine learning system uses multiple unique data sources and types to improve its performance. This article proposes a system that combines results from several types of models, all of which are trained on different data…

Machine Learning · Computer Science 2024-02-05 Aaron Mullen , Samuel E. Armstrong , Jasmine Perdeh , Bjorn Bauer , Jeffrey Talbert , V. K. Cody Bumgardner

Reinforcement learning (RL) applications, where an agent can simply learn optimal behaviors by interacting with the environment, are quickly gaining tremendous success in a wide variety of applications from controlling simple pendulums to…

Machine Learning · Computer Science 2022-01-28 Mariam Kiran , Melis Ozyildirim

Predicting stroke risk is a complex challenge that can be enhanced by integrating diverse clinically available data modalities. This study introduces a self-supervised multimodal framework that combines 3D brain imaging, clinical data, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Camille Delgrange , Olga Demler , Samia Mora , Bjoern Menze , Ezequiel de la Rosa , Neda Davoudi

Gene regulatory networks (GRNs) control cellular function and decision making during tissue development and homeostasis. Mathematical tools based on dynamical systems theory are often used to model these networks, but the size and…

Molecular Networks · Quantitative Biology 2018-03-16 Edgar Herrera-Delgado , Ruben Perez-Carrasco , James Briscoe , Peter Sollich

Reconstruction of gene regulatory networks is the process of identifying gene dependency from gene expression profile through some computation techniques. In our human body, though all cells pose similar genetic material but the activation…

Deep model-based reinforcement learning methods offer a conceptually simple approach to the decision-making and control problem: use learning for the purpose of estimating an approximate dynamics model, and offload the rest of the work to…

Machine Learning · Computer Science 2023-07-13 Michael Janner

Gene expression prediction, which predicts mRNA expression levels from DNA sequences, presents significant challenges. Previous works often focus on extending input sequence length to locate distal enhancers, which may influence target…

Machine Learning · Computer Science 2026-03-13 Zhao Yang , Yi Duan , Jiwei Zhu , Ying Ba , Chuan Cao , Bing Su

Cells receive a wide variety of cellular and environmental signals, which must be processed combinatorially to generate specific and timely genetic responses. We present here a theoretical study on the combinatorial control and integration…

Soft Condensed Matter · Physics 2007-05-23 Nicolas E. Buchler , Ulrich Gerland , Terence Hwa

A foundation model is a machine learning model trained on a large and diverse set of data, typically using self-supervised learning-based pre-training techniques, that can be adapted to various downstream tasks. However, current research on…

Decoding the linguistic intricacies of the genome is a crucial problem in biology, and pre-trained foundational models such as DNABERT and Nucleotide Transformer have made significant strides in this area. Existing works have largely hinged…

Genomics · Quantitative Biology 2024-03-20 Zhihan Zhou , Yanrong Ji , Weijian Li , Pratik Dutta , Ramana Davuluri , Han Liu

In computational molecular biology, gene regulatory binding sites prediction in whole genome remains a challenge for the researchers. Now a days, the genome wide regulatory binding site prediction tools required either direct pattern…

Genomics · Quantitative Biology 2010-02-06 Chandra Prakash Singh , Feroz Khan , Sanjay Kumar Singh , Durg Singh Chauhan

Engineering biology requires precise control of biomolecular circuits, and Cybergenetics is the field dedicated to achieving this goal. A significant challenge in developing controllers for cellular functions is designing systems that can…

Quantitative Methods · Quantitative Biology 2024-09-18 Hamza Faquir , Manuel Pájaro , Irene Otero-Muras

We present a novel classification-based algorithm called GeneClass for learning to predict gene regulatory response. Our approach is motivated by the hypothesis that in simple organisms such as Saccharomyces cerevisiae, we can learn a…

Quantitative Methods · Quantitative Biology 2007-05-23 Manuel Middendorf , Anshul Kundaje , Chris Wiggins , Yoav Freund , Christina Leslie

Deep learning associated with neurological signals is poised to drive major advancements in diverse fields such as medical diagnostics, neurorehabilitation, and brain-computer interfaces. The challenge in harnessing the full potential of…

Signal Processing · Electrical Eng. & Systems 2024-07-08 Di Wu , Siyuan Li , Jie Yang , Mohamad Sawan

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

Machine Learning · Computer Science 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

Gene transformer models such as Nucleotide Transformer, DNABert, and LOGO are trained to learn optimal gene sequence representations by using the Masked Language Modeling (MLM) training objective over the complete Human Reference Genome.…

Computation and Language · Computer Science 2024-10-23 Soumyadeep Roy , Shamik Sural , Niloy Ganguly

Modern deep models are trained on large real-world datasets, where data quality varies and redundancy is common. Data-centric approaches such as dataset pruning have shown promise in improving training efficiency and model performance.…

Machine Learning · Computer Science 2025-07-18 Suorong Yang , Peijia Li , Yujie Liu , Zhiming Xu , Peng Ye , Wanli Ouyang , Furao Shen , Dongzhan Zhou

We consider controllable DNA sequence design, where sequences are generated by conditioning on specific biological properties. While language models (LMs) such as GPT and BERT have achieved remarkable success in natural language generation,…

Machine Learning · Computer Science 2025-12-10 Xingyu Su , Xiner Li , Yuchao Lin , Ziqian Xie , Degui Zhi , Shuiwang Ji