English
Related papers

Related papers: SELFormer: Molecular Representation Learning via S…

200 papers

Recently, the remarkable capabilities of large language models (LLMs) have been illustrated across a variety of research domains such as natural language processing, computer vision, and molecular modeling. We extend this paradigm by…

Machine Learning · Computer Science 2023-09-04 Hongshuo Huang , Rishikesh Magar , Changwen Xu , Amir Barati Farimani

Various machine-learning models, including deep neural network models, have already been developed to predict deleteriousness of missense (non-synonymous) mutations. Potential improvements to the current state of the art, however, may still…

Genomics · Quantitative Biology 2023-02-13 Theodore Jiang , Li Fang , Kai Wang

Determining the aqueous solubility of molecules is a vital step in many pharmaceutical, environmental, and energy storage applications. Despite efforts made over decades, there are still challenges associated with developing a solubility…

Materials Science · Physics 2022-09-05 Gihan Panapitiya , Michael Girard , Aaron Hollas , Vijay Murugesan , Wei Wang , Emily Saldanha

In recent decades, chemistry publications and patents have increased rapidly. A significant portion of key information is embedded in molecular structure figures, complicating large-scale literature searches and limiting the application of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Xi Fang , Jiankun Wang , Xiaochen Cai , Shangqian Chen , Shuwen Yang , Haoyi Tao , Nan Wang , Lin Yao , Linfeng Zhang , Guolin Ke

The success of language models, especially transformer-based architectures, has trickled into other domains giving rise to "scientific language models" that operate on small molecules, proteins or polymers. In chemistry, language models…

Chemical Physics · Physics 2024-10-22 Nikita Janakarajan , Tim Erdmann , Sarath Swaminathan , Teodoro Laino , Jannis Born

Many real-world problems can be naturally described by mathematical formulas. The task of finding formulas from a set of observed inputs and outputs is called symbolic regression. Recently, neural networks have been applied to symbolic…

Machine Learning · Computer Science 2022-10-24 Martin Vastl , Jonáš Kulhánek , Jiří Kubalík , Erik Derner , Robert Babuška

Designing de-novo molecules with desired property profiles requires efficient exploration of the vast chemical space ranging from $10^{23}$ to $10^{60}$ possible synthesizable candidates. While various deep generative models have been…

Machine Learning · Computer Science 2025-08-25 Kamran Chitsaz , Roshan Balaji , Quentin Fournier , Nirav Pravinbhai Bhatt , Sarath Chandar

This paper introduces SEMISE, a novel method for representation learning in medical imaging that combines self-supervised and supervised learning. By leveraging both labeled and augmented data, SEMISE addresses the challenge of data…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Dung T. Tran , Hung Vu , Anh Tran , Hieu Pham , Hong Nguyen , Phong Nguyen

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Molecular optimization is a central task in drug discovery that requires precise structural reasoning and domain knowledge. While large language models (LLMs) have shown promise in generating high-level editing intentions in natural…

Machine Learning · Computer Science 2025-10-17 Wenyu Zhu , Chengzhu Li , Xiaohe Tian , Yifan Wang , Yinjun Jia , Jianhui Wang , Bowen Gao , Ya-Qin Zhang , Wei-Ying Ma , Yanyan Lan

Models that accurately predict properties based on chemical structure are valuable tools in drug discovery. However, for many properties, public and private training sets are typically small, and it is difficult for the models to generalize…

Quantitative Methods · Quantitative Biology 2022-11-08 Oscar Méndez-Lucio , Christos Nicolaou , Berton Earnshaw

The detailed analysis of molecular structures and properties holds great potential for drug development discovery through machine learning. Developing an emergent property in the model to understand molecules would broaden the horizons for…

We address the task of controlled generation of small molecules, which entails finding novel molecules with desired properties under certain constraints (e.g., similarity to a reference molecule). Here we introduce MolMIM, a probabilistic…

Machine Learning · Computer Science 2023-03-31 Danny Reidenbach , Micha Livne , Rajesh K. Ilango , Michelle Gill , Johnny Israeli

We report a method to convert discrete representations of molecules to and from a multidimensional continuous representation. This model allows us to generate new molecules for efficient exploration and optimization through open-ended…

Language models demonstrate fundamental abilities in syntax, semantics, and reasoning, though their performance often depends significantly on the inputs they process. This study introduces TSIS (Simplified TSID) and its variants:TSISD…

Artificial Intelligence · Computer Science 2024-11-19 Juan-Ni Wu , Tong Wang , Li-Juan Tang , Hai-Long Wu , Ru-Qin Yu

Computational methods are useful in accelerating the pace of drug discovery. Drug discovery carries several steps such as target identification and validation, lead discovery, and lead optimisation etc., In the phase of lead optimisation,…

Machine Learning · Computer Science 2024-08-31 K. Venkateswara Rao , Kunjam Nageswara Rao , G. Sita Ratnam

Foundation models have revolutionized natural language processing and artificial intelligence, significantly enhancing how machines comprehend and generate human languages. Inspired by the success of these foundation models, researchers…

Molecule and text representation learning has gained increasing interest due to its potential for enhancing the understanding of chemical information. However, existing models often struggle to capture subtle differences between molecules…

Machine Learning · Computer Science 2025-10-31 Hyuntae Park , Yeachan Kim , SangKeun Lee

Molecular language modeling tasks such as molecule captioning have been recognized for their potential to further understand molecular properties that can aid drug discovery or material synthesis based on chemical reactions. Unlike the…

Machine Learning · Computer Science 2025-03-12 Sangyeup Kim , Nayeon Kim , Yinhua Piao , Sun Kim

The mathematical representation of semantics is a key issue for Natural Language Processing (NLP). A lot of research has been devoted to finding ways of representing the semantics of individual words in vector spaces. Distributional…

Computation and Language · Computer Science 2014-11-13 Karl Moritz Hermann