English
Related papers

Related papers: Image-to-Graph Transformers for Chemical Structure…

200 papers

Since the advent of deep convolutional neural networks (DNNs), computer vision has seen an extremely rapid progress that has led to huge advances in medical imaging. This article does not aim to cover all aspects of the field but focuses on…

Medical Physics · Physics 2019-06-11 Shizuo Kaji , Satoshi Kida

Machine learning (ML) can be used to construct surrogate models for the fast prediction of a property of interest. ML can thus be applied to chemical projects, where the usual experimentation or calculation techniques can take hours or days…

In the intersection of molecular science and deep learning, tasks like virtual screening have driven the need for a high-throughput molecular representation generator on large chemical databases. However, as SMILES strings are the most…

Computational Engineering, Finance, and Science · Computer Science 2021-12-28 Wenhao Zhu , Ziyao Li , Lingsheng Cai , Guojie Song

One-dimensional NMR spectroscopy is one of the most widely used techniques for the characterization of organic compounds and natural products. For molecules with up to 36 non-hydrogen atoms, the number of possible structures has been…

Optical chemical structure recognition (OCSR) systems aim to extract the molecular structure information, usually in the form of molecular graph or SMILES, from images of chemical molecules. While many tools have been developed for this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Ching Ting Leung , Yufan Chen , Hanyu Gao

Generating molecular graphs with desired chemical properties driven by deep graph generative models provides a very promising way to accelerate drug discovery process. Such graph generative models usually consist of two steps: learning…

Machine Learning · Statistics 2020-06-19 Chengxi Zang , Fei Wang

In recent years, Large Language Models (LLMs) have achieved significant success in natural language processing (NLP) and various interdisciplinary areas. However, applying LLMs to chemistry is a complex task that requires specialized domain…

Machine Learning · Computer Science 2024-02-05 Chang Liao , Yemin Yu , Yu Mei , Ying Wei

Supervised learning on molecules has incredible potential to be useful in chemistry, drug discovery, and materials science. Luckily, several promising and closely related neural network models invariant to molecular symmetries have already…

Machine Learning · Computer Science 2017-06-14 Justin Gilmer , Samuel S. Schoenholz , Patrick F. Riley , Oriol Vinyals , George E. Dahl

Object detection in documents is a key step to automate the structural elements identification process in a digital or scanned document through understanding the hierarchical structure and relationships between different elements. Large and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Ayan Banerjee , Sanket Biswas , Josep Lladós , Umapada Pal

Contemporary graph learning algorithms are not well-defined for large molecules since they do not consider the hierarchical interactions among the atoms, which are essential to determine the molecular properties of macromolecules. In this…

Machine Learning · Computer Science 2023-08-02 Nhat Khang Ngo , Truong Son Hy , Risi Kondor

Machine learning in drug discovery has been focused on virtual screening of molecular libraries using discriminative models. Generative models are an entirely different approach that learn to represent and optimize molecules in a continuous…

Quantitative Methods · Quantitative Biology 2020-11-17 Matthew Ragoza , Tomohide Masuda , David Ryan Koes

Procuring expressive molecular representations underpins AI-driven molecule design and scientific discovery. The research mainly focuses on atom-level homogeneous molecular graphs, ignoring the rich information in subgraphs or motifs.…

Quantitative Methods · Quantitative Biology 2023-01-10 Fang Wu , Dragomir Radev , Stan Z. Li

The ability to describe images with natural language sentences is the hallmark for image and language understanding. Such a system has wide ranging applications such as annotating images and using natural sentences to search for images.In…

Machine Learning · Computer Science 2016-01-15 Afroze Ibrahim Baqapuri

Image segmentation is a key topic in image processing and computer vision with applications such as scene understanding, medical image analysis, robotic perception, video surveillance, augmented reality, and image compression, among many…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Shervin Minaee , Yuri Boykov , Fatih Porikli , Antonio Plaza , Nasser Kehtarnavaz , Demetri Terzopoulos

There is increasing adoption of artificial intelligence in drug discovery. However, existing studies use machine learning to mainly utilize the chemical structures of molecules but ignore the vast textual knowledge available in chemistry.…

Machine Learning · Computer Science 2024-01-31 Shengchao Liu , Weili Nie , Chengpeng Wang , Jiarui Lu , Zhuoran Qiao , Ling Liu , Jian Tang , Chaowei Xiao , Anima Anandkumar

Vision-Language Models (VLMs) have demonstrated remarkable performance across a variety of real-world tasks. However, existing VLMs typically process visual information by serializing images, a method that diverges significantly from the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yueyan Li , Chenggong Zhao , Zeyuan Zang , Caixia Yuan , Xiaojie Wang

Most of the knowledge in materials science literature is in the form of unstructured data such as text and images. Here, we present a framework employing natural language processing, which automates text and image comprehension and…

Digital Libraries · Computer Science 2021-01-06 Vineeth Venugopal , Sourav Sahoo , Mohd Zaki , Manish Agarwal , Nitya Nand Gosvami , N. M. Anoop Krishnan

Graphs serve as fundamental descriptors for systems composed of interacting elements, capturing a wide array of data types, from molecular interactions to social networks and knowledge graphs. In this paper, we present an exhaustive review…

Machine Learning · Computer Science 2024-11-13 Chenqing Hua

Interactive machine learning (IML) allows users to build their custom machine learning models without expert knowledge. While most existing IML systems are designed with classification algorithms, they sometimes oversimplify the…

Human-Computer Interaction · Computer Science 2024-04-16 Wataru Kawabe , Yusuke Sugano

Deep learning methods, in particular convolutional neural networks, have emerged as a powerful tool in medical image computing tasks. While these complex models provide excellent performance, their black-box nature may hinder real-world…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yuzhe Lu , Adam Perer