English
Related papers

Related papers: Augmenting Molecular Images with Vector Representa…

200 papers

AI models for drug discovery and chemical literature mining must interpret molecular images and generate outputs consistent with 3D geometry and stereochemistry. Most molecular language models rely on strings or graphs, while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Jing Lan , Hexiao Ding , Hongzhao Chen , Yufeng Jiang , Nga-Chun Ng , Gwing Kei Yip , Gerald W. Y. Cheng , Yunlin Mao , Jing Cai , Liang-ting Lin , Jung Sun Yoo

Classification with a large number of classes is a key problem in machine learning and corresponds to many real-world applications like tagging of images or textual documents in social networks. If one-vs-all methods usually reach top…

Machine Learning · Computer Science 2019-06-25 Thomas Gerald , Aurélia Léon , Nicolas Baskiotis , Ludovic Denoyer

Multimodal emotion recognition (MER) aims to identify human emotions by combining data from various modalities such as language, audio, and vision. Despite the recent advances of MER approaches, the limitations in obtaining extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yehun Song , Sunyoung Cho

We introduce a family of positive definite kernels specifically optimized for the manipulation of 3D structures of molecules with kernel methods. The kernels are based on the comparison of the three-points pharmacophores present in the 3D…

Quantitative Methods · Quantitative Biology 2016-08-16 Pierre Mahé , Liva Ralaivola , Véronique Stoven , Jean-Philippe Vert

Text contained in an image carries high-level semantics that can be exploited to achieve richer image understanding. In particular, the mere presence of text provides strong guiding content that should be employed to tackle a diversity of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Andres Mafla , Sounak Dey , Ali Furkan Biten , Lluis Gomez , Dimosthenis Karatzas

Most approaches to human attribute and action recognition in still images are based on image representation in which multi-scale local features are pooled across scale into a single, scale-invariant encoding. Both in bag-of-words and the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Fahad Shahbaz Khan , Joost van de Weijer , Rao Muhammad Anwer , Andrew D. Bagdanov , Michael Felsberg , Jorma Laaksonen

Recent advancements in multimodal pre-training models have significantly advanced computational pathology. However, current approaches predominantly rely on visual-language models, which may impose limitations from a molecular perspective…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Minghao Han , Dingkang Yang , Jiabei Cheng , Xukun Zhang , Linhao Qu , Zizhi Chen , Lihua Zhang

Chronic wounds are a significant burden on individuals and the healthcare system, affecting millions of people and incurring high costs. Wound classification using deep learning techniques is a promising approach for faster diagnosis and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Harini Narayanan , Sindhu Ghanta

Expression of human epidermal growth factor receptor 2 (HER2) is an important biomarker in breast cancer patients who can benefit from cost-effective automatic Hematoxylin and Eosin (H\&E) HER2 scoring. However, developing such scoring…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Rawan S. Abdulsadig , Bryan M. Williams , Nikolay Burlutskiy

Preliminary diagnosis of fungal infections can rely on microscopic examination. However, in many cases, it does not allow unambiguous identification of the species by microbiologist due to their visual similarity. Therefore, it is usually…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Bartosz Zieliński , Agnieszka Sroka-Oleksiak , Dawid Rymarczyk , Adam Piekarczyk , Monika Brzychczy-Włoch

This paper proposes a novel method of classifying malware into families using high-resolution greyscale images and multiple instance learning to overcome adversarial binary enlargement. Current methods of visualisation-based malware…

Cryptography and Security · Computer Science 2023-11-22 Tim Peters , Hikmat Farhat

We investigate whether synthetic images generated by diffusion models can enhance multi-label classification of protein subcellular localization. Specifically, we implement a simplified class-conditional denoising diffusion probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sylvey Lin , Zhi-Yi Cao

The generation of drug-like molecules is crucial for drug design. Existing reinforcement learning (RL) methods often overlook structural information. However, feature engineering-based methods usually merely focus on binding affinity…

Machine Learning · Computer Science 2024-11-25 Xiangyu Zhang

Hypergraphs model higher-order relations that drive real-world decisions, from drug prescriptions to recommendations. A central structural signal in such data, beyond what pairwise relations can express, is interaction compositionality:…

Machine Learning · Computer Science 2026-05-19 Kyrie Zhao , Zehong Wang , Tianyi Ma , Fang Wu , Xiangru Tang , Pietro Lio , Sheng Wang , Yanfang Ye

Modern malware evolves various detection avoidance techniques to bypass the state-of-the-art detection methods. An emerging trend to deal with this issue is the combination of image transformation and machine learning techniques to classify…

Cryptography and Security · Computer Science 2019-09-17 Duc-Ly Vu , Trong-Kha Nguyen , Tam V. Nguyen , Tu N. Nguyen , Fabio Massacci , Phu H. Phung

Recently, there has been a surge of interest in extending the success of large language models (LLMs) from texts to molecules. Most existing approaches adopt a graph neural network to represent a molecule as a series of node tokens for…

Computation and Language · Computer Science 2025-06-09 Yongqiang Chen , Quanming Yao , Juzheng Zhang , James Cheng , Yatao Bian

Molecular representation learning plays an essential role in cheminformatics. Recently, language model-based approaches have gained popularity as an alternative to traditional expert-designed features to encode molecules. However, these…

Machine Learning · Computer Science 2022-04-19 Zhihui Guo , Pramod Sharma , Andy Martinez , Liang Du , Robin Abraham

High-throughput drug screening -- using cell imaging or gene expression measurements as readouts of drug effect -- is a critical tool in biotechnology to assess and understand the relationship between the chemical structure and biological…

Machine Learning · Computer Science 2023-12-04 Chenyu Wang , Sharut Gupta , Caroline Uhler , Tommi Jaakkola

Machine learning models have found numerous successful applications in computational drug discovery. A large body of these models represents molecules as sequences since molecular sequences are easily available, simple, and informative. The…

Masked image modelling (MIM) is a powerful self-supervised representation learning paradigm, whose potential has not been widely demonstrated in medical image analysis. In this work, we show the capacity of MIM to capture rich semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Piotr Wójcik , Hussein Naji , Adrian Simon , Reinhard Büttner , Katarzyna Bożek