English
Related papers

Related papers: Context-enriched molecule representations improve …

200 papers

Despite the widespread success of deep learning, its intense requirements for vast amounts of data and extensive training make it impractical for various real-world applications where data is scarce. In recent years, Few-Shot Learning (FSL)…

Machine Learning · Computer Science 2025-01-27 Georgios Tsoumplekas , Vladislav Li , Panagiotis Sarigiannidis , Vasileios Argyriou

Activity and property prediction models are the central workhorses in drug discovery and materials sciences, but currently they have to be trained or fine-tuned for new tasks. Without training or fine-tuning, scientific language models…

Biomolecules · Quantitative Biology 2023-06-19 Philipp Seidl , Andreu Vall , Sepp Hochreiter , Günter Klambauer

Few-shot learning often involves metric learning-based classifiers, which predict the image label by comparing the distance between the extracted feature vector and class representations. However, applying global pooling in the backend of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Inyong Koo , Minki Jeong , Changick Kim

Although extensive research has been conducted on 3D point cloud segmentation, effectively adapting generic models to novel categories remains a formidable challenge. This paper proposes a novel approach to improve point cloud few-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zhenhua Ning , Zhuotao Tian , Guangming Lu , Wenjie Pei

With the continuous development of pre-trained language models, prompt-based training becomes a well-adopted paradigm that drastically improves the exploitation of models for many natural language processing tasks. Prompting also shows…

Computation and Language · Computer Science 2024-10-15 Quang Anh Nguyen , Nadi Tomeh , Mustapha Lebbah , Thierry Charnois , Hanene Azzag , Santiago Cordoba Muñoz

Deep-embedding methods aim to discover representations of a domain that make explicit the domain's class structure and thereby support few-shot learning. Disentangling methods aim to make explicit compositional or factorial structure. We…

Machine Learning · Computer Science 2018-05-22 Karl Ridgeway , Michael C. Mozer

Designing a neural network architecture for molecular representation is crucial for AI-driven drug discovery and molecule design. In this work, we propose a new framework for molecular representation learning. Our contribution is threefold:…

Machine Learning · Computer Science 2022-10-18 Jiye Kim , Seungbeom Lee , Dongwoo Kim , Sungsoo Ahn , Jaesik Park

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen

The effectiveness of prompt learning has been demonstrated in different pre-trained language models. By formulating suitable template and choosing representative label mapping, prompt learning can be used as an efficient knowledge probe.…

Computation and Language · Computer Science 2022-11-01 Jinta Weng , Yue Hu , Jing Qiu , Heyan Huan

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

Machine Learning · Computer Science 2019-10-04 Akihiro Nakamura , Tatsuya Harada

Few-shot segmentation is a task to segment objects or regions of novel classes within an image given only a few annotated examples. In the generalized setting, the task extends to segment both the base and the novel classes. The main…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Steve Andreas Immanuel , Hagai Raja Sinulingga

Few-Shot Relation Extraction aims at predicting the relation for a pair of entities in a sentence by training with a few labelled examples in each relation. Some recent works have introduced relation information (i.e., relation labels or…

Computation and Language · Computer Science 2022-05-20 Yang Liu , Jinpeng Hu , Xiang Wan , Tsung-Hui Chang

Aiming to incrementally learn new classes with only few samples while preserving the knowledge of base (old) classes, few-shot class-incremental learning (FSCIL) faces several challenges, such as overfitting and catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Junghun Oh , Sungyong Baik , Kyoung Mu Lee

In medical healthcare, obtaining detailed annotations is challenging, highlighting the need for robust Vision-Language Models (VLMs). Pretrained VLMs enable fine-tuning on small datasets or zero-shot inference, achieving performance…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Phuc Pham , Nhu Pham , Ngoc Quoc Ly

Molecule and text representation learning has gained increasing interest due to its potential for enhancing the understanding of chemical information. However, existing models often struggle to capture subtle differences between molecules…

Machine Learning · Computer Science 2025-10-31 Hyuntae Park , Yeachan Kim , SangKeun Lee

Advancements in cross-modal feature extraction and integration have significantly enhanced performance in few-shot learning tasks. However, current multi-modal object detection (MM-OD) methods often experience notable performance…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zeyu Shangguan , Daniel Seita , Mohammad Rostami

Deploying generative machine learning techniques to generate novel chemical structures based on molecular fingerprint representation has been well established in molecular design. Typically, sequential learning (SL) schemes such as hidden…

Biomolecules · Quantitative Biology 2022-04-07 Mohammad Sajjad Ghaemi , Karl Grantham , Isaac Tamblyn , Yifeng Li , Hsu Kiang Ooi

Few-shot node classification is tasked to provide accurate predictions for nodes from novel classes with only few representative labeled nodes. This problem has drawn tremendous attention for its projection to prevailing real-world…

Machine Learning · Computer Science 2022-12-13 Zhen Tan , Song Wang , Kaize Ding , Jundong Li , Huan Liu

With the rapid increase of compound databases available in medicinal and material science, there is a growing need for learning representations of molecules in a semi-supervised manner. In this paper, we propose an unsupervised hierarchical…

Machine Learning · Statistics 2017-11-30 Hai Nguyen , Shin-ichi Maeda , Kenta Oono

The ability to incrementally learn new classes from limited samples is crucial to the development of artificial intelligence systems for real clinical application. Although existing incremental learning techniques have attempted to address…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Hao Yang , Weijian Huang , Jiarun Liu , Cheng Li , Shanshan Wang