English
Related papers

Related papers: LiteGEM: Lite Geometry Enhanced Molecular Represen…

200 papers

We present MIX'EM, a novel solution for unsupervised image classification. MIX'EM generates representations that by themselves are sufficient to drive a general-purpose clustering algorithm to deliver high-quality classification. This is…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Ali Varamesh , Tinne Tuytelaars

Molecular representation learning plays a crucial role in AI-assisted drug discovery research. Encoding 3D molecular structures through Euclidean neural networks has become the prevailing method in the geometric deep learning community.…

Machine Learning · Computer Science 2023-03-29 Yiqun Wang , Yuning Shen , Shi Chen , Lihao Wang , Fei Ye , Hao Zhou

Accurately predicting protein-ligand binding free energies (BFEs) remains a central challenge in drug discovery, particularly because the most reliable methods, such as free energy perturbation (FEP), are computationally intensive and…

Chemical Physics · Physics 2025-12-09 Farzad Molani , Art E. Cho

Weight-only quantization is widely used to mitigate the memory-bound nature of LLM inference. Codebook-based methods extend this trend by achieving strong accuracy in the extremely low-bit regime (e.g., 2-bit). However, current kernels rely…

Machine Learning · Computer Science 2025-12-23 Gunho Park , Jeongin Bae , Byeongwook Kim , Baeseong park , Jiwon Ryu , Hoseung Kim , Se Jung Kwon , Dongsoo Lee

Current climate models often struggle with accuracy because they lack sufficient resolution, a limitation caused by computational constraints. This reduces the precision of weather forecasts and long-term climate predictions. To address…

Atmospheric and Oceanic Physics · Physics 2024-10-03 Adib Bazgir , Yuwen Zhang

Accurate financial volatility forecasting is crucial but challenged by the non-linear, highly correlated nature of market data. Recently, quantum computing has emerged as a promising paradigm for solving complex high-dimensional sampling…

Machine Learning · Computer Science 2026-05-07 Yixiong Chen

In recent times, the emergence of Large Language Models (LLMs) has resulted in increasingly larger model size, posing challenges for inference on low-resource devices. Prior approaches have explored offloading to facilitate low-memory…

Performance · Computer Science 2024-03-05 Xuanlei Zhao , Bin Jia , Haotian Zhou , Ziming Liu , Shenggan Cheng , Yang You

In hierarchal order of molecular geometry, we compare the performances of Geometric Quantum Machine Learning models. Two molecular datasets are considered: the simplistic linear shaped LiH-molecule and the trigonal pyramidal molecule NH3.…

Machine Learning · Computer Science 2025-12-08 Saumya Biswas , Jiten Oswal

The prediction of absorption, distribution, metabolism, excretion, and toxicity (ADMET) of small molecules from their molecular structure is a central problem in medicinal chemistry with great practical importance in drug discovery.…

Quantization of Large Language Models (LLMs) has recently gained popularity, particularly for on-device settings with limited hardware resources. While efficient, quantization inevitably degrades model quality, especially in aggressive…

Machine Learning · Computer Science 2025-06-25 Yeonhong Park , Jake Hyun , Hojoon Kim , Jae W. Lee

Pretraining molecular representations is crucial for drug and material discovery. Recent methods focus on learning representations from geometric structures, effectively capturing 3D position information. Yet, they overlook the rich…

Machine Learning · Computer Science 2024-11-19 Teng Xiao , Chao Cui , Huaisheng Zhu , Vasant G. Honavar

In the wheat nutrient deficiencies classification challenge, we present the DividE and EnseMble (DEEM) method for progressive test data predictions. We find that (1) test images are provided in the challenge; (2) samples are equipped with…

Accurate prognosis for Glioblastoma (GBM) using deep learning (DL) is hindered by extreme spatial and structural heterogeneity. Moreover, inconsistent MRI acquisition protocols across institutions hinder generalizability of models.…

Machine Learning · Computer Science 2026-02-13 Ankita Paul , Wenyi Wang

We propose DenseHMM - a modification of Hidden Markov Models (HMMs) that allows to learn dense representations of both the hidden states and the observables. Compared to the standard HMM, transition probabilities are not atomic but composed…

Machine Learning · Computer Science 2020-12-18 Joachim Sicking , Maximilian Pintz , Maram Akila , Tim Wirtz

Real-time decoding of quantum error correction (QEC) is essential for enabling fault-tolerant quantum computation. A practical decoder must operate with high accuracy at low latency, while remaining robust to spatial and temporal variations…

Quantum Physics · Physics 2026-01-23 Samuel Stein , Shuwen Kan , Chenxu Liu , Adrian Harkness , Sean Garner , Zefan Du , Yufei Ding , Ying Mao , Ang Li

Designing a neural network architecture for molecular representation is crucial for AI-driven drug discovery and molecule design. In this work, we propose a new framework for molecular representation learning. Our contribution is threefold:…

Machine Learning · Computer Science 2022-10-18 Jiye Kim , Seungbeom Lee , Dongwoo Kim , Sungsoo Ahn , Jaesik Park

Large Language Model (LLM) inference becomes resource-intensive, prompting a shift toward low-bit model weights to reduce the memory footprint and improve efficiency. Such low-bit LLMs necessitate the mixed-precision matrix multiplication…

Hardware Architecture · Computer Science 2025-07-29 Zhiwen Mo , Lei Wang , Jianyu Wei , Zhichen Zeng , Shijie Cao , Lingxiao Ma , Naifeng Jing , Ting Cao , Jilong Xue , Fan Yang , Mao Yang

Recent advances in self-supervised learning and the Transformer architecture have significantly improved natural language processing (NLP), achieving remarkably low perplexity. However, the growing size of NLP models introduces a memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-02 Gunho Park , Baeseong Park , Minsub Kim , Sungjae Lee , Jeonghoon Kim , Beomseok Kwon , Se Jung Kwon , Byeongwook Kim , Youngjoo Lee , Dongsoo Lee

Masked image modelling (MIM) is a powerful self-supervised representation learning paradigm, whose potential has not been widely demonstrated in medical image analysis. In this work, we show the capacity of MIM to capture rich semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Piotr Wójcik , Hussein Naji , Adrian Simon , Reinhard Büttner , Katarzyna Bożek

With the recent advances in machine learning for quantum chemistry, it is now possible to predict the chemical properties of compounds and to generate novel molecules. Existing generative models mostly use a string- or graph-based…

Biomolecules · Quantitative Biology 2020-10-14 Vitali Nesterov , Mario Wieser , Volker Roth