English
Related papers

Related papers: FARM: Enhancing Molecular Representations with Fun…

200 papers

Generalized additive models (GAMs) offer interpretability through independent univariate feature effects but underfit when interactions are present in data. GA$^2$Ms add selected pairwise interactions which improves accuracy, but sacrifices…

Understanding molecular structure and related knowledge is crucial for scientific research. Recent studies integrate molecular graphs with their textual descriptions to enhance molecular representation learning. However, they focus on the…

Artificial Intelligence · Computer Science 2025-06-02 Yibo Li , Yuan Fang , Mengmei Zhang , Chuan Shi

We present Graph Foundation Models (GFMs) which have made significant progress in various tasks, but their robustness against domain noise, structural perturbations, and adversarial attacks remains underexplored. A key limitation is the…

Machine Learning · Computer Science 2026-03-11 Junhua Shi , Qingyun Sun , Haonan Yuan , Xingcheng Fu

Atomistic foundation models (AFMs) have great promise as accurate interatomic potentials, and have enabled data-efficient molecular dynamics simulations with near quantum mechanical accuracy. However, AFMs remain markedly slower at…

Materials Science · Physics 2025-09-29 Lingyu Kong , Jaeheon Shim , Guoxiang Hu , Victor Fung

Molecular representation learning is a crucial task in predicting molecular properties. Molecules are often modeled as graphs where atoms and chemical bonds are represented as nodes and edges, respectively, and Graph Neural Networks (GNNs)…

Machine Learning · Computer Science 2023-05-23 Jiahao Chen , Yurou Liu , Jiangmeng Li , Bing Su , Jirong Wen

We propose Medial Atom Ray Fields (MARFs), a novel neural object representation that enables accurate differentiable surface rendering with a single network evaluation per camera ray. Existing neural ray fields struggle with multi-view…

Graphics · Computer Science 2023-07-04 Peder Bergebakken Sundt , Theoharis Theoharis

Due to the widespread use of complex machine learning models in real-world applications, it is becoming critical to explain model predictions. However, these models are typically black-box deep neural networks, explained post-hoc via…

Machine Learning · Computer Science 2022-10-20 Filip Radenovic , Abhimanyu Dubey , Dhruv Mahajan

Translating natural language questions into SPARQL queries enables Knowledge Base querying for factual and up-to-date responses. However, existing datasets for this task are predominantly template-based, leading models to learn superficial…

Computation and Language · Computer Science 2025-03-31 Papa Abdou Karim Karou Diallo , Amal Zouaq

Many predictive tasks of web applications need to model categorical variables, such as user IDs and demographics like genders and occupations. To apply standard machine learning techniques, these categorical predictors are always converted…

Machine Learning · Computer Science 2017-08-18 Xiangnan He , Tat-Seng Chua

Recent advancements in machine learning (ML) and deep learning (DL), particularly through the introduction of Foundation Models (FMs), have significantly enhanced surgical scene understanding within minimally invasive surgery (MIS). This…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ufaq Khan , Umair Nawaz , Adnan Qayyum , Shazad Ashraf , Yutong Xie , Muhammad Haris Khan , Muhammad Bilal , Junaid Qadir

Molecular representation learning contributes to multiple downstream tasks such as molecular property prediction and drug design. To properly represent molecules, graph contrastive learning is a promising paradigm as it utilizes…

Machine Learning · Computer Science 2022-03-14 Yin Fang , Qiang Zhang , Haihong Yang , Xiang Zhuang , Shumin Deng , Wen Zhang , Ming Qin , Zhuo Chen , Xiaohui Fan , Huajun Chen

Molecular representations fundamentally shape how machine learning systems reason about molecular structure and physical properties. Most existing approaches adopt a discrete pipeline: molecules are encoded as sequences, graphs, or point…

Multimodal foundation models have significantly improved feature representation by integrating information from multiple modalities, making them highly suitable for a broader set of applications. However, the exploration of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaiwen Zheng , Xuri Ge , Junchen Fu , Jun Peng , Joemon M. Jose

Machine learning, and representation learning in particular, has the potential to facilitate drug discovery by screening a large chemical space in silico. A successful approach for representing molecules is to treat them as a graph and…

Chemical Physics · Physics 2023-10-06 Ronen Taub , Yonatan Savir

Recent advances in Wireless Physical Layer Foundation Models (WPFMs) promise a new paradigm of universal Radio Frequency (RF) representations. However, these models inherit critical limitations found in deep learning such as the lack of…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Jaron Fontaine , Mohammad Cheraghinia , John Strassner , Adnan Shahid , Eli De Poorter

Molecular property prediction is a critical task in computational drug discovery. While recent advances in Graph Neural Networks (GNNs) and Transformers have shown to be effective and promising, they face the following limitations:…

Deep Learning has revolutionized machine learning, reaching unprecedented levels of accuracy, but at the cost of reduced interpretability. Especially in image processing systems, deep networks transform local pixel information into more…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xinyi Zhang , Manuel Günther

While interpretability is crucial for machine learning applications in safety-critical domains and for regulatory compliance, existing tabular foundation models like TabPFN lack transparency. Generalized Additive Models (GAMs) provide the…

Machine Learning · Computer Science 2026-02-06 Andreas Mueller , Julien Siems , Harsha Nori , David Salinas , Arber Zela , Rich Caruana , Frank Hutter

Facial micro-expressions, characterized by their subtle and brief nature, are valuable indicators of genuine emotions. Despite their significance in psychology, security, and behavioral analysis, micro-expression recognition remains…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Luu Tu Nguyen , Vu Tram Anh Khuong , Thi Bich Phuong Man , Thi Duyen Ngo , Thanh Ha Le

Recent research in molecular discovery has primarily been devoted to small, drug-like molecules, leaving many similarly important applications in material design without adequate technology. These applications often rely on more complex…