English
Related papers

Related papers: Information Routing in Atomistic Foundation Models…

200 papers

Leveraging ab initio data at scale has enabled the development of machine learning models capable of extremely accurate and fast molecular property prediction. A central paradigm of many previous works focuses on generating predictions for…

Computational Physics · Physics 2022-11-30 Kirill Shmilovich , Devin Willmott , Ivan Batalov , Mordechai Kornbluth , Jonathan Mailoa , J. Zico Kolter

Probabilistic graphical models that encode indistinguishable objects and relations among them use first-order logic constructs to compress a propositional factorised model for more efficient (lifted) inference. To obtain a lifted…

Artificial Intelligence · Computer Science 2025-09-01 Jan Speller , Malte Luttermann , Marcel Gehrke , Tanya Braun

Machine Learning (ML) techniques are revolutionizing the way to perform efficient materials modeling. Nevertheless, not all the ML approaches allow for the understanding of microscopic mechanisms at play in different phenomena. To address…

Materials Science · Physics 2022-06-22 Udaykumar Gajera , Loriano Storchi , Danila Amoroso , Francesco Delodovici , Silvia Picozzi

Cross-project defect prediction (CPDP) has been deemed as an emerging technology of software quality assurance, especially in new or inactive projects, and a few improved methods have been proposed to support better defect prediction.…

Software Engineering · Computer Science 2014-11-18 Peng He , Bing Li , Yutao Ma

We show that the information gained in spectroscopic experiments regarding the number and distribution of atomic environments can be used as a valuable constraint in the refinement of the atomic-scale structures of nanostructured or…

Materials Science · Physics 2015-05-14 Matthew J Cliffe , Martin T. Dove , D. A. Drabold , Andrew L. Goodwin

In this paper we propose an efficient deep learning encoder-decoder network for performing Harmonic-Percussive Source Separation (HPSS). It is shown that we are able to greatly reduce the number of model trainable parameters by using a…

Sound · Computer Science 2019-07-31 Carlos Lordelo , Emmanouil Benetos , Simon Dixon , Sven Ahlbäck

The high-throughput screening of periodic inorganic solids using machine learning methods requires atomic positions to encode structural and compositional details into appropriate material descriptors. These atomic positions are not…

Materials Science · Physics 2018-12-26 Ankit Jain , Thomas Bligaard

Model order estimation (MOE) is often a pre-requisite for Direction of Arrival (DoA) estimation. Due to limits imposed by array geometry, it is typically not possible to estimate spatial parameters for an arbitrary number of sources; an…

Signal Processing · Electrical Eng. & Systems 2022-09-05 Jianyuan Yu , William W. Howard , Yue Xu , R. Michael Buehrer

Language models (LMs) can perform complex reasoning either end-to-end, with hidden latent state, or compositionally, with transparent intermediate state. Composition offers benefits for interpretability and safety, but may need workflow…

Computation and Language · Computer Science 2023-01-06 Justin Reppert , Ben Rachbach , Charlie George , Luke Stebbing , Jungwon Byun , Maggie Appleton , Andreas Stuhlmüller

The use of machine learning is becoming increasingly common in computational materials science. To build effective models of the chemistry of materials, useful machine-based representations of atoms and their compounds are required. We…

Materials Science · Physics 2021-08-02 Luis M. Antunes , Ricardo Grau-Crespo , Keith T. Butler

Exploration of structure-property relationships as a function of dopant concentration is commonly based on mean field theories for solid solutions. However, such theories that work well for semiconductors tend to fail in materials with…

Instant machine learning predictions of molecular properties are desirable for materials design, but the predictive power of the methodology is mainly tested on well-known benchmark datasets. Here, we investigate the performance of machine…

A striking geometric disparity has long persisted in the practice of deep learning. While modern neural network architectures naturally exhibit rich symmetry and equivariance properties, popular optimizers such as Adam and its variants…

Optimization and Control · Mathematics 2026-05-27 Tim Tsz-Kit Lau , Weijie Su

A molecule is a complex of heterogeneous components, and the spatial arrangements of these components determine the whole molecular properties and characteristics. With the advent of deep learning in computational chemistry, several studies…

Machine Learning · Computer Science 2021-06-15 Jeonghee Jo , Bumju Kwak , Byunghan Lee , Sungroh Yoon

To characterize the complex higher-order interactions among variables within a system, this study introduces a novel framework, termed System Information Decomposition (SID), aimed at decomposing the information entropy of variables into…

Information Theory · Computer Science 2024-11-12 Aobo Lyu , Bing Yuan , Ou Deng , Mingzhe Yang , Jiang Zhang

Extraction of structure, in particular of group symmetries, is increasingly crucial to understanding and building intelligent models. In particular, some information-theoretic models of parsimonious learning have been argued to induce…

Information Theory · Computer Science 2025-07-08 Hippolyte Charvin , Nicola Catenacci Volpi , Daniel Polani

We establish the link between Mathematical Morphology and the map of Asplund's distances between a probe and a grey scale function, using the Logarithmic Image Processing scalar multiplication. We demonstrate that the map is the logarithm…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Guillaume Noyel , Michel Jourlin

Most machine learning models for molecular property prediction rely on a single molecular representation (either a sequence, a graph, or a 3D structure) and treat molecular geometry as static. We present MolFM-Lite, a multi-modal model that…

Neural responses encode information that is useful for a variety of downstream tasks. A common approach to understand these systems is to build regression models or ``decoders'' that reconstruct features of the stimulus from neural…

Machine Learning · Statistics 2024-11-14 Sarah E. Harvey , David Lipshutz , Alex H. Williams

Embodied trajectories, such as the executable motion sequences of robotic manipulators, underwater vehicles, and mobile robots, are a fundamental output of embodied AI. Modern generative models often treat them as a dense, monolithic signal…

Robotics · Computer Science 2026-05-25 Yan Tang , Yuanbo Tang , Tingyu Cao , Shaolun Huang , Yang Li