English
Related papers

Related papers: MatMMFuse: Multi-Modal Fusion model for Material P…

200 papers

There has been a recent surge of interest in using machine learning to approximate density functional theory (DFT) in materials science. However, many of the most performant models are evaluated on large databases of computed properties of,…

Materials Science · Physics 2021-07-02 Filip Ekström , Rickard Armiento , Fredrik Lindsten

In this work we propose simple, effective and computationally efficient transfer learning approaches for structure-property relation predictions in the context of materials, with highly informative input from different modalities. As…

Materials Science · Physics 2024-12-11 Dario Massa , Grzegorz Kaszuba , Stefanos Papanikolaou , Piotr Sankowski

Metal-organic frameworks (MOFs) have emerged as promising materials for various applications due to their unique structural properties and versatile functionalities. This study presents a comprehensive investigation of machine learning…

Machine Learning · Computer Science 2025-07-08 Zhuo Zheng , Keyan Liu , Xiyuan Zhu

In condensed matter physics and materials science, predicting material properties necessitates understanding intricate many-body interactions. Conventional methods such as density functional theory (DFT) and molecular dynamics (MD) often…

Materials Science · Physics 2023-11-17 Lalit Yadav

Predicting material properties base on micro structure of materials has long been a challenging problem. Recently many deep learning methods have been developed for material property prediction. In this study, we propose a crystal…

Materials Science · Physics 2022-11-22 Xiangrui Yang

The prediction of crystal properties is essential for understanding structure-property relationships and accelerating the discovery of functional materials. However, conventional approaches relying on experimental measurements or density…

Materials Science · Physics 2025-06-24 Changwen Xu , Shang Zhu , Venkatasubramanian Viswanathan

Fine-tuning vision-language models (VLMs) such as CLIP often leads to catastrophic forgetting of pretrained knowledge. Prior work primarily aims to mitigate forgetting during adaptation; however, forgetting often remains inevitable during…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Wenqing Wang , Da Li , Xiatian Zhu , Josef Kittler

Machine learning has revolutionized materials design, yet predicting complex properties like alloy ductility remains challenging due to the influence of processing conditions and microstructural features that resist quantification through…

Materials Science · Physics 2025-06-17 Yongqian Peng , Zhouran Zhang , Longhui Zhang , Fengyuan Zhao , Yahao Li , Yicong Ye , Shuxin Bai

A very active area of materials research is to devise methods that use machine learning to automatically extract predictive models from existing materials data. While prior examples have demonstrated successful models for some applications,…

Materials Science · Physics 2016-08-29 Logan Ward , Ankit Agrawal , Alok Choudhary , Christopher Wolverton

Machine-learned force fields (MLFFs) promise to offer a computationally efficient alternative to ab initio simulations for complex molecular systems. However, ensuring their generalizability beyond training data is crucial for their wide…

Machine Learning · Computer Science 2024-12-24 Shaswat Mohanty , Yifan Wang , Wei Cai

Characterizing materials using electron micrographs is crucial in areas such as semiconductors and quantum materials. Traditional classification methods falter due to the intricatestructures of these micrographs. This study introduces an…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Sakhinana Sagar Srinivas , Geethan Sannidhi , Sreeja Gangasani , Chidaksh Ravuru , Venkataramana Runkana

With the proliferation of multi-modal data in large-scale visual recognition systems, enabling models to continuously acquire knowledge from evolving data streams while preserving prior information has become increasingly critical.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Juncen Guo , Siao Liu , Xiaoguang Zhu , Lianlong Sun , Liangyu Teng , Jingyi Wu , Di Li , Linxiao Gong , Weiwei Jiang , Wei Zhou , Liang Song

Material representations that are compatible with machine learning models play a key role in developing models that exhibit high accuracy for property prediction. Atomic orbital interactions are one of the important factors that govern the…

In late fusion, each modality is processed in a separate unimodal Convolutional Neural Network (CNN) stream and the scores of each modality are fused at the end. Due to its simplicity late fusion is still the predominant approach in many…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Hamid Reza Vaezi Joze , Amirreza Shaban , Michael L. Iuzzolino , Kazuhito Koishida

Metal-organic frameworks (MOFs) are porous crystalline materials with broad applications such as carbon capture and drug delivery, yet accurately predicting their 3D structures remains a significant challenge. While Large Language Models…

Machine Learning · Computer Science 2026-01-15 Mianzhi Pan , JianFei Li , Peishuo Liu , Botian Wang , Yawen Ouyang , Yiming Rong , Hao Zhou , Jianbing Zhang

Multimodal image fusion (MMIF) integrates information from different modalities to obtain a comprehensive image, aiding downstream tasks. However, existing research focuses on complementary information fusion and training strategies,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Dan He , Guofen Wang , Weisheng Li , Yucheng Shu , Wenbo Li , Lijian Yang , Yuping Huang , Feiyan Li

Multi-modal image fusion (MMIF) maps useful information from various modalities into the same representation space, thereby producing an informative fused image. However, the existing fusion algorithms tend to symmetrically fuse the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jingxue Huang , Xilai Li , Tianshu Tan , Xiaosong Li , Tao Ye

Machine Learning (ML) is accelerating the progress of materials prediction and classification, with particular success in CGNN designs. While classical ML methods remain accessible, advanced deep networks are still challenging to build and…

Other Condensed Matter · Physics 2025-02-04 Gavin Nop , Micah Mundy , Durga Paudyal , Jonathan Smith

Understanding material failure is critical for designing stronger and lighter structures by identifying weaknesses that could be mitigated. Existing full-physics numerical simulation techniques involve trade-offs between speed, accuracy,…

This study presents a novel multimodal fusion model for three-dimensional mineral prospectivity mapping (3D MPM), effectively integrating structural and fluid information through a deep network architecture. Leveraging Convolutional Neural…

Machine Learning · Computer Science 2023-10-10 Yang Zheng , Hao Deng , Ruisheng Wang , Jingjie Wu