English
Related papers

Related papers: MMPolymer: A Multimodal Multitask Pretraining Fram…

200 papers

Many material properties are manifested in the morphological appearance and characterized with microscopic image, such as scanning electron microscopy (SEM). Polymer miscibility is a key physical quantity of polymer material and commonly…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Zhilong Liang , Zhenzhi Tan , Ruixin Hong , Wanli Ouyang , Jinying Yuan , Changshui Zhang

The Prognostics and Health Management Data Challenge (PHM) 2016 tracks the health state of components of a semiconductor wafer polishing process. The ultimate goal is to develop an ability to predict the measurement on the wafer surface…

Artificial Intelligence · Computer Science 2025-03-04 Kart-Leong Lim , Rahul Dutta

Plasticisers (PLs) are small additives commonly incorporated into polymer composites to enhance processability and improve mechanical properties. Their effectiveness depends heavily on their miscibility within the polymer melt, yet…

Soft Condensed Matter · Physics 2025-05-07 Lois Smith , Jessica Steele , Hossein Ali Karimi-Varzaneh , Paola Carbone

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Rapid determination of molecular structures can greatly accelerate workflows across many chemical disciplines. However, elucidating structure using only one-dimensional (1D) NMR spectra, the most readily accessible data, remains an…

Chemical Physics · Physics 2024-08-16 Frank Hu , Michael S. Chen , Grant M. Rotskoff , Matthew W. Kanan , Thomas E. Markland

Multimodal pre-training remains constrained by the descriptive bias of image-caption pairs, leading models to favor surface linguistic cues over grounded visual understanding. We introduce MMRPT, a masked multimodal reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xuhui Zheng , Kang An , Ziliang Wang , Yuhang Wang , Faqiang Qian , Yichao Wu

Previous vision-language pre-training models mainly construct multi-modal inputs with tokens and objects (pixels) followed by performing cross-modality interaction between them. We argue that the input of only tokens and object features…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Zejun Li , Zhihao Fan , Huaixiao Tou , Jingjing Chen , Zhongyu Wei , Xuanjing Huang

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

Learning robust and scalable visual representations from massive multi-view video data remains a challenge in computer vision and autonomous driving. Existing pre-training methods either rely on expensive supervised learning with 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Jialv Zou , Bencheng Liao , Qian Zhang , Wenyu Liu , Xinggang Wang

Antimicrobial resistance is one of the biggest health problem, especially in the current period of COVID-19 pandemic. Due to the unique membrane-destruction bactericidal mechanism, antimicrobial peptide-mimetic copolymers are paid more…

Biomolecules · Quantitative Biology 2022-12-09 Tianyu Wu , Yang Tang

Predicting multiple real-world tasks in a single model often requires a particularly diverse feature space. Multimodal (MM) models aim to extract the synergistic predictive potential of multiple data types to create a shared feature space…

Machine Learning · Computer Science 2023-11-07 Vinitra Swamy , Malika Satayeva , Jibril Frej , Thierry Bossy , Thijs Vogels , Martin Jaggi , Tanja Käser , Mary-Anne Hartley

Here, we demonstrate how machine learning enables the prediction of comonomers reactivity ratios based on the molecular structure of monomers. We combined multi-task learning, multi-inputs, and Graph Attention Network to build a model…

Machine Learning · Computer Science 2023-01-04 Tung Nguyen , Mona Bavarian

While traditional trial-and-error methods for designing amorphous alloys are costly and inefficient, machine learning approaches based solely on composition lack critical atomic structural information. Machine learning interatomic…

Materials Science · Physics 2025-08-19 Xuhe Gong , Hengbo Zhao , Xiao Fu , Jingchen Lian , Qifan Yang , Ran Li , Ruijuan Xiao , Tao Zhang , Hong Li

Masked point modeling has become a promising scheme of self-supervised pre-training for point clouds. Existing methods reconstruct either the original points or related features as the objective of pre-training. However, considering the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Qibo Qiu , Honghui Yang , Wenxiao Wang , Shun Zhang , Haiming Gao , Haochao Ying , Wei Hua , Xiaofei He

A very active area of materials research is to devise methods that use machine learning to automatically extract predictive models from existing materials data. While prior examples have demonstrated successful models for some applications,…

Materials Science · Physics 2016-08-29 Logan Ward , Ankit Agrawal , Alok Choudhary , Christopher Wolverton

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced performance on 2D visual tasks. However, improving their spatial intelligence remains a challenge. Existing 3D MLLMs always rely on additional 3D or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Diankun Wu , Fangfu Liu , Yi-Hsin Hung , Yueqi Duan

Chemists in search of structure-property relationships face great challenges due to limited high quality, concordant datasets. Machine learning (ML) has significantly advanced predictive capabilities in chemical sciences, but these modern…

Machine Learning · Computer Science 2025-09-18 Yulia Pimonova , Michael G. Taylor , Alice Allen , Ping Yang , Nicholas Lubbers

Parametric 3D models have enabled a wide variety of tasks in computer graphics and vision, such as modeling human bodies, faces, and hands. However, the construction of these parametric models is often tedious, as it requires heavy manual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Pablo Palafox , Aljaž Božič , Justus Thies , Matthias Nießner , Angela Dai

Predicting the rheological behavior of associative polymers bridging colloidal particles into transient networks is fundamentally challenging because the coupled spatiotemporal scales prevent efficient molecular-fidelity modeling. We…

Soft Condensed Matter · Physics 2026-02-17 Jalal Abdolahi , Dominic M. Robe , Ronald G. Larson , Elnaz Hajizadeh

In this work, we introduce a polymer discovery platform to efficiently design polymers with tailored properties, exemplified by the discovery of high-performance polymer electrolytes. The platform integrates three core components: a…

Chemical Physics · Physics 2025-04-04 Arash Khajeh , Xiangyun Lei , Weike Ye , Zhenze Yang , Daniel Schweigert , Ha-Kyung Kwon