English
Related papers

Related papers: Enhancing Spatial Reasoning in Large Language Mode…

200 papers

Proteins adopt multiple structural conformations to perform their diverse biological functions, and understanding these conformations is crucial for advancing drug discovery. Traditional physics-based simulation methods often struggle with…

Biomolecules · Quantitative Biology 2025-03-14 Jiarui Lu , Xiaoyin Chen , Stephen Zhewen Lu , Chence Shi , Hongyu Guo , Yoshua Bengio , Jian Tang

Multi-objective optimization problems (MOPs) are ubiquitous in real-world applications, presenting a complex challenge of balancing multiple conflicting objectives. Traditional evolutionary algorithms (EAs), though effective, often rely on…

Neural and Evolutionary Computing · Computer Science 2024-07-29 Yuxiao Huang , Shenghao Wu , Wenjie Zhang , Jibin Wu , Liang Feng , Kay Chen Tan

The computational discovery and design of new crystalline materials, particularly metal-organic frameworks (MOFs), heavily relies on high-quality, computation-ready structural data. However, recent studies have revealed significant error…

Chemical Physics · Physics 2025-10-29 Guobin Zhao , Pengyu Zhao , Yongchul G. Chung

Traffic forecasting represents a crucial problem within intelligent transportation systems. In recent research, Large Language Models (LLMs) have emerged as a promising method, but their intrinsic design, tailored primarily for sequential…

Machine Learning · Computer Science 2025-09-18 Hyotaek Jeon , Hyunwook Lee , Juwon Kim , Sungahn Ko

In condensed matter physics and materials science, predicting material properties necessitates understanding intricate many-body interactions. Conventional methods such as density functional theory (DFT) and molecular dynamics (MD) often…

Materials Science · Physics 2023-11-17 Lalit Yadav

Conventional mechanical design follows an iterative process in which initial concepts are refined through cycles of expert assessment and resource-intensive Finite Element Method (FEM) analysis to meet performance goals. While machine…

Machine Learning · Computer Science 2025-05-02 Yayati Jadhav , Amir Barati Farimani

In this work, we investigate extending the comprehension of Multi-modal Large Language Models (MLLMs) to regional objects. To this end, we propose to extract features corresponding to regional objects as soft prompts for LLM, which provides…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Qiang Zhou , Chaohui Yu , Shaofeng Zhang , Sitong Wu , Zhibing Wang , Fan Wang

Scalable synthesis remains the gate between MOF discovery and industrial deployment, as scale-up know-how is fragmented across disparate reports. We introduce ESU-MOF, a literature-mined dataset and a positive-unlabeled learning strategy…

We present MeshLLM, a novel framework that leverages large language models (LLMs) to understand and generate text-serialized 3D meshes. Our approach addresses key limitations in existing methods, including the limited dataset scale when…

Universal machine learning interatomic potentials (uMLIPs) have emerged as powerful tools for accelerating atomistic simulations, offering scalable and efficient modeling with accuracy close to quantum calculations. However, their…

Materials Science · Physics 2025-07-17 Hendrik Kraß , Ju Huang , Seyed Mohamad Moosavi

Large Language Models (LLMs) have enabled remarkable progress in natural language processing, yet their high computational and memory demands pose challenges for deployment in resource-constrained environments. Although recent low-rank…

Computation and Language · Computer Science 2026-02-09 Jiayi Tian , Ryan Solgi , Jinming Lu , Yifan Yang , Hai Li , Zheng Zhang

We report a workflow and the output of a natural language processing (NLP)-based procedure to mine the extant metal-organic framework (MOF) literature describing structurally characterized MOFs and their solvent removal and thermal…

Materials Science · Physics 2021-09-17 A. Nandy , G. Terrones , N. Arunachalam , C. Duan , D. W. Kastner , H. J. Kulik

Automated analysis for engineering structures offers considerable potential for boosting efficiency by minimizing repetitive tasks. Although AI-driven methods are increasingly common, no systematic framework yet leverages Large Language…

Software Engineering · Computer Science 2025-04-15 Haoran Liang , Mohammad Talebi Kalaleh , Qipei Mei

Multi-modal large language models (MLLMs) have rapidly advanced in visual tasks, yet their spatial understanding remains limited to single images, leaving them ill-suited for physical-world applications that require multi-frame reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Runsen Xu , Weiyao Wang , Hao Tang , Xingyu Chen , Xiaodong Wang , Fu-Jen Chu , Matt Feiszli , Kevin J. Liang

Instead of pretraining multilingual language models from scratch, a more efficient method is to adapt existing pretrained language models (PLMs) to new languages via vocabulary extension and continued pretraining. However, this method…

Computation and Language · Computer Science 2024-03-26 Yihong Liu , Peiqin Lin , Mingyang Wang , Hinrich Schütze

Recent advances in 3D scene-language understanding have leveraged Large Language Models (LLMs) for 3D reasoning by transferring their general reasoning ability to 3D multi-modal contexts. However, existing methods typically adopt standard…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yerim Jeon , Miso Lee , WonJun Moon , Jae-Pil Heo

Multi-modal large language models (MLLMs) have shown incredible capabilities in a variety of 2D vision and language tasks. We extend MLLMs' perceptual capabilities to ground and reason about images in 3-dimensional space. To that end, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jang Hyun Cho , Boris Ivanovic , Yulong Cao , Edward Schmerling , Yue Wang , Xinshuo Weng , Boyi Li , Yurong You , Philipp Krähenbühl , Yan Wang , Marco Pavone

SpatialLM is a large language model designed to process 3D point cloud data and generate structured 3D scene understanding outputs. These outputs include architectural elements like walls, doors, windows, and oriented object boxes with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Yongsen Mao , Junhao Zhong , Chuan Fang , Jia Zheng , Rui Tang , Hao Zhu , Ping Tan , Zihan Zhou

Metal-organic frameworks (MOFs) are highly promising for carbon capture, yet navigating their vast design space remains challenging. Recent deep generative models enable de novo MOF design but primarily act as feed-forward structure…

Machine Learning · Computer Science 2026-04-16 Chaoran Zhang , Guangyao Li , Dongxu Ji

Although Multimodal Large Language Models have achieved remarkable progress, they still struggle with complex 3D spatial reasoning due to the reliance on 2D visual priors. Existing approaches typically mitigate this limitation either…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jiahua Chen , Qihong Tang , Weinong Wang , Qi Fan