English
Related papers

Related papers: Enhancing Spatial Reasoning in Large Language Mode…

200 papers

This work presents an ontology-integrated large language model (LLM) framework for chemical engineering that unites structured domain knowledge with generative reasoning. The proposed pipeline aligns model training and inference with the…

Machine Learning · Computer Science 2025-12-15 Crystal Su , Kuai Yu , Jingrui Zhang , Mingyuan Shao , Daniel Bauer

Large Language Models (LLMs) represent formidable tools for sequence modeling, boasting an innate capacity for general pattern recognition. Nevertheless, their broader spatial reasoning capabilities, especially applied to numerical…

Robotics · Computer Science 2023-12-05 Manasi Sharma

Large language models (LLMs) and foundation models have been recently touted as a game-changer for 6G systems. However, recent efforts on LLMs for wireless networks are limited to a direct application of existing language models that were…

Networking and Internet Architecture · Computer Science 2024-02-08 Shengzhe Xu , Christo Kurisummoottil Thomas , Omar Hashash , Nikhil Muralidhar , Walid Saad , Naren Ramakrishnan

Spatio-physical reasoning, a foundation capability for understanding the real physics world, is a critical step towards building robust world models. While recent vision language models (VLMs) have shown remarkable progress in specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Tiancheng Han , Yunfei Gao , Yong Li , Wuzhou Yu , Qiaosheng Zhang , Wenqi Shao

Large Language Models (LLMs) excel in diverse areas, yet struggle with complex scientific reasoning, especially in the field of chemistry. Different from the simple chemistry tasks (e.g., molecule classification) addressed in previous…

Computation and Language · Computer Science 2024-02-12 Siru Ouyang , Zhuosheng Zhang , Bing Yan , Xuan Liu , Yejin Choi , Jiawei Han , Lianhui Qin

Machine learning has revolutionized polymer science by enabling rapid property prediction and generative design. Large language models (LLMs) offer further opportunities in polymer informatics by simplifying workflows that traditionally…

Computational Engineering, Finance, and Science · Computer Science 2026-02-20 Sonakshi Gupta , Akhlak Mahmood , Shivank Shukla , Rampi Ramprasad

Despite their widespread adoption in various domains, especially due to their powerful reasoning capabilities, Large Language Models (LLMs) are not the off-the-shelf choice to drive multi-objective optimization yet. Conventional strategies…

Machine Learning · Computer Science 2026-01-21 Andrej Schwanke , Lyubomir Ivanov , David Salinas , Frank Hutter , Arber Zela

Large Language Models (LLMs) and Vision Language Models (VLMs) have shown impressive reasoning abilities, yet they struggle with spatial understanding and layout consistency when performing fine-grained visual editing. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Haoyu Zhen , Xiaolong Li , Yilin Zhao , Han Zhang , Sifei Liu , Kaichun Mo , Chuang Gan , Subhashree Radhakrishnan

3D spatial understanding is essential in real-world applications such as robotics, autonomous vehicles, virtual reality, and medical imaging. Recently, Large Language Models (LLMs), having demonstrated remarkable success across various…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jirong Zha , Yuxuan Fan , Xiao Yang , Chen Gao , Xinlei Chen

3D Visual Grounding (3DVG) focuses on locating objects in 3D scenes based on natural language descriptions, serving as a fundamental task for embodied AI and robotics. Recent advances in Multi-modal Large Language Models (MLLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Beining Xu , Siting Zhu , Zhao Jin , Junxian Li , Hesheng Wang

The large language model (LLM) is typically integrated into the mainstream optimization protocol. No work has questioned whether maintaining the model integrity is \textit{indispensable} for promising performance. In this work, we introduce…

Computation and Language · Computer Science 2026-03-17 Mingyuan Zhang , Yue Bai , Huan Wang , Yizhou Wang , Qihua Dong , Yitian Zhang , Yun Fu

Deep generative models have shown promise for modeling metal-organic frameworks (MOFs), but existing approaches (1) rely on coarse-grained representations that assume fixed bond lengths and angles, and (2) neglect the MOF-adsorbate…

Materials Science · Physics 2026-02-10 Nayoung Kim , Honghui Kim , Sihyun Yu , Minkyu Kim , Seongsu Kim , Sungsoo Ahn

Large language models (LLMs) achieve impressive results over various tasks, and ever-expanding public repositories contain an abundance of pre-trained models. Therefore, identifying the best-performing LLM for a given task is a significant…

Computation and Language · Computer Science 2025-11-13 Idan Kashani , Avi Mendelson , Yaniv Nemcovsky

High-throughput screening of large hypothetical databases of metal-organic frameworks (MOFs) can uncover new materials, but their stability in real-world applications is often unknown. We leverage community knowledge and machine learning…

In recent years, Multi-modal Large Language Models (MLLMs) have achieved strong performance in OCR-centric Visual Question Answering (VQA) tasks, illustrating their capability to process heterogeneous data and exhibit adaptability across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Chen Duan , Zhentao Guo , Pei Fu , Zining Wang , Kai Zhou , Pengfei Yan

Molecular Relational Learning (MRL) aims to understand interactions between molecular pairs, playing a critical role in advancing biochemical research. With the recent development of large language models (LLMs), a growing number of studies…

Machine Learning · Computer Science 2025-06-03 Zhuo Chen , Yizhen Zheng , Huan Yee Koh , Hongxin Xiang , Linjiang Chen , Wenjie Du , Yang Wang

Pretrained large language models (LLMs) can work as high-level robotic planners by reasoning over abstract task descriptions and natural language instructions, etc. However, they have shown a lack of knowledge and effectiveness in planning…

Robotics · Computer Science 2025-09-30 Wanming Yu , Adrian Röfer , Abhinav Valada , Sethu Vijayakumar

The recent progress of using graph based encoding of crystal structures for high throughput material property prediction has been quite successful. However, using a single modality model prevents us from exploiting the advantages of an…

Machine Learning · Computer Science 2025-05-09 Abhiroop Bhattacharya , Sylvain G. Cloutier

Progress in the application of machine learning (ML) methods to materials design is hindered by the lack of understanding of the reliability of ML predictions, in particular for the application of ML to small data sets often found in…

Materials Science · Physics 2023-04-06 Evan M. Askanazi , Emanuel A. Lazar , Ilya Grinberg

Machine learning (ML) models utilizing structure-based features provide an efficient means for accurate property predictions across diverse chemical spaces. However, obtaining equilibrium crystal structures typically requires expensive…

Materials Science · Physics 2021-04-22 Yunxing Zuo , Mingde Qin , Chi Chen , Weike Ye , Xiangguo Li , Jian Luo , Shyue Ping Ong