English
Related papers

Related papers: Intelligent Materials Modelling: Large Language Mo…

200 papers

This paper explores the spatial reasoning capability of large language models (LLMs) over textual input through a suite of five tasks aimed at probing their spatial understanding and computational abilities. The models were tested on both…

Computation and Language · Computer Science 2025-10-24 Maggie Bai , Ava Kim Cohen , Eleanor Koss , Charlie Lichtenbaum

This paper investigates Large Language Models (LLMs) ability to assess the economic soundness and theoretical consistency of empirical findings in spatial econometrics. We created original and deliberately altered "counterfactual" summaries…

Computers and Society · Computer Science 2025-06-10 Giuseppe Arbia , Luca Morandini , Vincenzo Nardelli

Large Language Models (LLMs) have demonstrated exceptional performance in natural language processing tasks, yet their massive size makes serving them inefficient and costly. Semi-structured pruning has emerged as an effective method for…

Machine Learning · Computer Science 2025-06-25 Hongyi Liu , Rajarshi Saha , Zhen Jia , Youngsuk Park , Jiaji Huang , Shoham Sabach , Yu-Xiang Wang , George Karypis

Large Language Models (LLMs) have been extensively applied in time series analysis. Yet, their utility in the few-shot classification (i.e., a crucial training scenario due to the limited training data available in industrial applications)…

Machine Learning · Computer Science 2025-02-04 Yakun Chen , Zihao Li , Chao Yang , Xianzhi Wang , Guandong Xu

We investigate the robustness of Large Language Models (LLMs) to structural interventions by deleting and swapping adjacent layers during inference. Surprisingly, models retain 72-95% of their original top-1 prediction accuracy without any…

Machine Learning · Computer Science 2025-06-17 Vedang Lad , Jin Hwa Lee , Wes Gurnee , Max Tegmark

Latent structure methods, specifically linear continuous latent structure methods, are a type of fundamental statistical learning strategy. They are widely used for dimension reduction, regression and prediction, in the fields of…

Methodology · Statistics 2025-08-07 Clara Grazian , Qian Jin , Pierre Lafaye De Micheaux

LLMs are routinely evaluated on language use, yet their explicit knowledge about linguistic structure remains poorly understood. Existing linguistic benchmarks focus on narrow phenomena, emphasize high-resource languages, and rarely test…

Computation and Language · Computer Science 2026-02-13 Tjaša Arčon , Matej Klemen , Marko Robnik-Šikonja , Kaja Dobrovoljc

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

Artificial Intelligence · Computer Science 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta

Characterizing materials using electron micrographs is crucial in areas such as semiconductors and quantum materials. Traditional classification methods falter due to the intricatestructures of these micrographs. This study introduces an…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Sakhinana Sagar Srinivas , Geethan Sannidhi , Sreeja Gangasani , Chidaksh Ravuru , Venkataramana Runkana

Large Language Models (LLMs) have been achieving competent performance on a wide range of downstream tasks, yet existing work shows that inference on structured data is challenging for LLMs. This is because LLMs need to either understand…

Computation and Language · Computer Science 2024-07-04 Younghun Lee , Sungchul Kim , Ryan A. Rossi , Tong Yu , Xiang Chen

Time-lapse electrical resistivity tomography (ERT) is a popular geophysical method to estimate three-dimensional (3D) permeability fields from electrical potential difference measurements. Traditional inversion and data assimilation methods…

Geophysics · Physics 2022-08-10 M. K. Mudunuru , E. L. D. Cromwell , H. Wang , X. Chen

Large language models (LLMs) have been a disruptive innovation in recent years, and they play a crucial role in our daily lives due to their ability to understand and generate human-like text. Their capabilities include natural language…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Akrit Mudvari , Yuang Jiang , Leandros Tassiulas

With the emergence of Transformer architectures and their powerful understanding of textual data, a new horizon has opened up to predict the molecular properties based on text description. While SMILES are the most common form of…

Chemical Physics · Physics 2023-10-11 Suryanarayanan Balaji , Rishikesh Magar , Yayati Jadhav , Amir Barati Farimani

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang

Large Language Models (LLMs) have achieved remarkable progress, with Parameter-Efficient Fine-Tuning (PEFT) emerging as a key technique for downstream task adaptation. However, existing PEFT methods mainly operate in Euclidean space,…

Machine Learning · Computer Science 2026-02-17 Buze Zhang , Jinkai Tao , Zilang Zeng , Neil He , Ali Maatouk , Menglin Yang , Rex Ying

The advancement of Large Language Models (LLMs) for domain applications in fields such as materials science and engineering depends on the development of fine-tuning strategies that adapt models for specialized, technical capabilities. In…

Computation and Language · Computer Science 2024-09-06 Wei Lu , Rachel K. Luu , Markus J. Buehler

This research examines the use of Large Language Models (LLMs) in predicting time series, with a specific focus on the LLMTIME model. Despite the established effectiveness of LLMs in tasks such as text generation, language translation, and…

Machine Learning · Computer Science 2024-08-12 Rui Cao , Qiao Wang

Information extraction and textual comprehension from materials literature are vital for developing an exhaustive knowledge base that enables accelerated materials discovery. Language models have demonstrated their capability to answer…

Computation and Language · Computer Science 2023-08-21 Mohd Zaki , Jayadeva , Mausam , N. M. Anoop Krishnan

Numerous Fault Localisation (FL) and repair techniques have been proposed to address faults in Deep Learning (DL) models. However, their effectiveness in practical applications remains uncertain due to the reliance on pre-defined rules.…

Software Engineering · Computer Science 2025-06-05 Jinhan Kim , Nargiz Humbatova , Gunel Jahangirova , Shin Yoo , Paolo Tonella

In recent years, groundbreaking advancements in natural language processing have culminated in the emergence of powerful large language models (LLMs), which have showcased remarkable capabilities across a vast array of domains, including…

Computation and Language · Computer Science 2023-12-11 Microsoft Research AI4Science , Microsoft Azure Quantum