English
Related papers

Related papers: Large Language Models for Material Property Predic…

200 papers

Large Language Models (LLMs) have shown promising results on various language and vision tasks. Recently, there has been growing interest in applying LLMs to graph-based tasks, particularly on Text-Attributed Graphs (TAGs). However, most…

Machine Learning · Computer Science 2024-06-10 Zhongmou He , Jing Zhu , Shengyi Qian , Joyce Chai , Danai Koutra

Predicting human decision-making in high-stakes environments remains a central challenge for artificial intelligence. While large language models (LLMs) demonstrate strong general reasoning, they often struggle to generate consistent,…

Artificial Intelligence · Computer Science 2026-02-20 Ben Yellin , Ehud Ezra , Mark Foreman , Shula Grinapol

Foundation models, e.g., large language models (LLMs), trained on internet-scale data possess zero-shot generalization capabilities that make them a promising technology towards detecting and mitigating out-of-distribution failure modes of…

Robotics · Computer Science 2024-07-12 Rohan Sinha , Amine Elhafsi , Christopher Agia , Matthew Foutter , Edward Schmerling , Marco Pavone

Prognosis prediction is crucial for determining optimal treatment plans for lung cancer patients. Traditionally, such predictions relied on models developed from retrospective patient data. Recently, large language models (LLMs) have gained…

Computation and Language · Computer Science 2024-08-16 Danqing Hu , Bing Liu , Xiang Li , Xiaofeng Zhu , Nan Wu

Understanding material failure is critical for designing stronger and lighter structures by identifying weaknesses that could be mitigated. Existing full-physics numerical simulation techniques involve trade-offs between speed, accuracy,…

Large language models (LLMs) have demonstrated broad utility across molecular domains, spanning drug discovery and materials design. Analyzing LLMs' latent representations is crucial for elucidating their underlying mechanisms, improving…

Machine Learning · Computer Science 2026-02-03 Zhuoran Li , Xu Sun , Wanyu Lin , Jiannong Cao

Speech generation models based on large language models (LLMs) typically operate on discrete acoustic codes, which differ fundamentally from text tokens due to their multicodebook structure. At each timestep, models must predict N codebook…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-26 Roy Fejgin , Paarth Neekhara , Xuesong Yang , Edresson Casanova , Ryan Langman , Jaehyeon Kim , Subhankar Ghosh , Shehzeen Hussain , Jason Li

Large language models (LLMs) have achieved notable progress. Despite their success, next-token prediction (NTP), the dominant method for LLM training and inference, is constrained in both contextual coverage and inference efficiency due to…

Computation and Language · Computer Science 2025-09-23 Xiaohao Liu , Xiaobo Xia , Weixiang Zhao , Manyi Zhang , Xianzhi Yu , Xiu Su , Shuo Yang , See-Kiong Ng , Tat-Seng Chua

Modern foundation models such as large language models (LLMs) and large multi-modal models (LMMs) require a massive amount of computational and memory resources. We propose a new framework to convert such LLMs/LMMs into a reduced-dimension…

Machine Learning · Computer Science 2025-05-27 Toshiaki Koike-Akino , Xiangyu Chen , Jing Liu , Ye Wang , Pu , Wang , Matthew Brand

Accurate human mobility prediction underpins many important applications across a variety of domains, including epidemic modelling, transport planning, and emergency responses. Due to the sparsity of mobility data and the stochastic nature…

Artificial Intelligence · Computer Science 2024-01-10 Xinglei Wang , Meng Fang , Zichao Zeng , Tao Cheng

This paper identifies and analyzes applications in which Large Language Models (LLMs) can make Internet of Things (IoT) networks more intelligent and responsive through three case studies from critical topics: DDoS attack detection,…

Artificial Intelligence · Computer Science 2024-10-28 Mingyu Zong , Arvin Hekmati , Michael Guastalla , Yiyi Li , Bhaskar Krishnamachari

Accurately identifying the material composition of objects is a critical capability for AI robots powered by large language models (LLMs) to perform context-aware manipulation. Radar technologies offer a promising sensing modality for…

Signal Processing · Electrical Eng. & Systems 2025-08-06 Jiangyou Zhu , Hongyu Deng , He Chen

Large language models (LLMs) demonstrate impressive results in natural language processing tasks but require a significant amount of computational and memory resources. Structured matrix representations are a promising way for reducing the…

Computation and Language · Computer Science 2025-06-04 Ekaterina Grishina , Mikhail Gorbunov , Maxim Rakhuba

While Large Language Models (LLMs) have exhibited remarkable emergent capabilities through extensive pre-training, they still face critical limitations in generalizing to specialized domains and handling diverse linguistic variations, known…

Computation and Language · Computer Science 2025-05-28 Jinwu Hu , Zhitian Zhang , Guohao Chen , Xutao Wen , Chao Shuai , Wei Luo , Bin Xiao , Yuanqing Li , Mingkui Tan

Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich data. We provide an econometric framework for realizing this…

Econometrics · Economics 2025-12-08 Jens Ludwig , Sendhil Mullainathan , Ashesh Rambachan

Large language models (LLMs), such as ChatGPT, have demonstrated impressive performance in the text generation task, showing the ability to understand and respond to complex instructions. However, the performance of naive LLMs in speciffc…

Computation and Language · Computer Science 2025-12-12 HuangChao Xu , Baohua Zhang , Zhong Jin , Tiannian Zhu , Quansheng Wu , Hongming Weng

The integration of Large Language Models (LLMs) into engineering workflows presents new opportunities for making computational tools more accessible. Especially where such tools remain underutilized due to technical or expertise barriers,…

Artificial Intelligence · Computer Science 2026-02-19 Yinon Goldshtein , Gal Perelman , Assaf Schuster , Avi Ostfeld

Due to an exponential increase in published research articles, it is impossible for individual scientists to read all publications, even within their own research field. In this work, we investigate the use of large language models (LLMs)…

Prospect Theory (PT) models human decision-making behaviour under uncertainty, among which linguistic uncertainty is commonly adopted in real-world scenarios. Although recent studies have developed some frameworks to test PT parameters for…

Artificial Intelligence · Computer Science 2026-04-13 Rui Wang , Qihan Lin , Jiayu Liu , Qing Zong , Tianshi Zheng , Dadi Guo , Haochen Shi , Weiqi Wang , Yangqiu Song

Materials design often relies on human-generated hypotheses, a process inherently limited by cognitive constraints such as knowledge gaps and limited ability to integrate and extract knowledge implications, particularly when…