English
Related papers

Related papers: OpInf-LLM: Parametric PDE Solving with LLMs via Op…

200 papers

Physics-informed Neural Networks (PINNs) have been shown as a promising approach for solving both forward and inverse problems of partial differential equations (PDEs). Meanwhile, the neural operator approach, including methods such as Deep…

Machine Learning · Computer Science 2023-10-31 Bin Lin , Zhiping Mao , Zhicheng Wang , George Em Karniadakis

This paper focuses on the PINNs algorithm by proposing the ALM-PINNs computational framework to solve various nonlinear partial differential equations and corresponding parameters identification problems. The numerical solutions obtained by…

Numerical Analysis · Mathematics 2024-10-15 Yimeng Tian , Dinghua Xu

Solving large-scale Partial Differential Equations (PDEs) on complex three-dimensional geometries represents a central challenge in scientific and engineering computing, often impeded by expensive pre-processing stages and substantial…

Computational Engineering, Finance, and Science · Computer Science 2025-10-21 Peijian Zeng , Guan Wang , Haohao Gu , Xiaoguang Hu , Tiezhu Gao , Zhuowei Wang , Aimin Yang , Xiaoyu Song

In many scientific fields, the generation and evolution of data are governed by partial differential equations (PDEs) which are typically informed by established physical laws at the macroscopic level to describe general and predictable…

Methodology · Statistics 2025-07-01 Ziyuan Chen , Shunxing Yan , Fang Yao

Inference-time scaling has emerged as a powerful technique for enhancing the reasoning performance of Large Language Models (LLMs). However, existing approaches often rely on heuristic strategies for parallel sampling, lacking a principled…

Machine Learning · Computer Science 2025-12-22 Youkang Wang , Jian Wang , Rubing Chen , Xiao-Yong Wei

Numerical approximations of partial differential equations (PDEs) are routinely employed to formulate the solution of physics, engineering, and mathematical problems involving functions of several variables, such as the propagation of heat…

This paper introduces a novel Large Language Models (LLMs)-assisted agent that automatically converts natural-language descriptions of power system optimization scenarios into compact, solver-ready formulations and generates corresponding…

Artificial Intelligence · Computer Science 2025-08-12 Yunkai Hu , Tianqiao Zhao , Meng Yue

PDEs arise ubiquitously in science and engineering, where solutions depend on parameters (physical properties, boundary conditions, geometry). Traditional numerical methods require re-solving the PDE for each parameter, making parameter…

Machine Learning · Statistics 2026-02-02 Zhuo Zhang , Xiong Xiong , Sen Zhang , Yuan Zhao , Xi Yang

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

Machine learning based partial differential equations (PDEs) solvers have received great attention in recent years. Most progress in this area has been driven by deep neural networks such as physics-informed neural networks (PINNs) and…

Numerical Analysis · Mathematics 2025-09-23 Chunyang Liao

Large language models (LLMs) have advanced rapidly, emerging as versatile tools across fields thanks to their exceptional language understanding, generation, and reasoning capabilities. However, performing LLM inference at the network edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-28 Zhixiong Chen , Bingjie Zhu , Jiangzhou Wang , Hyundong Shin , Arumugam Nallanathan , Dusit Niyato

Large language models (LLMs) can generate code from natural language descriptions. Their performance is typically evaluated using programming benchmarks that simulate real-world tasks. These benchmarks provide specifications in the form of…

Databases · Computer Science 2025-07-09 Shuning Zhang , Yongjoo Park

Comprehensive evaluation of Large Language Models (LLMs) is an open research problem. Existing evaluations rely on deterministic point estimates generated via greedy decoding. However, we find that deterministic evaluations fail to capture…

Machine Learning · Computer Science 2025-03-04 Yan Scholten , Stephan Günnemann , Leo Schwinn

Physics-informed neural operators have emerged as a powerful paradigm for solving parametric partial differential equations (PDEs), particularly in the aerospace field, enabling the learning of solution operators that generalize across…

Machine Learning · Computer Science 2025-06-24 Jing Wang , Biao Chen , Hairun Xie , Rui Wang , Yifan Xia , Jifa Zhang , Hui Xu

Large language models (LLMs) have demonstrated exceptional performance across a variety of tasks. However, their substantial scale leads to significant computational resource consumption during inference, resulting in high costs.…

Machine Learning · Computer Science 2025-06-13 Zhaode Wang , Jingbang Yang , Xinyu Qian , Shiwen Xing , Xiaotang Jiang , Chengfei Lv , Shengyu Zhang

The rapid evolution of Large Language Model (LLM) inference systems has yielded significant efficiency improvements. However, our systematic analysis reveals that current evaluation methodologies frequently exhibit fundamental flaws, often…

Despite significant advancements in the general capability of large language models (LLMs), they continue to struggle with consistent and accurate reasoning, especially in complex tasks such as mathematical and code reasoning. One key…

Machine Learning · Computer Science 2024-10-10 Zhenwen Liang , Ye Liu , Tong Niu , Xiangliang Zhang , Yingbo Zhou , Semih Yavuz

Large language models (LLMs) have shown strong results on a range of applications, including regression and scoring tasks. Typically, one obtains outputs from an LLM via autoregressive sampling from the model's output distribution. We show…

Computation and Language · Computer Science 2024-11-04 Michal Lukasik , Harikrishna Narasimhan , Aditya Krishna Menon , Felix Yu , Sanjiv Kumar

Large language models (LLMs) are increasingly used to convert natural language descriptions into mathematical optimization formulations. Current evaluations often treat formulations as a whole, relying on coarse metrics like solution…

Machine Learning · Computer Science 2025-10-21 Dania Refai , Moataz Ahmed