English
Related papers

Related papers: OMNIFLOW: A Physics-Grounded Multimodal Agent for …

200 papers

Despite the broad applicability of large language models (LLMs), their reliance on probabilistic inference makes them vulnerable to errors such as hallucination in generated facts and inconsistent output structure in natural language…

Computation and Language · Computer Science 2025-10-24 Xin Lian , Kenneth D. Forbus

Large language models (LLMs) perform substantially below human level on existing theory-of-mind (ToM) benchmarks, even when augmented with chain-of-thought prompting or probabilistic belief updates. We argue that these failures primarily…

Computation and Language · Computer Science 2026-04-21 Wang Bill Zhu , Qiutong Tony Yi , Robin Jia , Jesse Thomason

Large reasoning models (LRMs) generate complex reasoning traces with planning, reflection, verification, and backtracking. In this work, we introduce ReasoningFlow, a unified schema for analyzing the semantic structures of these complex…

Computation and Language · Computer Science 2025-06-04 Jinu Lee , Sagnik Mukherjee , Dilek Hakkani-Tur , Julia Hockenmaier

Despite significant progress, multimodal large language models continue to struggle with visual mathematical problem solving. Some recent works recognize that visual perception is a bottleneck in visual mathematical reasoning, but their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Shuhang Chen , Yunqiu Xu , Junjie Xie , Aojun Lu , Tao Feng , Zeying Huang , Ning Zhang , Yi Sun , Yi Yang , Hangjie Yuan

Large Language Models (LLMs) are increasingly entering specialized, safety-critical engineering workflows governed by strict quantitative standards and immutable physical laws, making rigorous evaluation of their reasoning capabilities…

Computation and Language · Computer Science 2026-01-08 Ayesha Gull , Muhammad Usman Safder , Rania Elbadry , Fan Zhang , Veselin Stoyanov , Preslav Nakov , Zhuohan Xie

Computational fluid dynamics (CFD) drives progress in numerous scientific and engineering fields, yet high-fidelity simulations remain computationally prohibitive. While machine learning approaches offer computing acceleration, they…

Fluid Dynamics · Physics 2025-08-12 Rui Zhang , Qi Meng , Han Wan , Yang Liu , Zhi-Ming Ma , Hao Sun

Unsupervised Reinforcement Learning from Internal Feedback (RLIF) has emerged as a promising paradigm for eliciting the latent capabilities of Large Language Models (LLMs) without external supervision. However, current methods rely on…

Computation and Language · Computer Science 2026-05-26 Ruishuo Chen , Yu Chen , Zhuoran Li , Longbo Huang

Theory-of-Mind (ToM), the ability to infer others' perceptions and mental states, is fundamental to human interaction but remains challenging for Large Language Models (LLMs). While existing ToM reasoning methods show promise with reasoning…

Computation and Language · Computer Science 2025-06-03 Hainiu Xu , Siya Qi , Jiazheng Li , Yuxiang Zhou , Jinhua Du , Caroline Catmur , Yulan He

Logical reasoning, i.e., deductively inferring the truth value of a conclusion from a set of premises, is an important task for artificial intelligence with wide potential impacts on science, mathematics, and society. While many…

Computation and Language · Computer Science 2024-02-15 Theo X. Olausson , Alex Gu , Benjamin Lipkin , Cedegao E. Zhang , Armando Solar-Lezama , Joshua B. Tenenbaum , Roger Levy

Large Language Models (LLMs) reasoning processes are challenging to analyze due to their complexity and the lack of organized visualization tools. We present ReasonGraph, a web-based platform for visualizing and analyzing LLM reasoning…

Computation and Language · Computer Science 2025-03-07 Zongqian Li , Ehsan Shareghi , Nigel Collier

Breakthroughs in frontier theory often depend on the combination of concrete diagrammatic notations with rigorous logic. While multimodal large language models (MLLMs) show promise in general scientific tasks, current benchmarks often focus…

Artificial Intelligence · Computer Science 2026-04-07 Zeyu Wang , Xiaogang Li , Peiyao Xiao , Qinhao Kong , Ben Wang , Chengliang Xu , Zichao Chen , Bing Zhao , Hu Wei

ML-based systems are software systems that incorporates machine learning components such as Deep Neural Networks (DNNs) or Large Language Models (LLMs). While such systems enable advanced features such as high performance computer vision,…

Software Engineering · Computer Science 2025-03-14 Shin Yoo , Robert Feldt , Somin Kim , Naryeong Kim

Understanding natural and engineered systems often relies on symbolic formulations, such as differential equations, which provide interpretability and transferability beyond black-box models. We introduce Latent Grammar Flow (LGF), a…

Machine Learning · Computer Science 2026-04-20 Karin Yu , Eleni Chatzi , Georgios Kissas

One of the primary driving forces contributing to the superior performance of Large Language Models (LLMs) is the extensive availability of human-annotated natural language data, which is used for alignment fine-tuning. This inspired…

Computation and Language · Computer Science 2024-06-18 Fangzhi Xu , Qiushi Sun , Kanzhi Cheng , Jun Liu , Yu Qiao , Zhiyong Wu

Large Language Models (LLMs) have shown promising results across various tasks, yet their reasoning capabilities remain a fundamental challenge. Developing AI systems with strong reasoning capabilities is regarded as a crucial milestone in…

Artificial Intelligence · Computer Science 2025-08-20 Xiao-Wen Yang , Jie-Jing Shao , Lan-Zhe Guo , Bo-Wen Zhang , Zhi Zhou , Lin-Han Jia , Wang-Zhou Dai , Yu-Feng Li

Large unimodal foundation models for vision and language encode rich semantic structures, yet aligning them typically requires computationally intensive multimodal fine-tuning. Such approaches depend on large-scale parameter updates, are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Abhishek Dalvi , Vasant Honavar

Despite the success of Large-Vision Language Models (LVLMs), general optimization objectives (e.g., standard MLE) fail to constrain visual trajectories, leading to language bias and hallucination. To mitigate this, current methods introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yangfu Li , Yuning Gong , Hongjian Zhan , Teng Li , Yuanhuiyi Lyu , Tianyi Chen , Qi Liu , Ziyuan Huang , Zhihang Zhong , Dandan Zheng , Yue Lu

Vision-and-Language Navigation (VLN) requires agents to autonomously navigate complex environments via visual images and natural language instructions--remains highly challenging. Recent research on enhancing language-guided navigation…

Artificial Intelligence · Computer Science 2026-02-10 Changxin Huang , Lv Tang , Zhaohuan Zhan , Lisha Yu , Runhao Zeng , Zun Liu , Zhengjie Wang , Jianqiang Li

The evolution of Omni-Modal Large Language Models~(Omni-LLMs) has revolutionized human--computer interaction, enabling unified audio-visual perception and speech response. However, existing Omni-LLMs struggle with complex real-world…

Sound · Computer Science 2026-03-10 Wenjie Tian , Zhixian Zhao , Jingbin Hu , Huakang Chen , Haohe Liu , Binshen Mu , Lei Xie

Standard Chain-of-Thought (CoT) prompting empowers Large Language Models (LLMs) with reasoning capabilities, yet its reliance on linear natural language is inherently insufficient for effective world modeling in embodied tasks. While text…

Artificial Intelligence · Computer Science 2026-04-14 Hongyu Chen , Liang Lin , Guangrun Wang