English
Related papers

Related papers: CombiGraph-Vis: A Curated Multimodal Olympiad Benc…

200 papers

How much large language models (LLMs) can aid scientific discovery, notably in assisting academic peer review, is in heated debate. Between a literature digest and a human-comparable research assistant lies their practical application…

Computation and Language · Computer Science 2025-08-19 Tianyi Li , Yu Qin , Olivia R. Liu Sheng

Leveraging the general world knowledge of Large Language Models (LLMs) holds significant promise for improving the ability of autonomous driving systems to handle rare and complex scenarios. While integrating LLMs into…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jing Gu , Niccolò Cavagnero , Gijs Dubbelman

With the rapid progress of Multimodal LLMs, evaluating their mathematical reasoning capabilities has become an increasingly important research direction. In particular, visual-textual mathematical reasoning serves as a key indicator of an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hao Liang , Linzhuang Sun , Minxuan Zhou , Zirong Chen , Meiyi Qiang , Mingan Lin , Tianpeng Li , Fan Yang , Zenan Zhou , Wentao Zhang

Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem…

Artificial Intelligence · Computer Science 2024-05-24 Huajian Xin , Daya Guo , Zhihong Shao , Zhizhou Ren , Qihao Zhu , Bo Liu , Chong Ruan , Wenda Li , Xiaodan Liang

Mathematical reasoning is a hallmark of human intelligence, and whether large language models (LLMs) can meaningfully perform it remains a central question in artificial intelligence and cognitive science. As LLMs are increasingly…

Computation and Language · Computer Science 2026-04-03 Linyang He , Qiyao Yu , Hanze Dong , Baohao Liao , Xinxing Xu , Micah Goldblum , Jiang Bian , Nima Mesgarani

Despite significant advancements in the general capability of large language models (LLMs), they continue to struggle with consistent and accurate reasoning, especially in complex tasks such as mathematical and code reasoning. One key…

Machine Learning · Computer Science 2024-10-10 Zhenwen Liang , Ye Liu , Tong Niu , Xiangliang Zhang , Yingbo Zhou , Semih Yavuz

Large Language Models (LLMs) have demonstrated strong performance across a wide range of tasks, yet they still struggle with complex mathematical reasoning, a challenge fundamentally rooted in deep structural dependencies. To address this…

Artificial Intelligence · Computer Science 2025-12-01 Lei Zan , Keli Zhang , Ruichu Cai , Lujia Pan

Enterprise security faces escalating threats from sophisticated malware, compounded by expanding digital operations. This paper presents the first systematic evaluation of large language models (LLMs) to proactively identify indicators of…

Cryptography and Security · Computer Science 2026-01-15 Aniesh Chawla , Udbhav Prasad

State-of-the-art (SOTA) semi-supervised learning (SSL) methods have been highly successful in leveraging a mix of labeled and unlabeled data by combining techniques of consistency regularization and pseudo-labeling. During pseudo-labeling,…

Competitive programming problems increasingly serve as valuable benchmarks to evaluate the coding capabilities of large language models (LLMs) due to their complexity and ease of verification. Yet, current coding benchmarks face limitations…

Artificial Intelligence · Computer Science 2025-12-23 Kaijian Zou , Aaron Xiong , Yunxiang Zhang , Frederick Zhang , Yueqi Ren , Jirong Yang , Ayoung Lee , Shitanshu Bhushan , Lu Wang

The use of Large Language Models (LLMs) in mathematical reasoning has become a cornerstone of related research, demonstrating the intelligence of these models and enabling potential practical applications through their advanced performance,…

Computation and Language · Computer Science 2024-12-20 Kathrin Seßler , Yao Rong , Emek Gözlüklü , Enkelejda Kasneci

Defect grading of power transmission equipment (DGPTE) is crucial to the stability of electric energy transmission. Although existing machine learning methods exhibit strong capabilities in defect detection, they are plagued by difficulties…

Computation and Language · Computer Science 2026-05-29 Tao Wang , Lipeng Zhu , Jiayong Li , Feng Gao , Siwen Liang

Multimodal Large Language Models (MLLMs) excel in solving text-based mathematical problems, but they struggle with mathematical diagrams since they are primarily trained on natural scene images. For humans, visual aids generally enhance…

Computation and Language · Computer Science 2024-09-26 Wenwen Zhuang , Xin Huang , Xiantao Zhang , Jin Zeng

Large language models (LLMs) have demonstrated impressive reasoning capabilities, particularly in textual mathematical problem-solving. However, existing open-source image instruction fine-tuning datasets, containing limited question-answer…

Computation and Language · Computer Science 2024-10-10 Wenhao Shi , Zhiqiang Hu , Yi Bin , Junhua Liu , Yang Yang , See-Kiong Ng , Lidong Bing , Roy Ka-Wei Lee

Many machine learning tasks aim to find models that work well not for a single, but for a group of criteria, often opposing ones. One such example is imbalanced data classification, where, on the one hand, we want to achieve the best…

Machine Learning · Computer Science 2025-11-18 Szymon Wojciechowski , Michał Woźniak

Understanding and reasoning on the large-scale scientific literature is a crucial touchstone for large language model (LLM) based agents. However, existing works are mainly restricted to tool-free tasks within single papers, largely due to…

Artificial Intelligence · Computer Science 2026-02-02 Daoyu Wang , Mingyue Cheng , Shuo Yu , Zirui Liu , Ze Guo , Xin Li , Qi Liu

We argue that current evaluation frameworks for large language models (LLMs) suffer from four systematic failures that make them structurally inadequate for deployed, agentic systems: distributional, temporal, scope, and process invalidity.…

Artificial Intelligence · Computer Science 2026-05-08 Jazmia Henry

Large Language Models (LLMs) like LLaMA, Mistral, and Gemma are increasingly used in decision-critical domains such as healthcare, law, and finance, yet their reliability remains uncertain. They often make overconfident errors, degrade…

Computation and Language · Computer Science 2026-01-01 Rohit Kumar Salla , Manoj Saravanan , Shrikar Reddy Kota

While Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation, they often produce solutions that lack guarantees of correctness, robustness, and efficiency. This limitation is particularly acute in domains…

Software Engineering · Computer Science 2025-09-04 Yueke Zhang , Yifan Zhang , Kevin Leach , Yu Huang

Model merging offers a scalable alternative to multi-task learning but often yields suboptimal performance on classification tasks. We attribute this degradation to a geometric misalignment between the merged encoder and static…

Machine Learning · Computer Science 2026-02-03 Fanshuang Kong , Richong Zhang , Zhijie Nie , Hang Zhou , Ziqiao Wang , Qiang Sun , Chunming Hu