English
Related papers

Related papers: EduFlow: Advancing MLLMs' Problem-Solving Proficie…

200 papers

While Large language models (LLMs) have the capability to iteratively reflect on their own outputs, recent studies have observed their struggles with knowledge-rich problems without access to external resources. In addition to the…

Computation and Language · Computer Science 2024-06-25 Hanqi Yan , Qinglin Zhu , Xinyu Wang , Lin Gui , Yulan He

With the growing use of Large Language Model (LLM)-based Question-Answering (QA) systems in education, it is critical to evaluate their performance across individual pipeline components. In this work, we introduce {\model}, a modular…

Computation and Language · Computer Science 2025-12-01 Meenakshi Mittal , Rishi Khare , Mihran Miroyan , Chancharik Mitra , Narges Norouzi

The integration of large language models (LLMs) into education presents unprecedented opportunities for scalable personalized learning. However, standard LLMs often function as generic information providers, lacking alignment with…

Machine Learning · Computer Science 2025-07-29 Siyu Song , Wentao Liu , Ye Lu , Ruohua Zhang , Tao Liu , Jinze Lv , Xinyun Wang , Aimin Zhou , Fei Tan , Bo Jiang , Hao Hao

As the field of Multimodal Large Language Models (MLLMs) continues to evolve, their potential to revolutionize artificial intelligence is particularly promising, especially in addressing mathematical reasoning tasks. Current mathematical…

Educational illustrations play a central role in communicating abstract concepts, yet current multimodal large language models (MLLMs) remain limited in producing pedagogically coherent and semantically consistent educational visuals. We…

Artificial Intelligence · Computer Science 2025-11-25 Zhenyu Wu , Jian Li , Hua Huang

Logical reasoning is a crucial task for Large Language Models (LLMs), enabling them to tackle complex problems. Among reasoning tasks, multi-step reasoning poses a particular challenge. Grounded in the theory of formal logic, we have…

Machine Learning · Computer Science 2024-10-25 Jialian Li , Yipin Zhang , Wei Shen , Yuzi Yan , Jian Xie , Dong Yan

Small Language Models (SLMs) are a cost-effective alternative to Large Language Models (LLMs), but often struggle with complex reasoning due to their limited capacity and a tendency to produce mistakes or inconsistent answers during…

Computation and Language · Computer Science 2025-08-19 Yuanfeng Xu , Zehui Dai , Jian Liang , Jiapeng Guan , Guangrun Wang , Liang Lin , Xiaohui Lv

Large language models (LLMs) like GPT-4, DeepSeek-R1, and ReasonFlux have shown significant improvements in various reasoning tasks. However, smaller LLMs still struggle with complex mathematical reasoning because they fail to effectively…

Computation and Language · Computer Science 2025-02-27 Ling Yang , Zhaochen Yu , Tianjun Zhang , Minkai Xu , Joseph E. Gonzalez , Bin Cui , Shuicheng Yan

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Large language models are increasingly used as educational assistants, yet evaluation of their educational capabilities remains concentrated on question-answering and tutoring tasks. A critical gap exists for multimedia instructional…

Computers and Society · Computer Science 2026-04-14 Shuzhen Bi , Mingzi Zhang , Zhuoxuan Li , Xiaolong Wang , Keqian Li , Aimin Zhou

Large language models (LLMs) demonstrate impressive language understanding and contextual learning abilities, making them suitable for natural language processing (NLP) tasks and complex mathematical reasoning. However, when applied to…

Artificial Intelligence · Computer Science 2023-09-13 Haotian Xu

Multimodal Large Language Models (MLLMs) hold promise for accelerating scientific discovery by interpreting complex experimental procedures. However, their true capabilities are poorly understood, as existing benchmarks neglect the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yicheng Xu , Yue Wu , Jiashuo Yu , Ziang Yan , Tianxiang Jiang , Yinan He , Qingsong Zhao , Kai Chen , Yu Qiao , Limin Wang , Manabu Okumura , Yi Wang

Large Language Models (LLMs) are increasingly deployed in critical applications requiring reliable reasoning, yet their internal reasoning processes remain difficult to evaluate systematically. Existing methods focus on final-answer…

Machine Learning · Computer Science 2026-02-03 Shaima Ahmad Freja , Ferhat Ozgur Catak , Betul Yurdem , Chunming Rong

Vision-Language Models (VLMs) have recently shown promising advancements in sequential decision-making tasks through task-specific fine-tuning. However, common fine-tuning methods, such as Supervised Fine-Tuning (SFT) and Reinforcement…

Computation and Language · Computer Science 2025-03-26 Haoqiang Kang , Enna Sachdeva , Piyush Gupta , Sangjae Bae , Kwonjoon Lee

The rapid advancing of Multimodal Large Language Models (MLLMs) has spurred interest in complex multimodal reasoning tasks in the real-world and virtual environment, which require coordinating multiple abilities, including visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Ziyue Wang , Yurui Dong , Fuwen Luo , Minyuan Ruan , Zhili Cheng , Chi Chen , Peng Li , Yang Liu

Reinforcement learning with verifiable reward (RLVR) has become a promising paradigm for post-training large language models (LLMs) to improve their reasoning capability. However, when the rollout accuracy is low on hard problems, the…

Machine Learning · Computer Science 2026-04-21 Huanyu Liu , Jia Li , Yihong Dong , Chang Yu , Taozhi Chen , Lecheng Wang , Yongding Tao , Bin Gu , Ge Li

Recently, multimodal large language models (MLLMs) have been widely applied to reasoning tasks. However, they suffer from limited multi-rationale semantic modeling, insufficient logical robustness, and are susceptible to misleading…

Artificial Intelligence · Computer Science 2025-12-08 Chuang Yu , Jinmiao Zhao , Mingxuan Zhao , Yunpeng Liu , Xiujun Shu , Yuanhao Feng , Bo Wang , Xiangyu Yue

Process Reward Models (PRMs) provide step-level supervision that improves the reliability of reasoning in large language models. While PRMs have been extensively studied in text-based domains, their extension to Vision Language Models…

Artificial Intelligence · Computer Science 2025-10-08 Brandon Ong , Tej Deep Pala , Vernon Toh , William Chandra Tjhi , Soujanya Poria

Multi-step processes via large language models (LLMs) have proven effective for solving complex reasoning tasks. However, the depth of exploration of the reasoning procedure can significantly affect the task performance. Existing methods to…

Artificial Intelligence · Computer Science 2025-06-19 Jinghan Zhang , Xiting Wang , Fengran Mo , Yeyang Zhou , Wanfu Gao , Kunpeng Liu

Large language models (LLMs) have demonstrated strong reasoning abilities across specialized domains, motivating research into their application to legal reasoning. However, existing legal benchmarks often conflate factual recall with…

Artificial Intelligence · Computer Science 2025-11-21 Wenhan Yu , Xinbo Lin , Lanxin Ni , Jinhua Cheng , Lei Sha