Computation and Language · Computer Science
U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in LLMs
Konstantin Chernyshev, Vitaliy Polshkov, Ekaterina Artemova, Alex Myasnikov +3
2026-02-03
Computation and Language · Computer Science
Explaining Puzzle Solutions in Natural Language: An Exploratory Study on 6x6 Sudoku
Anirudh Maiya, Razan Alghamdi, Maria Leonor Pacheco, Ashutosh Trivedi +1
2026-04-28
Artificial Intelligence · Computer Science
FIMO: A Challenge Formal Dataset for Automated Theorem Proving
Chengwu Liu, Jianhao Shen, Huajian Xin, Zhengying Liu +8
2023-12-06
Logic in Computer Science · Computer Science
SMT and Functional Equation Solving over the Reals: Challenges from the IMO
Chad E. Brown, Karel Chvalovský, Mikoláš Janota, Mirek Olšák +1
2025-07-10
Computation and Language · Computer Science
Medal Matters: Probing LLMs' Failure Cases Through Olympic Rankings
Juhwan Choi, Seunguk Yu, JungMin Yun, YoungBin Kim
2026-01-23
Artificial Intelligence · Computer Science
RIMO: An Easy-to-Evaluate, Hard-to-Solve Olympiad Benchmark for Advanced Mathematical Reasoning
Ziye Chen, Chengwei Qin, Yao Shu
2025-09-10
Computation and Language · Computer Science
FormalML: A Benchmark for Evaluating Formal Subgoal Completion in Machine Learning Theory
Xiao-Wen Yang, Zihao Zhang, Jianuo Cao, Zhi Zhou +6
2025-10-06
Artificial Intelligence · Computer Science
Brains vs. Bytes: Evaluating LLM Proficiency in Olympiad Mathematics
Hamed Mahdavi, Alireza Hashemi, Majid Daliri, Pegah Mohammadipour +5
2025-04-14
Software Engineering · Computer Science
Demystifying Issues, Causes and Solutions in LLM Open-Source Projects
Yangxiao Cai, Peng Liang, Yifei Wang, Zengyang Li +1
2025-04-08
Artificial Intelligence · Computer Science
Advancing Mathematics Research with AI-Driven Formal Proof Search
George Tsoukalas, Anton Kovsharov, Sergey Shirobokov, Anja Surina +16
2026-05-22
Computation and Language · Computer Science
Competition-Level Problems are Effective LLM Evaluators
Yiming Huang, Zhenghao Lin, Xiao Liu, Yeyun Gong +7
2024-06-05
Logic in Computer Science · Computer Science
Towards Solving More Challenging IMO Problems via Decoupled Reasoning and Proving
Zhenwen Liang, Linfeng Song, Yang Li, Tao Yang +3
2025-07-10
Machine Learning · Computer Science
Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward
Arnav Chavan, Raghav Magazine, Shubham Kushwaha, Mérouane Debbah +1
2024-04-25
Computation and Language · Computer Science
UNVEILING: What Makes Linguistics Olympiad Puzzles Tricky for LLMs?
Mukund Choudhary, KV Aditya Srivatsa, Gaurja Aeron, Antara Raaghavi Bhattacharya +5
2025-08-18
Computation and Language · Computer Science
Large Language Models Struggle with Unreasonability in Math Problems
Jingyuan Ma, Damai Dai, Zihang Yuan, Rui li +5
2025-06-03
Computation and Language · Computer Science
Probing the Difficulty Perception Mechanism of Large Language Models
Sunbowen Lee, Qingyu Yin, Chak Tou Leong, Jialiang Zhang +4
2025-10-14
Artificial Intelligence · Computer Science
Evaluating Large Language Models on Solved and Unsolved Problems in Graph Theory: Implications for Computing Education
Adithya Kulkarni, Mohna Chakraborty, Jay Bagga
2026-02-06
Computation and Language · Computer Science
AMO-Bench: Large Language Models Still Struggle in High School Math Competitions
Shengnan An, Xunliang Cai, Xuezhi Cao, Xiaoyu Li +7
2025-10-31