中文
相关论文

相关论文: AceMath: Advancing Frontier Math Reasoning with Po…

200 篇论文

Large Language Models (LLMs) are changing the coding paradigm, known as vibe coding, yet synthesizing algorithmically sophisticated and robust code still remains a critical challenge. Incentivizing the deep reasoning capabilities of LLMs is…

计算与语言 · 计算机科学 2026-02-18 Chansung Park , Juyong Jiang , Fan Wang , Sayak Paul , Jiasi Shen , Jing Tang , Jianguo Li

An effective reward model plays a pivotal role in reinforcement learning for post-training enhancement of visual generative models. However, current approaches of reward modeling suffer from implementation complexity due to their reliance…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Runtao Liu , Jiahao Zhan , Yingqing He , Chen Wei , Alan Yuille , Qifeng Chen

Process reward models (PRMs) have shown success in complex reasoning tasks for large language models (LLMs). However, their application to machine translation (MT) remains underexplored due to the lack of systematic methodologies and…

计算与语言 · 计算机科学 2025-09-22 Zhaopeng Feng , Jiahan Ren , Jiayuan Su , Jiamei Zheng , Hongwei Wang , Zuozhu Liu

Multimodal instruction tuning has proven to be an effective strategy for achieving zero-shot generalization by fine-tuning pre-trained Large Multimodal Models (LMMs) with instruction-following data. However, as the scale of LMMs continues…

Performance optimization of deep learning models is conducted either manually or through automatic architecture search, or a combination of both. On the other hand, their performance strongly depends on the target hardware and how…

机器学习 · 计算机科学 2022-09-23 Vahid Partovi Nia , Alireza Ghaffari , Mahdi Zolnouri , Yvon Savaria

The Process Reward Model (PRM) plays a crucial role in mathematical reasoning tasks, requiring high-quality supervised process data. However, we observe that reasoning steps generated by Large Language Models (LLMs) often fail to exhibit…

人工智能 · 计算机科学 2025-08-25 Yulan Hu , Sheng Ouyang , Jinman Zhao , Yong Liu

Computation methods for solving entropy-regularized reward optimization -- a class of problems widely used for fine-tuning generative models -- have advanced rapidly. Among those, Adjoint Matching (AM, Domingo-Enrich et al., 2025) has…

机器学习 · 统计学 2026-02-17 Oswin So , Brian Karrer , Chuchu Fan , Ricky T. Q. Chen , Guan-Horng Liu

Can AI make progress on important, unsolved mathematical problems? Large language models are now capable of sophisticated mathematical and scientific reasoning, but whether they can perform novel research is still widely debated and…

Looped Language Models (LoopLMs) perform multi-step latent reasoning prior to token generation and outperform conventional LLMs on reasoning benchmarks at smaller parameter budgets. However, attempts to further improve LoopLM reasoning with…

机器学习 · 计算机科学 2026-05-29 Jonathan Williams , Esin Tureci

One way to enhance the reasoning capability of Large Language Models (LLMs) is to conduct Supervised Fine-Tuning (SFT) using Chain-of-Thought (CoT) annotations. This approach does not show sufficiently strong generalization ability,…

计算与语言 · 计算机科学 2024-12-16 Trung Quoc Luong , Xinbo Zhang , Zhanming Jie , Peng Sun , Xiaoran Jin , Hang Li

Representation learning has been widely studied in the context of meta-learning, enabling rapid learning of new tasks through shared representations. Recent works such as MAML have explored using fine-tuning-based metrics, which measure the…

机器学习 · 计算机科学 2021-05-06 Kurtland Chua , Qi Lei , Jason D. Lee

A well-defined benchmark is essential for measuring and accelerating research progress of machine learning models. In this paper, we present a benchmark for high-level mathematical reasoning and study the reasoning capabilities of neural…

计算机科学中的逻辑 · 计算机科学 2021-03-25 Wenda Li , Lei Yu , Yuhuai Wu , Lawrence C. Paulson

Training on large amounts of rationales (i.e., CoT Fine-tuning) is effective at improving the reasoning capabilities of large language models (LLMs). However, acquiring human-authored rationales or augmenting rationales from proprietary…

计算与语言 · 计算机科学 2024-10-04 Hyeonbin Hwang , Doyoung Kim , Seungone Kim , Seonghyeon Ye , Minjoon Seo

While large language models have made significant progress in mathematical reasoning, they remain unreliable at judging the correctness of their own solutions. Existing approaches that equip models with self-verification typically treat…

计算与语言 · 计算机科学 2026-05-28 Haihui Pan , Junwei Bao , Hongfei Jiang , Yang Song

A particularly successful class of approaches for few-shot learning combines language models with prompts -- hand-crafted task descriptions that complement data samples. However, designing prompts by hand for each task commonly requires…

计算与语言 · 计算机科学 2023-10-24 Rami Aly , Xingjian Shi , Kaixiang Lin , Aston Zhang , Andrew Gordon Wilson

While model-based verifiers are essential for scaling Reinforcement Learning with Verifiable Rewards (RLVR), current outcome-centric verification paradigms primarily focus on the consistency between the final result and the ground truth,…

Text-to-motion generation has advanced with diffusion- and flow-based generative models, yet supervised pretraining remains insufficient to align models with high-level objectives such as semantic consistency, realism, and human preference.…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Xiaofeng Tan , Wanjiang Weng , Hongsong Wang , Fang Zhao , Xin Geng , Liang Wang

Reward models (RMs), which are central to existing post-training methods, aim to align LLM outputs with human values by providing feedback signals during fine-tuning. However, existing RMs struggle to capture nuanced, user-specific…

机器学习 · 计算机科学 2025-08-21 Mengdi Li , Guanqiao Chen , Xufeng Zhao , Haochen Wen , Shu Yang , Di Wang

Recent advances in large-scale generative language models have shown that reasoning capabilities can significantly improve model performance across a variety of tasks. However, the impact of reasoning on a model's ability to mitigate…

计算与语言 · 计算机科学 2025-06-09 Sanchit Kabra , Akshita Jha , Chandan K. Reddy