中文
相关论文

相关论文: Guided Self-Evolving LLMs with Minimal Human Super…

200 篇论文

Large language models (LLMs) have improved significantly in their reasoning through extensive training on massive datasets. However, relying solely on additional data for improvement is becoming increasingly impractical, highlighting the…

计算与语言 · 计算机科学 2025-10-01 Gaurav Srivastava , Zhenyu Bi , Meng Lu , Xuan Wang

Training a task-specific small reasoning model is challenging when direct human supervision or high-quality labels are scarce. However, LLMs with reasoning capabilities produce abundant intermediate reasoning traces that can be…

计算与语言 · 计算机科学 2025-09-19 Sumanta Bhattacharyya , Sara Riazi , Pedram Rooshenas

Creating high-quality data for training robust language-instructed agents is a long-lasting challenge in embodied AI. In this paper, we introduce a Self-Refining Data Flywheel (SRDF) that generates high-quality and large-scale navigational…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Zun Wang , Jialu Li , Yicong Hong , Songze Li , Kunchang Li , Shoubin Yu , Yi Wang , Yu Qiao , Yali Wang , Mohit Bansal , Limin Wang

Large Language Models (LLMs) have demonstrated remarkable progress in complex reasoning tasks through both post-training and test-time scaling laws. While prevalent test-time scaling approaches are often realized by using external reward…

机器学习 · 计算机科学 2025-10-31 Fuxiang Zhang , Jiacheng Xu , Chaojie Wang , Ce Cui , Yang Liu , Bo An

While language models have shown remarkable performance across diverse tasks, they still encounter challenges in complex reasoning scenarios. Recent research suggests that language models trained on linearized search traces toward…

人工智能 · 计算机科学 2025-10-28 Seungyong Moon , Bumsoo Park , Hyun Oh Song

Scaling up self-supervised learning has driven breakthroughs in language and vision, yet comparable progress has remained elusive in reinforcement learning (RL). In this paper, we study building blocks for self-supervised RL that unlock…

机器学习 · 计算机科学 2026-02-03 Kevin Wang , Ishaan Javali , Michał Bortkiewicz , Tomasz Trzciński , Benjamin Eysenbach

We present a general framework for evolutionary learning to emergent unbiased state representation without any supervision. Evolutionary frameworks such as self-play converge to bad local optima in case of multi-agent reinforcement learning…

机器学习 · 统计学 2023-02-03 Shohei Ohsawa

Prompt-based continual learning provides a rehearsal-free solution by tuning small sets of parameters while keeping pre-trained models frozen. To meet the complex demands of sequential tasks, it is crucial to integrate task-specific…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Kiseong Hong , Gyeong-hyeon Kim , Eunwoo Kim

Traditional methods for automating recommender system design, such as Neural Architecture Search (NAS), are often constrained by a fixed search space defined by human priors, limiting innovation to pre-defined operators. While recent…

信息检索 · 计算机科学 2026-02-16 Sein Kim , Sangwu Park , Hongseok Kang , Wonjoong Kim , Jimin Seo , Yeonjun In , Kanghoon Yoon , Chanyoung Park

Large language models often struggle with length generalization and solving complex problem instances beyond their training distribution. We present a self-improvement approach where models iteratively generate and learn from their own…

机器学习 · 计算机科学 2025-02-14 Nayoung Lee , Ziyang Cai , Avi Schwarzschild , Kangwook Lee , Dimitris Papailiopoulos

Recently, self-supervised learning methods like MoCo, SimCLR, BYOL and SwAV have reduced the gap with supervised methods. These results have been achieved in a control environment, that is the highly curated ImageNet dataset. However, the…

Drifting, characterized by controlled vehicle motion at high sideslip angles, is crucial for safely handling emergency scenarios at the friction limits. While recent reinforcement learning approaches show promise for drifting control, they…

机器人学 · 计算机科学 2025-08-04 Yihan Zhou , Yiwen Lu , Bo Yang , Jiayun Li , Yilin Mo

Significant progress in reward modeling over recent years has been driven by a paradigm shift from task-specific designs towards generalist reward models. Despite this trend, developing effective reward models remains a fundamental…

Reflection is widely recognized as a cornerstone of student development, fostering critical thinking, self-regulation, and deep conceptual understanding. Traditionally, reflective skills have been cultivated through structured feedback,…

人机交互 · 计算机科学 2025-09-10 Bo Yuan , Jiazi Hu

Co-evolutionary self-play, where one language model generates problems and another solves them, promises autonomous curriculum learning without human supervision. In practice, the proposer quickly converges to a narrow distribution of…

计算与语言 · 计算机科学 2026-04-29 Jacob Dineen , Aswin RRV , Zhikun Xu , Ben Zhou

Existing low-light image enhancement (LIE) methods have achieved noteworthy success in solving synthetic distortions, yet they often fall short in practical applications. The limitations arise from two inherent challenges in real-world LIE:…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Yunlong Lin , Tian Ye , Sixiang Chen , Zhenqi Fu , Yingying Wang , Wenhao Chai , Zhaohu Xing , Lei Zhu , Xinghao Ding

Recent advances in test-time scaling have led to the emergence of thinking LLMs that exhibit self-reflective behaviors and multi-step reasoning. While RL drives this self-improvement paradigm, a recent study (Gandhi et al., 2025) shows that…

人工智能 · 计算机科学 2025-08-22 Aswin RRV , Jacob Dineen , Divij Handa , Md Nayem Uddin , Mihir Parmar , Chitta Baral , Ben Zhou

Reinforcement learning from verifiable rewards (RLVR) has improved the reasoning abilities of LLMs, yet a fundamental limitation remains: models cannot learn from problems that are too difficult to solve under their current policy, as these…

Reward modeling (RM), which captures human preferences to align large language models (LLMs), is increasingly employed in tasks such as model finetuning, response filtering, and ranking. However, due to the inherent complexity of human…

计算与语言 · 计算机科学 2026-04-09 Pankayaraj Pathmanathan , Furong Huang

When asked a question in a language less seen in its training data, current reasoning large language models (RLMs) often exhibit dramatically lower performance than when asked the same question in English. In response, we introduce…

计算与语言 · 计算机科学 2026-01-27 Lintang Sutawika , Gokul Swamy , Zhiwei Steven Wu , Graham Neubig