English
Related papers

Related papers: ThinkFL: Self-Refining Failure Localization for Mi…

200 papers

Large Language Model (LLM) serving systems remain fundamentally fragile, where frequent hardware faults in hyperscale clusters trigger disproportionate service outages in the software stack. Current recovery mechanisms are prohibitively…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-02 Shangshu Qian , Kipling Liu , P. C. Sruthi , Lin Tan , Yongle Zhang

When applying reinforcement learning--typically through GRPO--to large vision-language model reasoning struggles to effectively scale reasoning length or generates verbose outputs across all tasks with only marginal gains in accuracy. To…

Computation and Language · Computer Science 2025-10-24 Wenyi Xiao , Leilei Gan

Recent advances in vision-language models (VLMs) reasoning have been largely attributed to the rise of reinforcement Learning (RL), which has shifted the community's focus away from the supervised fine-tuning (SFT) paradigm. Many studies…

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

Machine Learning · Computer Science 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Function call capabilities have become crucial for Large Language Models (LLMs), enabling them to interact more effectively with external tools and APIs. Existing methods for improving the function call capabilities of LLMs rely on data…

Artificial Intelligence · Computer Science 2026-01-28 Weiran Guo , Bing Bo , Shaoxiang Wu , Jingsheng Yang

E-commerce platforms and payment solution providers face increasingly sophisticated fraud schemes, ranging from identity theft and account takeovers to complex money laundering operations that exploit the speed and anonymity of digital…

Artificial Intelligence · Computer Science 2026-01-12 Cooper Lin , Yanting Zhang , Maohao Ran , Wei Xue , Hongwei Fan , Yibo Xu , Zhenglin Wan , Sirui Han , Yike Guo , Jun Song

Reasoning capability plays a significantly critical role in the the broad applications of Large Language Models (LLMs). To enhance the reasoning performance of LLMs, diverse Reinforcement Learning (RL)-based fine-tuning approaches have been…

Computation and Language · Computer Science 2025-09-09 Wenqiao Zhu , Ji Liu , Rongjuncheng Zhang , Haipang Wu , Yulun Zhang

In the era of foundation models, fine-tuning pre-trained models for specific downstream tasks has become crucial. This drives the need for robust fine-tuning methods to address challenges such as model overfitting and sparse labeling.…

Machine Learning · Computer Science 2025-12-12 Shikun Liu , Deyu Zou , Nima Shoghi , Victor Fung , Kai Liu , Pan Li

Fine-tuning foundation models is critical for superior performance on personalized downstream tasks, compared to using pre-trained models. Collaborative learning can leverage local clients' datasets for fine-tuning, but limited client data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Tianjun Yuan , Jiaxiang Geng , Pengchao Han , Xianhao Chen , Bing Luo

Large language models (LLMs) have demonstrated remarkable capabilities in various tasks. However, their suitability for domain-specific tasks, is limited due to their immense scale at deployment, susceptibility to misinformation, and more…

Computation and Language · Computer Science 2023-11-01 Jiaxin Zhang , Zhuohang Li , Kamalika Das , Sricharan Kumar

In this survey, we systematically summarize the current literature on studies that apply reinforcement learning (RL) to the motion planning and control of autonomous vehicles. Many existing contributions can be attributed to the pipeline…

Robotics · Computer Science 2021-06-02 Fei Ye , Shen Zhang , Pin Wang , Ching-Yao Chan

Large language models have emerged as powerful tools for general intelligence, showcasing advanced natural language processing capabilities that find applications across diverse domains. Despite their impressive performance, recent studies…

Computation and Language · Computer Science 2025-04-01 Elita Lobo , Chirag Agarwal , Himabindu Lakkaraju

In this work, we present a simple yet theoretically motivated improvement to Supervised Fine-Tuning (SFT) for the Large Language Model (LLM), addressing its limited generalization compared to reinforcement learning (RL). Through…

Machine Learning · Computer Science 2026-03-02 Yongliang Wu , Yizhou Zhou , Zhou Ziheng , Yingzhe Peng , Xinyu Ye , Xinting Hu , Wenbo Zhu , Lu Qi , Ming-Hsuan Yang , Xu Yang

While critical for alignment, Supervised Fine-Tuning (SFT) incurs the risk of catastrophic forgetting, yet the layer-wise emergence of instruction-following capabilities remains elusive. We investigate this mechanism via a comprehensive…

Machine Learning · Computer Science 2026-04-15 Qinghua Zhao , Xueling Gong , Xinyu Chen , Zhongfeng Kang , Xinlu Li

Supervised Fine-Tuning (SFT) Large Language Models (LLM) fundamentally rely on high-quality training data. While data selection and data synthesis are two common strategies to improve data quality, existing approaches often face limitations…

Computation and Language · Computer Science 2025-10-23 Zinan Tang , Xin Gao , Qizhi Pei , Zhuoshi Pan , Mengzhang Cai , Jiang Wu , Conghui He , Lijun Wu

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

With the rapid advancement of Large Language Models (LLMs), the Chain-of-Thought (CoT) component has become significant for complex reasoning tasks. However, in conventional Supervised Fine-Tuning (SFT), the model could allocate…

Computation and Language · Computer Science 2025-12-25 Xiaofeng Shi , Qian Kou , Yuduo Li , Hua Zhou

Continual learning (CL) for Foundation Models (FMs) is an essential yet underexplored challenge, especially in Federated Continual Learning (FCL), where each client learns from a private, evolving task stream under strict data and…

Machine Learning · Computer Science 2025-08-14 Hao Yu , Xin Yang , Boyang Fan , Xuemei Cao , Hanlin Gu , Lixin Fan , Qiang Yang

Understanding spatial dynamics and semantics in point cloud is fundamental for comprehensive 3D comprehension. While reinforcement learning algorithms such as Group Relative Policy Optimization (GRPO) have recently achieved remarkable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yankai Wang , Yiding Sun , Qirui Wang , Pengbo Li , Chaoyi Lu , Dongxu Zhang

Diffusion models recently emerged as a powerful paradigm for recommender systems, offering state-of-the-art performance by modeling the generative process of user-item interactions. However, training such models from scratch is both…

Information Retrieval · Computer Science 2025-11-11 Yu Hou , Hua Li , Ha Young Kim , Won-Yong Shin