English
Related papers

Related papers: WST: Weak-to-Strong Knowledge Transfer via Reinfor…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has achieved great success in developing Large Language Models (LLMs) with chain-of-thought rollouts for many tasks such as math and coding. Nevertheless, RLVR struggles with sample…

Machine Learning · Computer Science 2026-05-15 Kai Yan , Alexander G. Schwing , Yu-Xiong Wang

There is increasing interest in distilling task-specific knowledge from large language models (LLM) to smaller student models. Nonetheless, LLM distillation presents a dual challenge: 1) there is a high cost associated with querying the…

Computation and Language · Computer Science 2024-06-11 Yuhang Zhou , Wei Ai

Weak-to-strong generalization, where a student model trained on imperfect labels generated by a weaker teacher nonetheless surpasses that teacher, has been widely observed but the mechanisms that enable it have remained poorly understood.…

Machine Learning · Statistics 2025-05-27 Behrad Moniri , Hamed Hassani

Supervised fine-tuning (SFT) provides the standard approach for teaching LLMs new behaviors from offline expert demonstrations. However, standard SFT uniformly fits all samples -- including those with low likelihood under the base model --…

Machine Learning · Computer Science 2026-05-15 Mahdi Sabbaghi , George Pappas , Adel Javanmard , Hamed Hassani

Large Language Models (LLMs) are changing the coding paradigm, known as vibe coding, yet synthesizing algorithmically sophisticated and robust code still remains a critical challenge. Incentivizing the deep reasoning capabilities of LLMs is…

Computation and Language · Computer Science 2026-02-18 Chansung Park , Juyong Jiang , Fan Wang , Sayak Paul , Jiasi Shen , Jing Tang , Jianguo Li

To continuously enhance model adaptability in surgical video scene parsing, recent studies incrementally update it to progressively learn to segment an increasing number of surgical instruments over time. However, prior works constantly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Yu Zhu , Kang Li , Zheng Li , Pheng-Ann Heng

Large Language Models (LLMs) require alignment with human preferences to avoid generating offensive, false, or meaningless content. Recently, low-resource methods for LLM alignment have been popular, while still facing challenges in…

Computation and Language · Computer Science 2025-06-10 Feifan Song , Shaohang Wei , Wen Luo , Yuxuan Fan , Tianyu Liu , Guoyin Wang , Houfeng Wang

Unlike existing knowledge distillation methods focus on the baseline settings, where the teacher models and training strategies are not that strong and competing as state-of-the-art approaches, this paper presents a method dubbed DIST to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Tao Huang , Shan You , Fei Wang , Chen Qian , Chang Xu

Finite-State Transducers (FSTs) are effective models for string-to-string rewriting tasks, often providing the efficiency necessary for high-performance applications, but constructing transducers by hand is difficult. In this work, we…

Computation and Language · Computer Science 2026-01-21 Michael Ginn , Alexis Palmer , Mans Hulden

Knowledge distillation in machine learning is the process of transferring knowledge from a large model called the teacher to a smaller model called the student. Knowledge distillation is one of the techniques to compress the large network…

Machine Learning · Computer Science 2022-06-27 Durga Prasad Ganta , Himel Das Gupta , Victor S. Sheng

Much literature has shown that prompt-based learning is an efficient method to make use of the large pre-trained language model. Recent works also exhibit the possibility of steering a chatbot's output by plugging in an appropriate prompt.…

Computation and Language · Computer Science 2022-10-14 Hsuan Su , Pohan Chi , Shih-Cheng Huang , Chung Ho Lam , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

With the dramatically increased number of parameters in language models, sparsity methods have received ever-increasing research focus to compress and accelerate the models. While most research focuses on how to accurately retain…

Artificial Intelligence · Computer Science 2022-05-24 Yuchao Li , Fuli Luo , Chuanqi Tan , Mengdi Wang , Songfang Huang , Shen Li , Junjie Bai

Near-field magnetic resonance wireless power transfer (WPT) technology has garnered significant attention due to its broad application prospects in medical implants, electric vehicles, and robotics. Addressing the challenges faced by…

Applied Physics · Physics 2025-05-13 Likai Wang , Yuqian Wang , Shengyu Hu , Yunhui Li , Hong Chen , Ce Wang , Zhiwei Guo

We propose a novel knowledge distillation approach to facilitate the transfer of dark knowledge from a teacher to a student. Contrary to most of the existing methods that rely on effective training of student models given pretrained…

Machine Learning · Computer Science 2022-01-25 Dae Young Park , Moon-Hyun Cha , Changwook Jeong , Dae Sin Kim , Bohyung Han

Model ensemble is a useful approach in reinforcement learning (RL) for training effective agents. Despite wide success of RL, training effective agents remains difficult due to the multitude of factors requiring careful tuning, such as…

Machine Learning · Computer Science 2025-05-22 Yiwen Song , Qianyue Hao , Qingmin Liao , Jian Yuan , Yong Li

Large language models (LLMs) transcend passive generation and act as goal-directed agents by invoking external tools. Reinforcement learning (RL) offers a principled framework for optimizing these emergent tool-use policies, yet the…

Computation and Language · Computer Science 2026-02-05 Zihan Lin , Xiaohan Wang , Jie Cao , Jiajun Chai , Guojun Yin , Wei Lin , Ran He

Enhancing the sustainability and efficiency of wireless sensor networks (WSN) in dynamic and unpredictable environments requires adaptive communication and energy harvesting strategies. We propose a novel adaptive control strategy for WSNs…

Systems and Control · Electrical Eng. & Systems 2026-02-20 Hossein Mohammadi Firouzjaei , Rafaela Scaciota , Sumudu Samarakoon

Recent advances in reinforcement learning (RL) have substantially improved the training of large-scale language models, leading to significant gains in generation quality and reasoning ability. However, most existing research focuses on…

Machine Learning · Computer Science 2026-01-13 Di Zhang , Xun Wu , Shaohan Huang , Lingjie Jiang , Yaru Hao , Li Dong , Zewen Chi , Zhifang Sui , Furu Wei

A safe and efficient decision-making system is crucial for autonomous vehicles. However, the complexity of driving environments limits the effectiveness of many rule-based and machine learning approaches. Reinforcement Learning (RL), with…

Robotics · Computer Science 2024-11-05 Rongliang Zhou , Jiakun Huang , Mingjun Li , Hepeng Li , Haotian Cao , Xiaolin Song

Few-Shot Class-Incremental Learning presents an extension of the Class Incremental Learning problem where a model is faced with the problem of data scarcity while addressing the catastrophic forgetting problem. This problem remains an open…

Machine Learning · Computer Science 2024-05-13 Naeem Paeedeh , Mahardhika Pratama , Sunu Wibirama , Wolfgang Mayer , Zehong Cao , Ryszard Kowalczyk
‹ Prev 1 3 4 5 6 7 10 Next ›