English
Related papers

Related papers: ADWIN: Adaptive Windows for Horizon-Aware On-Polic…

200 papers

Immersive applications such as virtual and augmented reality impose stringent requirements on frame rate, latency, and synchronization between physical and virtual environments. To meet these requirements, an edge server must render…

Machine Learning · Computer Science 2026-02-10 Xiaoyi Wu , Juaren Steiger , Bin Li , R. Srikant

Knowledge distillation (KD) is a widely used technique to transfer knowledge from a large teacher network to a smaller student model. Traditional KD uses a fixed balancing factor alpha as a hyperparameter to combine the hard-label…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zhengda Li

Many applications of reinforcement learning can be formalized as goal-conditioned environments, where, in each episode, there is a "goal" that affects the rewards obtained during that episode but does not affect the dynamics. Various…

Machine Learning · Computer Science 2023-03-09 Alexander Levine , Soheil Feizi

Nonlinear model predictive control (NMPC) requires accurate and computationally efficient plant models. Our previous work has shown that the classical compartmentalization model reduction approach for distillation columns can be enhanced by…

Optimization and Control · Mathematics 2020-11-26 Jannik T. Lüthje , Jan C. Schulze , Adrian Caspari , Adel Mhamdi , Alexander Mitsos , Pascal Schäfer

Offline Reinforcement Learning (RL) aims to learn effective policies from a static dataset without requiring further agent-environment interactions. However, its practical adoption is often hindered by the need for explicit reward…

Machine Learning · Computer Science 2025-12-23 Gaurav Chaudhary , Laxmidhar Behera

LLM-based generation of SystemVerilog Assertions (SVA) is often reported as nearing saturation, with the strongest specialized model reaching ${\sim}76\%$ accuracy on NL2SVA-Human. We show that this aggregate hides a temporal gap: models…

Hardware Architecture · Computer Science 2026-05-14 Qingyun Zou , Yingze Li , Tianen Liu , Bingsheng He , Weng-Fai Wong

On-policy distillation is a promising approach for transferring knowledge between language models, where a student learns from dense token-level signals along its own trajectories. This framework typically uses reverse KL divergence,…

Machine Learning · Computer Science 2026-05-25 Woogyeol Jin , Taywon Min , Yongjin Yang , Swanand Ravindra Kadhe , Yi Zhou , Dennis Wei , Nathalie Baracaldo , Kimin Lee

Knowledge distillation(KD) aims to improve the performance of a student network by mimicing the knowledge from a powerful teacher network. Existing methods focus on studying what knowledge should be transferred and treat all samples equally…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Youcai Zhang , Zhonghao Lan , Yuchen Dai , Fangao Zeng , Yan Bai , Jie Chang , Yichen Wei

Diffusion Probabilistic Models (DPMs) have emerged as a powerful class of deep generative models, achieving remarkable performance in image synthesis tasks. However, these models face challenges in terms of widespread adoption due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kidist Amde Mekonnen , Nicola Dall'Asen , Paolo Rota

On-policy self-distillation trains a reasoning model on its own rollouts while a teacher, often the same model conditioned on privileged context, provides dense token-level supervision. Existing objectives typically weight the teacher's…

Artificial Intelligence · Computer Science 2026-05-14 Junlong Ke , Zichen Wen , Weijia Li , Conghui He , Linfeng Zhang

While large vision-language models (VLMs) demonstrate strong long-context understanding, their prevalent small branches fail on linguistics-photography alignment for a limited window size. We discover that knowledge distillation improves…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Haoyi Zhou , Shuo Li , Tianyu Chen , Qi Song , Chonghan Gao , Jianxin Li

Knowledge distillation with multiple teachers is increasingly used to improve robustness, efficiency, and safety, yet existing approaches rely largely on heuristic or implementation-specific weighting schemes. This paper develops an…

Machine Learning · Computer Science 2026-01-27 Aaron R. Flouro , Shawn P. Chadwick

Knowledge distillation (KD) is a technique that compresses large teacher models by training smaller student models to mimic them. The success of KD in auto-regressive language models mainly relies on Reverse KL for mode-seeking and…

Computation and Language · Computer Science 2024-09-23 Jun Rao , Xuebo Liu , Zepeng Lin , Liang Ding , Jing Li , Dacheng Tao , Min Zhang

On-the-fly category discovery (OCD) aims to recognize known categories while simultaneously discovering novel ones from an unlabeled online stream, using a model trained only on labeled data. Existing approaches freeze the feature extractor…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanan Wu , Yuhan Yan , Tailai Chen , Zhixiang Chi , ZiZhang Wu , Yi Jin , Yang Wang , Zhenbo Li

Traditional knowledge distillation (KD) relies on a proficient teacher trained on the target task, which is not always available. In this setting, cross-task distillation can be used, enabling the use of any teacher model trained on a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Dylan Auty , Roy Miles , Benedikt Kolbeinsson , Krystian Mikolajczyk

Distillation-based acceleration has become foundational for making autoregressive streaming video diffusion models practical, with distribution matching distillation (DMD) as the de facto choice. Existing methods, however, train the student…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Bin Wu , Mengqi Huang , Shaojin Wu , Weinan Jia , Yuxin Wang , Zhendong Mao , Yongdong Zhang

Knowledge distillation is considered as a training and compression strategy in which two neural networks, namely a teacher and a student, are coupled together during training. The teacher network is supposed to be a trustworthy predictor…

Computation and Language · Computer Science 2020-12-29 Peyman Passban , Yimeng Wu , Mehdi Rezagholizadeh , Qun Liu

Solving complex long-horizon tasks requires strong planning and reasoning capabilities. Although datasets with explicit chain-of-thought (CoT) rationales can substantially benefit learning, they are costly to obtain. To address this…

Artificial Intelligence · Computer Science 2026-05-13 Shengjie Wang , Guanghe Li , Zonghan Yang , Yang Gao

Reinforcement learning (RL) post-training has recently driven major gains in long chain-of-thought reasoning large language models (LLMs), but the high inference cost of such models motivates distillation into smaller students. Most…

Machine Learning · Computer Science 2026-04-13 Zhaoyang Zhang , Shuli Jiang , Yantao Shen , Yuting Zhang , Dhananjay Ram , Shuo Yang , Zhuowen Tu , Wei Xia , Stefano Soatto

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

Machine Learning · Computer Science 2020-08-31 Yiren Lu , Jonathan Tompson