English
Related papers

Related papers: Distilling Bayesian Belief States into Language Mo…

200 papers

Recent advances in self-supervised learning have experienced remarkable progress, especially for contrastive learning based methods, which regard each image as well as its augmentations as an individual class and try to distinguish them…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Haohang Xu , Jiemin Fang , Xiaopeng Zhang , Lingxi Xie , Xinggang Wang , Wenrui Dai , Hongkai Xiong , Qi Tian

Large language models (LMs) beyond a certain scale, demonstrate the emergent capability of generating free-text rationales for their predictions via chain-of-thought (CoT) prompting. While CoT can yield dramatically improved performance,…

Computation and Language · Computer Science 2023-09-01 Peifeng Wang , Zhengyang Wang , Zheng Li , Yifan Gao , Bing Yin , Xiang Ren

Small Language Models (SLMs, under 10B parameters) are attractive for private, on-device deployment, yet they frequently fail on strict constraint-satisfaction problems due to linear, overconfident reasoning traces that do not recover from…

Computation and Language · Computer Science 2026-01-22 Aradhya Dixit , Tianxi Liang , Jai Telang

Hand-crafting high quality prompts to optimize the performance of language models is a complicated and labor-intensive process. Furthermore, when migrating to newer, smaller, or weaker models (possibly due to latency or cost gains), prompts…

We propose a conceptually simple and lightweight framework for improving the robustness of vision models through the combination of knowledge distillation and data augmentation. We address the conjecture that larger models do not make for…

Machine Learning · Computer Science 2024-02-06 Andy Zhou , Jindong Wang , Yu-Xiong Wang , Haohan Wang

Knowledge distillation is often used to transfer knowledge from a strong teacher model to a relatively weak student model. Traditional methods include response-based methods and feature-based methods. Response-based methods are widely used…

Information Retrieval · Computer Science 2023-12-12 Hao Sun , Xiao Liu , Yeyun Gong , Anlei Dong , Jingwen Lu , Yan Zhang , Linjun Yang , Rangan Majumder , Nan Duan

Tool-integrated reasoning (TIR) is difficult to scale to small language models due to instability in long-horizon tool interactions and limited model capacity. While reinforcement learning methods like group relative policy optimization…

Computation and Language · Computer Science 2026-05-11 Qiyong Zhong , Mao Zheng , Mingyang Song , Xin Lin , Jie Sun , Houcheng Jiang , Xiang Wang , Junfeng Fang

Large language models (LLMs) define a distribution over text, which can be viewed as a probabilistic representation of uncertainty: sampling K responses yields a belief state - responses a model deems plausible. Existing work exploits this…

Computation and Language · Computer Science 2026-05-26 Joris Baan , Wilker Aziz , Barbara Plank , Raquel Fernández

With the adoption of retrieval-augmented generation (RAG), large language models (LLMs) are expected to ground their generation to the retrieved contexts. Yet, this is hindered by position bias of LLMs, failing to evenly attend to all…

Computation and Language · Computer Science 2024-12-20 Youngwon Lee , Seung-won Hwang , Daniel Campos , Filip Graliński , Zhewei Yao , Yuxiong He

As Large Language Models (LLMs) continue to grow in both capability and cost, transferring frontier capabilities into smaller, deployable students has become a central engineering problem, and knowledge distillation remains the dominant…

Machine Learning · Computer Science 2026-05-19 Mingyang Song , Mao Zheng

Large vision-language models have achieved outstanding performance, but their size and computational requirements make their deployment on resource-constrained devices and time-sensitive tasks impractical. Model distillation, the process of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Xuanlin Li , Yunhao Fang , Minghua Liu , Zhan Ling , Zhuowen Tu , Hao Su

Recently, multi-modal content generation has attracted lots of attention from researchers by investigating the utilization of visual instruction tuning based on large language models (LLMs). To enhance the performance and generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Xinwei Li , Li Lin , Shuai Wang , Chen Qian

Question answering (QA) models are well-known to exploit data bias, e.g., the language prior in visual QA and the position bias in reading comprehension. Recent debiasing methods achieve good out-of-distribution (OOD) generalizability with…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Yulei Niu , Hanwang Zhang

While long Chain-of-Thought (CoT) distillation effectively transfers reasoning capability to smaller language models, the reasoning process often remains redundant and computational budget uncontrollable, leading to inefficient resource…

Computation and Language · Computer Science 2025-12-29 Lujie Niu , Lei Shen , Yi Jiang , Caixia Yuan , Xiaojie Wang , Wenbo Su , Bo zheng

Large language models (LLMs) have progressed rapidly in complex reasoning and question answering, yet LLM hallucination remains a central bottleneck that hinders practical deployment, especially for commercial black-box LLMs accessible only…

Computation and Language · Computer Science 2026-05-08 Huizi Cui , Huan Ma , Qilin Wang , Yuhang Gao , Changqing Zhang

This paper proposes the DistillCSE framework, which performs contrastive learning under the self-training paradigm with knowledge distillation. The potential advantage of DistillCSE is its self-enhancing feature: using a base model to…

Computation and Language · Computer Science 2023-12-25 Jiahao Xu , Wei Shao , Lihui Chen , Lemao Liu

Multi-agent debate (MAD) is widely used to improve large language model (LLM) performance through test-time scaling, yet recent work shows that vanilla MAD often underperforms simple majority vote despite higher computational cost. Studies…

Computation and Language · Computer Science 2026-01-29 Xiaochen Zhu , Caiqi Zhang , Yizhou Chi , Tom Stafford , Nigel Collier , Andreas Vlachos

Large Language models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities, where a LLM makes predictions for a given test input together with a few input-output pairs (demonstrations). Nevertheless, the inclusion of…

Computation and Language · Computer Science 2024-03-13 Yichuan Li , Xiyao Ma , Sixing Lu , Kyumin Lee , Xiaohu Liu , Chenlei Guo

Knowledge distillation offers a transformative pathway to developing powerful, yet efficient, small language models (SLMs) suitable for resource-constrained environments. In this paper, we benchmark the performance and computational cost of…

Computation and Language · Computer Science 2026-02-25 Sachin Gopal Wani , Eric Page , Ajay Dholakia , David Ellison

How do people understand and evaluate claims about others' beliefs, even though these beliefs cannot be directly observed? In this paper, we introduce a cognitive model of epistemic language interpretation, grounded in Bayesian inferences…

Computation and Language · Computer Science 2025-04-21 Lance Ying , Tan Zhi-Xuan , Lionel Wong , Vikash Mansinghka , Joshua B. Tenenbaum