English
Related papers

Related papers: PHUDGE: Phi-3 as Scalable Judge

200 papers

Large Language Models (LLMs) have demonstrated considerable advances, and several claims have been made about their exceeding human performance. However, in real-world tasks, domain knowledge is often required. Low-resource learning methods…

Computation and Language · Computer Science 2023-11-17 Yuxuan Lu , Bingsheng Yao , Shao Zhang , Yun Wang , Peng Zhang , Tun Lu , Toby Jia-Jun Li , Dakuo Wang

Scaling large language models (LLMs) significantly improves performance but comes with prohibitive computational costs. Mixture-of-Experts (MoE) models offer an efficient alternative, increasing capacity without a proportional rise in…

Machine Learning · Computer Science 2024-12-16 Aditya Vavre , Ethan He , Dennis Liu , Zijie Yan , June Yang , Nima Tajbakhsh , Ashwath Aithal

Large Language Models (LLMs) are increasingly adopted as evaluators, offering a scalable alternative to human annotation. However, existing supervised fine-tuning (SFT) approaches often fall short in domains that demand complex reasoning.…

Computation and Language · Computer Science 2025-11-04 Nuo Chen , Zhiyuan Hu , Qingyun Zou , Jiaying Wu , Qian Wang , Bryan Hooi , Bingsheng He

Pre-trained models have become indispensable for efficiently building models across a broad spectrum of downstream tasks. The advantages of pre-trained models have been highlighted by empirical studies on scaling laws, which demonstrate…

Machine Learning · Statistics 2026-02-05 Kazuto Fukuchi , Ryuichiro Hataya , Kota Matsui

The Outstanding performance and growing size of Large Language Models has led to increased attention in parameter efficient learning. The two predominant approaches are Adapters and Pruning. Adapters are to freeze the model and give it a…

Computation and Language · Computer Science 2023-04-07 Guorun Wang , Jun Yang , Yaoru Sun

Human evaluation is increasingly critical for assessing large language models, capturing linguistic nuances, and reflecting user preferences more accurately than traditional automated metrics. However, the resource-intensive nature of this…

Computation and Language · Computer Science 2023-10-24 Meriem Boubdir , Edward Kim , Beyza Ermis , Marzieh Fadaee , Sara Hooker

Recent advancements in the field of large language models, particularly through the Chain of Thought (CoT) approach, have demonstrated significant improvements in solving complex problems. However, existing models either tend to sacrifice…

Computation and Language · Computer Science 2025-12-30 Yijiong Yu

This paper is not motivated to seek innovation within the attention mechanism. Instead, it focuses on overcoming the existing trade-offs between accuracy and efficiency within the context of point cloud processing, leveraging the power of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Xiaoyang Wu , Li Jiang , Peng-Shuai Wang , Zhijian Liu , Xihui Liu , Yu Qiao , Wanli Ouyang , Tong He , Hengshuang Zhao

Recent years have witnessed meteoric progress in reasoning models: neural networks that generate intermediate reasoning traces (RTs) before producing a final output. Despite the rapid advancement, our understanding of how RTs support…

Artificial Intelligence · Computer Science 2026-02-17 William L. Tong , Ege Cakar , Cengiz Pehlevan

With the increasing size of large language models, layer pruning has gained increased attention as a hardware-friendly approach for model compression. However, existing layer pruning methods struggle to simultaneously address key practical…

Computation and Language · Computer Science 2025-11-24 Tao Yuan , Haoli Bai , Yinfei Pan , Xuyang Cao , Tianyu Zhang , Lu Hou , Ting Hu , Xianzhi Yu

Large Language Models (LLMs) are so powerful that they sometimes learn correlations between labels and features that are irrelevant to the task, leading to poor generalization on out-of-distribution data. We propose explanation-based…

Computation and Language · Computer Science 2023-06-07 Josh Magnus Ludan , Yixuan Meng , Tai Nguyen , Saurabh Shah , Qing Lyu , Marianna Apidianaki , Chris Callison-Burch

Instruction tuning is critical for adapting large language models (LLMs) to downstream tasks, and recent studies have demonstrated that small amounts of human-curated data can outperform larger datasets, challenging traditional data scaling…

Computation and Language · Computer Science 2025-03-07 Jinlong Pang , Jiaheng Wei , Ankit Parag Shah , Zhaowei Zhu , Yaxuan Wang , Chen Qian , Yang Liu , Yujia Bao , Wei Wei

Following its success in natural language processing and computer vision, foundation models that are pre-trained on large-scale multi-task datasets have also shown great potential in robotics. However, most existing robot foundation models…

Robotics · Computer Science 2025-03-13 Rujia Yang , Geng Chen , Chuan Wen , Yang Gao

Meta learning approaches to few-shot classification are computationally efficient at test time, requiring just a few optimization steps or single forward pass to learn a new task, but they remain highly memory-intensive to train. This…

We consider to design a new efficient and easy-to-implement algorithm to solve a general group sparse optimization model with a class of non-convex non-Lipschitz regularizations, named as fast iterative thresholding and support-and-scale…

Optimization and Control · Mathematics 2025-01-09 Yanan Zhao , Qiaoli Dong , Yufei Zhao , Chunlin Wu

In the rapidly advancing field of Large Language Models (LLMs), effectively leveraging existing datasets during fine-tuning to maximize the model's potential is of paramount importance. This paper introduces P3, an adaptive framework aimed…

Computation and Language · Computer Science 2024-10-21 Yingxuan Yang , Huayi Wang , Muning Wen , Xiaoyun Mo , Qiuying Peng , Jun Wang , Weinan Zhang

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

Artificial Intelligence · Computer Science 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

This paper proposes Edge-FIT (Federated Instruction Tuning on the Edge), a scalable framework for Federated Instruction Tuning (FIT) of Large Language Models (LLMs). Traditional Federated Learning (TFL) methods, like FedAvg, fail when…

Machine Learning · Computer Science 2025-10-07 Vinay Venkatesh , Vamsidhar R Kamanuru , Lav Kumar , Nikita Kothari

Learned optimizers are powerful alternatives to hand-designed update rules like Adam, yet they have seen limited practical adoption since they often fail to meta-generalize beyond their training distribution and incur high meta-training…

Machine Learning · Computer Science 2026-02-24 Abhinav Moudgil , Boris Knyazev , Eugene Belilovsky

There has been growing interest in parameter-efficient methods to apply pre-trained language models to downstream tasks. Building on the Prompt Tuning approach of Lester et al. (2021), which learns task-specific soft prompts to condition a…

Computation and Language · Computer Science 2022-03-18 Tu Vu , Brian Lester , Noah Constant , Rami Al-Rfou , Daniel Cer