English
Related papers

Related papers: LLM Distillation for Efficient Few-Shot Multiple C…

200 papers

The performance of Large Language Models (LLMs) on multiple-choice question (MCQ) benchmarks is frequently cited as proof of their medical capabilities. We hypothesized that LLM performance on medical MCQs may in part be illusory and driven…

In education, the capability of generating human-like text of Large Language Models (LLMs) inspired work on how they can increase the efficiency of learning and teaching. We study the affordability of these models for educators and students…

Computation and Language · Computer Science 2025-03-06 Bianca Raimondi , Saverio Giallorenzo , Maurizio Gabbrielli

We introduce a large language model (LLM) based approach to answer complex questions requiring multi-hop numerical reasoning over financial reports. While LLMs have exhibited remarkable performance on various natural language and reasoning…

Computation and Language · Computer Science 2023-11-28 Karmvir Singh Phogat , Chetan Harsha , Sridhar Dasaratha , Shashishekar Ramakrishna , Sai Akhil Puranam

Large Language Models (LLMs) often struggle with tasks requiring mathematical reasoning, particularly multiple-choice questions (MCQs). To address this issue, we developed LLaMa-SciQ, an educational chatbot designed to assist college…

Artificial Intelligence · Computer Science 2024-09-26 Marc-Antoine Allard , Matin Ansaripour , Maria Yuffa , Paul Teiletche

Multiple-choice questions (MCQ) are frequently used to assess large language models (LLMs). Typically, an LLM is given a question and selects the answer deemed most probable after adjustments for factors like length. Unfortunately, LLMs may…

Computation and Language · Computer Science 2024-06-12 Aidar Myrzakhan , Sondos Mahmoud Bsharat , Zhiqiang Shen

Large Language Models (LLMs) have shown outstanding performance across wide range of downstream tasks. This competency is attributed to their substantial parameter size and pre-training on extensive corpus. Moreover, LLMs have exhibited…

Computation and Language · Computer Science 2023-08-10 Yuhan Ma , Haiqi Jiang , Chenyou Fan

While Large Language Models (LLMs) have demonstrated significant promise as agents in interactive tasks, their substantial computational requirements and restricted number of calls constrain their practical utility, especially in…

Machine Learning · Computer Science 2024-05-07 Maryam Hashemzadeh , Elias Stengel-Eskin , Sarath Chandar , Marc-Alexandre Cote

Medical question-answering (QA) systems can benefit from advances in large language models (LLMs), but directly applying LLMs to the clinical domain poses challenges such as maintaining factual accuracy and avoiding hallucinations. In this…

Computation and Language · Computer Science 2025-12-08 Tasnimul Hassan , Md Faisal Karim , Haziq Jeelani , Elham Behnam , Robert Green , Fayeq Jeelani Syed

Large Language Models (LLMs) have demonstrated great performance in few-shot In-Context Learning (ICL) for a variety of generative and discriminative chemical design tasks. The newly expanded context windows of LLMs can further improve ICL…

Recent advances in large language models (LLMs) have significantly impacted the domain of multi-hop question answering (MHQA), where systems are required to aggregate information and infer answers from disparate pieces of text. However, the…

Computation and Language · Computer Science 2024-10-02 Seongmin Lee , Jaewook Shin , Youngjin Ahn , Seokin Seo , Ohjoon Kwon , Kee-Eung Kim

Knowledge distillation typically involves transferring knowledge from a Large Language Model (LLM) to a Smaller Language Model (SLM). However, in tasks such as text matching, fine-tuned smaller models often yield more effective…

Computation and Language · Computer Science 2025-07-09 Mingzhe Li , Jing Xiang , Qishen Zhang , Kaiyang Wan , Xiuying Chen

The availability of large, high-quality datasets has been one of the main drivers of recent progress in question answering (QA). Such annotated datasets however are difficult and costly to collect, and rarely exist in languages other than…

Computation and Language · Computer Science 2023-08-08 Priyanka Agrawal , Chris Alberti , Fantine Huot , Joshua Maynez , Ji Ma , Sebastian Ruder , Kuzman Ganchev , Dipanjan Das , Mirella Lapata

It is important to develop mathematically tractable models than can interpret knowledge extracted from the data and provide reasonable predictions. In this paper, we present a Linear Distillation Learning, a simple remedy to improve the…

Machine Learning · Computer Science 2019-10-14 Arip Asadulaev , Igor Kuznetsov , Andrey Filchenkov

Large Language Models (LLMs) have become essential tools across various domains due to their impressive capabilities in understanding and generating human-like text. The ability to accurately answer multiple-choice questions (MCQs) holds…

Computation and Language · Computer Science 2025-01-06 Mohamed Hisham Abdellatif

This paper proposes LLaFS, the first attempt to leverage large language models (LLMs) in few-shot segmentation. In contrast to the conventional few-shot segmentation methods that only rely on the limited and biased information from the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Lanyun Zhu , Tianrun Chen , Deyi Ji , Jieping Ye , Jun Liu

Few-shot prompting and step-by-step reasoning have enhanced the capabilities of Large Language Models (LLMs) in tackling complex tasks including code generation. In this paper, we introduce a prompt selection and augmentation algorithm…

Robotics · Computer Science 2024-03-21 On Tai Wu , Frodo Kin Sun Chan , Zunhao Zhang , Yan Nei Law , Benny Drescher , Edmond Shiao Bun Lai

We introduce a low-resource safety enhancement method for aligning large language models (LLMs) without the need for supervised fine-tuning (SFT) or reinforcement learning from human feedback (RLHF). Our main idea is to exploit knowledge…

Computation and Language · Computer Science 2024-06-07 Haozheng Luo , Jiahao Yu , Wenxin Zhang , Jialong Li , Jerry Yao-Chieh Hu , Xinyu Xing , Han Liu

Knowledge distillation plays a key role in compressing the Large Language Models (LLMs), which boosts a small-size student model under large teacher models' guidance. However, existing LLM distillation methods overly rely on…

Computation and Language · Computer Science 2024-07-16 Xiaoyu Liu , Yun Zhang , Wei Li , Simiao Li , Xudong Huang , Hanting Chen , Yehui Tang , Jie Hu , Zhiwei Xiong , Yunhe Wang

In recent years, the use of large language models (LLMs) has significantly increased, and these models have demonstrated remarkable performance in a variety of general language tasks. However, the evaluation of their performance in…

Computation and Language · Computer Science 2025-01-14 Iman Barati , Arash Ghafouri , Behrouz Minaei-Bidgoli

Large Language Models (LLMs) enable advanced natural language processing but face deployment challenges on resource-constrained edge devices due to high computational, memory, and energy demands. Optimizing these models requires addressing…

Machine Learning · Computer Science 2026-01-16 Jacob Sander , Brian Jalaian , Venkat R. Dasari