English
Related papers

Related papers: Making LLMs Worth Every Penny: Resource-Limited Te…

200 papers

The traditional data annotation process is often labor-intensive, time-consuming, and susceptible to human bias, which complicates the management of increasingly complex datasets. This study explores the potential of large language models…

Computation and Language · Computer Science 2024-09-17 Jianfei Wu , Xubin Wang , Weijia Jia

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we…

Computation and Language · Computer Science 2021-05-03 Sinong Wang , Han Fang , Madian Khabsa , Hanzi Mao , Hao Ma

Cross-lingual summarization (XLS) aims to generate a summary in a target language different from the source language document. While large language models (LLMs) have shown promising zero-shot XLS performance, their few-shot capabilities on…

Computation and Language · Computer Science 2024-06-10 Gyutae Park , Seojin Hwang , Hwanhee Lee

Training or finetuning large-scale language models (LLMs) such as GPT-3 requires substantial computation resources, motivating recent efforts to explore parameter-efficient adaptation to downstream tasks. One practical area of research is…

Computation and Language · Computer Science 2023-10-23 Danqing Luo , Chen Zhang , Jiahui Xu , Bin Wang , Yiming Chen , Yan Zhang , Haizhou Li

Large language models show promise for legal applications, but deploying frontier models raises concerns about cost, latency, and data privacy. We evaluate whether sub-10B parameter models can serve as practical alternatives by testing nine…

Computation and Language · Computer Science 2026-03-30 Snehit Vaddi

We introduce LAMPO, a novel paradigm that leverages Large Language Models (LLMs) for solving few-shot multi-class ordinal classification tasks. Unlike conventional methods, which concatenate all demonstration examples with the test instance…

Machine Learning · Computer Science 2024-08-08 Zhen Qin , Junru Wu , Jiaming Shen , Tianqi Liu , Xuanhui Wang

Collecting labeled datasets in finance is challenging due to scarcity of domain experts and higher cost of employing them. While Large Language Models (LLMs) have demonstrated remarkable performance in data annotation tasks on general…

Computation and Language · Computer Science 2024-03-28 Toyin Aguda , Suchetha Siddagangappa , Elena Kochkina , Simerjot Kaur , Dongsheng Wang , Charese Smiley , Sameena Shah

Large language models (LLMs) have made significant strides at code generation through improved model design, training, and chain-of-thought. However, prompt-level optimizations remain an important yet under-explored aspect of LLMs for…

Software Engineering · Computer Science 2024-12-05 Derek Xu , Tong Xie , Botao Xia , Haoyu Li , Yunsheng Bai , Yizhou Sun , Wei Wang

The generative large language models (LLMs) are increasingly used for data augmentation tasks, where text samples are paraphrased (or generated anew) and then used for classifier fine-tuning. Existing works on augmentation leverage the…

Computation and Language · Computer Science 2024-10-15 Jan Cegin , Branislav Pecher , Jakub Simko , Ivan Srba , Maria Bielikova , Peter Brusilovsky

Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars. Notably, chain of thought (CoT) prompting, a…

Computation and Language · Computer Science 2023-01-31 Takeshi Kojima , Shixiang Shane Gu , Machel Reid , Yutaka Matsuo , Yusuke Iwasawa

A long-running goal of the clinical NLP community is the extraction of important variables trapped in clinical notes. However, roadblocks have included dataset shift from the general domain and a lack of public clinical corpora and…

Computation and Language · Computer Science 2022-12-01 Monica Agrawal , Stefan Hegselmann , Hunter Lang , Yoon Kim , David Sontag

Recent research has demonstrated the feasibility of training efficient intent detectors based on pre-trained language model~(PLM) with limited labeled data. However, deploying these detectors in resource-constrained environments such as…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Albert Y. S. Lam , Xiao-Ming Wu

Large language models (LLMs) such as GPT-4o and Claude Sonnet 4.5 have demonstrated strong capabilities in open-ended reasoning and generative language tasks, leading to their widespread adoption across a broad range of NLP applications.…

Computation and Language · Computer Science 2026-02-09 Alberto Andres Valdes Gonzalez

Large Language Models (LLMs) have attracted significant attention for classification tasks, offering a flexible alternative to trusted classical machine learning models like LightGBM through zero-shot prompting. However, their reliability…

Machine Learning · Computer Science 2025-12-02 Saeed AlMarri , Mathieu Ravaut , Kristof Juhasz , Gautier Marti , Hamdan Al Ahbabi , Ibrahim Elfadel

We introduce FinanceMath, a novel benchmark designed to evaluate LLMs' capabilities in solving knowledge-intensive math reasoning problems. Compared to prior works, this study features three core advancements. First, FinanceMath includes…

Computation and Language · Computer Science 2024-08-09 Yilun Zhao , Hongjun Liu , Yitao Long , Rui Zhang , Chen Zhao , Arman Cohan

Recent studies report that autoregressive language models can successfully solve many NLP tasks via zero- and few-shot learning paradigms, which opens up new possibilities for using the pre-trained language models. This paper introduces two…

Computation and Language · Computer Science 2023-10-13 Oleh Shliazhko , Alena Fenogenova , Maria Tikhonova , Vladislav Mikhailov , Anastasia Kozlova , Tatiana Shavrina

E-commerce platforms require structured product data in the form of attribute-value pairs to offer features such as faceted product search or attribute-based product comparison. However, vendors often provide unstructured product…

Computation and Language · Computer Science 2024-09-23 Alexander Brinkmann , Roee Shraga , Christian Bizer

Text-attributed graphs have recently garnered significant attention due to their wide range of applications in web domains. Existing methodologies employ word embedding models for acquiring text representations as node features, which are…

Machine Learning · Computer Science 2024-12-11 Jianxiang Yu , Yuxiang Ren , Chenghua Gong , Jiaqi Tan , Xiang Li , Xuecang Zhang

Large Language Models (LLMs) have demonstrated impressive capabilities across diverse Natural Language Processing (NLP) tasks, including language understanding, reasoning, and generation. However, general-domain LLMs often struggle with…

Computation and Language · Computer Science 2024-11-06 Sorouralsadat Fatemi , Yuheng Hu , Maryam Mousavi

In recent years, Large Language Models (LLMs) have demonstrated remarkable versatility across various applications, including natural language understanding, domain-specific knowledge tasks, etc. However, applying LLMs to complex,…

Computation and Language · Computer Science 2024-11-12 Xinqi Yang , Scott Zang , Yong Ren , Dingjie Peng , Zheng Wen