English
Related papers

Related papers: Thinking about GPT-3 In-Context Learning for Biome…

200 papers

Automatic pathological speech detection approaches have shown promising results, gaining attention as potential diagnostic tools alongside costly traditional methods. While these approaches can achieve high accuracy, their lack of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-01 Mahdi Amiri , Hatef Otroshi Shahreza , Ina Kodrasi

We introduce a few-shot benchmark consisting of 7 different classification tasks native to the Polish language. We conducted an empirical comparison with 0 and 16 shots between fine-tuning, linear probing, SetFit, and in-context learning…

Computation and Language · Computer Science 2024-04-30 Tsimur Hadeliya , Dariusz Kajtoch

The use of large language models (LLMs) in healthcare is gaining popularity, but their practicality and safety in clinical settings have not been thoroughly assessed. In high-stakes environments like medical settings, trust and safety are…

Artificial Intelligence · Computer Science 2023-06-29 Salmonn Talebi , Elizabeth Tong , Mohammad R. K. Mofrad

This work presents our participation in the EvalLLM 2025 challenge on biomedical Named Entity Recognition (NER) and health event extraction in French (few-shot setting). For NER, we propose three approaches combining large language models…

Large language models (LLMs) offer impressive performance in various zero-shot and few-shot tasks. However, their success in zero-shot and few-shot settings may be affected by task contamination, a potential limitation that has not been…

Computation and Language · Computer Science 2024-01-02 Changmao Li , Jeffrey Flanigan

In-context machine translation (MT) with large language models (LLMs) is a promising approach for low-resource MT, as it can readily take advantage of linguistic resources such as grammar books and dictionaries. Such resources are usually…

Computation and Language · Computer Science 2025-05-30 Renhao Pei , Yihong Liu , Peiqin Lin , François Yvon , Hinrich Schütze

This paper reports on the use of prompt engineering and GPT-3.5 for biomedical query-focused multi-document summarisation. Using GPT-3.5 and appropriate prompts, our system achieves top ROUGE-F1 results in the task of obtaining…

Computation and Language · Computer Science 2023-11-10 Diego Mollá

Large language models (LLMs) typically utilize the top-k contexts from a retriever in retrieval-augmented generation (RAG). In this work, we propose a novel instruction fine-tuning framework RankRAG, which instruction-tunes a single LLM for…

Computation and Language · Computer Science 2024-07-03 Yue Yu , Wei Ping , Zihan Liu , Boxin Wang , Jiaxuan You , Chao Zhang , Mohammad Shoeybi , Bryan Catanzaro

Large Language Models (LLMs) are transformer-based machine learning models that have shown remarkable performance in tasks for which they were not explicitly trained. Here, we explore the potential of LLMs to perform symbolic regression --…

Computation and Language · Computer Science 2026-04-17 Samiha Sharlin , Tyler R. Josephson

Large Language Models (LLMs) have become ubiquitous in NLP and deep learning. In-Context Learning (ICL) has been suggested as a bridging paradigm between the training-free and fine-tuning LLMs settings. In ICL, an LLM is conditioned to…

Computation and Language · Computer Science 2024-06-12 Jérémie Cabessa , Hugo Hernault , Umer Mushtaq

Large Language Models (LLMs) have recently demonstrated impressive few-shot learning capabilities through in-context learning (ICL). However, ICL performance is highly dependent on the choice of few-shot demonstrations, making the selection…

Computation and Language · Computer Science 2025-06-03 Soumya Suvra Ghosal , Soumyabrata Pal , Koyel Mukherjee , Dinesh Manocha

To advance biomedical vison-language model capabilities through scaling up, fine-tuning, and instruction tuning, develop vision-language models with improved performance in handling long text, explore strategies to efficiently adopt vision…

Artificial Intelligence · Computer Science 2025-05-26 Cheng Peng , Kai Zhang , Mengxian Lyu , Hongfang Liu , Lichao Sun , Yonghui Wu

Long context understanding remains challenging for large language models due to their limited context windows. This paper introduces Long Input Fine-Tuning (LIFT) for long context modeling, a novel framework that enhances LLM performance on…

Computation and Language · Computer Science 2024-12-19 Yansheng Mao , Jiaqi Li , Fanxu Meng , Jing Xiong , Zilong Zheng , Muhan Zhang

We assessed the performance of commercial Large Language Models (LLMs) GPT-3.5-Turbo and GPT-4 on tasks from the 2023 BioASQ challenge. In Task 11b Phase B, which is focused on answer generation, both models demonstrated competitive…

Computation and Language · Computer Science 2023-07-25 Samy Ateia , Udo Kruschwitz

Large Language Models (LLMs) have provided a new pathway for Named Entity Recognition (NER) tasks. Compared with fine-tuning, LLM-powered prompting methods avoid the need for training, conserve substantial computational resources, and rely…

Computation and Language · Computer Science 2025-04-02 Yongjian Tang , Rakebul Hasan , Thomas Runkler

Whereas the recent emergence of large language models (LLMs) like ChatGPT has exhibited impressive general performance, it still has a large gap with fully-supervised models on specific tasks such as multi-span question answering. Previous…

Computation and Language · Computer Science 2023-06-08 Zixian Huang , Jiaying Zhou , Gengyang Xiao , Gong Cheng

Recent development of large-scale pre-trained language models (PLM) have significantly improved the capability of models in various NLP tasks, in terms of performance after task-specific fine-tuning and zero-shot / few-shot learning.…

Computation and Language · Computer Science 2022-04-21 Chenguang Zhu , Michael Zeng

Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning. Existing approaches typically involve fine-tuning LLMs with synthetic data, which depends on…

Computation and Language · Computer Science 2024-11-14 Siheng Li , Cheng Yang , Zesen Cheng , Lemao Liu , Mo Yu , Yujiu Yang , Wai Lam

Previous works on emotion recognition in conversation (ERC) follow a two-step paradigm, which can be summarized as first producing context-independent features via fine-tuning pretrained language models (PLMs) and then analyzing contextual…

Computation and Language · Computer Science 2023-01-18 Xiangyu Qin , Zhiyu Wu , Jinshi Cui , Tingting Zhang , Yanran Li , Jian Luan , Bin Wang , Li Wang

Relation extraction (RE) is an important task that aims to identify the relationships between entities in texts. While large language models (LLMs) have revealed remarkable in-context learning (ICL) capability for general zero and few-shot…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Peng Wang , Jiajun Liu , Yikai Guo , Ke Ji , Ziyu Shang , Zijie Xu