English
Related papers

Related papers: Data-Efficient Biomedical In-Context Learning: A D…

200 papers

To enhance the performance of large language models (LLMs) in biomedical natural language processing (BioNLP) by introducing a domain-specific instruction dataset and examining its impact when combined with multi-task learning principles.…

Computation and Language · Computer Science 2024-06-10 Hieu Tran , Zhichao Yang , Zonghai Yao , Hong Yu

Recently, there has been increasing interest in applying large language models (LLMs) as zero-shot passage rankers. However, few studies have explored how to select appropriate in-context demonstrations for the passage ranking task, which…

Information Retrieval · Computer Science 2024-09-26 Wenhan Liu , Yutao Zhu , Zhicheng Dou

In-context learning with large language models (LLMs) excels at adapting to various tasks rapidly. However, its success hinges on carefully selecting demonstrations, which remains an obstacle in practice. Current approaches to this problem…

Computation and Language · Computer Science 2024-01-15 Shangqing Xu , Chao Zhang

Large Language Models (LLMs) are at the forefront of NLP achievements but fall short in dealing with shortcut learning, factual inconsistency, and vulnerability to adversarial inputs.These shortcomings are especially critical in medical…

Computation and Language · Computer Science 2024-04-09 Mael Jullien , Marco Valentino , André Freitas

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

Computation and Language · Computer Science 2025-04-08 Menglin Liu , Ge Shi

Large Language Models (LLMs) with in-context learning (ICL) ability can quickly adapt to a specific context given a few demonstrations (demos). Recently, Multimodal Large Language Models (MLLMs) built upon LLMs have also shown multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shuo Chen , Zhen Han , Bailan He , Jianzhe Liu , Mark Buckley , Yao Qin , Philip Torr , Volker Tresp , Jindong Gu

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples. This makes it hard for data-driven RSs to cater to a diverse set of users due to the varying properties…

Information Retrieval · Computer Science 2024-05-03 Kirandeep Kaur , Chirag Shah

Large Language Models(LLMs) excel in general tasks but struggle in specialized domains like healthcare due to limited domain-specific knowledge.Supervised Fine-Tuning(SFT) data construction for domain adaptation often relies on heuristic…

Machine Learning · Computer Science 2025-09-19 Hongxin Ding , Yue Fang , Runchuan Zhu , Xinke Jiang , Jinyang Zhang , Yongxin Xu , Xu Chu , Junfeng Zhao , Yasha Wang

In-Context Learning (ICL) empowers large language models to perform tasks by conditioning on a few input-output examples. However, the performance of ICL is highly sensitive to the selection of these demonstrations. While existing methods…

Computation and Language · Computer Science 2025-04-15 Owen Patterson , Chee Ng

Large language models (LLMs) have become the norm in natural language processing (NLP), excelling in few-shot in-context learning (ICL) with their remarkable abilities. Nonetheless, the success of ICL largely hinges on the choice of…

Computation and Language · Computer Science 2025-05-06 Xingxuan Li , Xuan-Phi Nguyen , Shafiq Joty , Lidong Bing

Large Language Models (LLMs) are increasingly adopted for applications in healthcare, reaching the performance of domain experts on tasks such as question answering and document summarisation. Despite their success on these tasks, it is…

Computation and Language · Computer Science 2025-05-20 Aishik Nagar , Viktor Schlegel , Thanh-Tung Nguyen , Hao Li , Yuping Wu , Kuluhan Binici , Stefan Winkler

While large-scale training data is fundamental for developing capable large language models (LLMs), strategically selecting high-quality data has emerged as a critical approach to enhance training efficiency and reduce computational costs.…

Machine Learning · Computer Science 2025-07-23 Yang Yu , Kai Han , Hang Zhou , Yehui Tang , Kaiqi Huang , Yunhe Wang , Dacheng Tao

In-context learning (ICL) has become a classic approach for enabling LLMs to handle various tasks based on a few input-output examples. The effectiveness of ICL heavily relies on the quality of these examples, and previous works which…

Computation and Language · Computer Science 2025-07-25 Yifu Chen , Bingchen Huang , Zhiling Wang , Yuanchao Du , Junfeng Luo , Lei Shen , Zhineng chen

Multi-label classification problems with thousands of classes are hard to solve with in-context learning alone, as language models (LMs) might lack prior knowledge about the precise classes or how to assign them, and it is generally…

Computation and Language · Computer Science 2024-01-23 Karel D'Oosterlinck , Omar Khattab , François Remy , Thomas Demeester , Chris Develder , Christopher Potts

Large language models (LLMs) face significant challenges when balancing multiple high-level objectives, such as generating coherent, relevant, and high-quality responses while maintaining efficient task adaptation across diverse tasks. To…

Computation and Language · Computer Science 2025-02-21 Yupeng Chang , Yi Chang , Yuan Wu

Deep Learning (DL) techniques are increasingly applied in scientific studies across various domains to address complex research questions. However, the methodological details of these DL models are often hidden in the unstructured text. As…

Information Retrieval · Computer Science 2024-11-15 Vamsi Krishna Kommineni , Birgitta König-Ries , Sheeba Samuel

It has long been recognized that it is not enough for a Recommender System (RS) to provide recommendations based only on their relevance to users. Among many other criteria, the set of recommendations may need to be diverse. Diversity is…

Information Retrieval · Computer Science 2024-06-19 Diego Carraro , Derek Bridge

In-context learning (ICL) enables large language models (LLMs) to perform new tasks by prompting them with a sequence of training examples. However, it is known that ICL is very sensitive to the choice of training examples: randomly…

Computation and Language · Computer Science 2023-09-13 Ting-Yun Chang , Robin Jia

Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularly for item-to-item (I2I) recommendations, remains…

Information Retrieval · Computer Science 2025-01-22 Chao Zhang , Haoxin Zhang , Shiwei Wu , Di Wu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

Despite recent advancements in Large Language Models (LLMs), their performance on tasks involving long contexts remains sub-optimal. In this work, we propose DoubleDipper, a novel In-Context-Learning method that automatically generates…