中文
相关论文

相关论文: Scaling Laws for Many-Shot In-Context Learning wit…

200 篇论文

Collecting and annotating task-oriented dialogues is time-consuming and costly; thus, zero and few shot learning could greatly benefit dialogue state tracking (DST). In this work, we propose an in-context learning (ICL) framework for…

计算与语言 · 计算机科学 2022-10-27 Yushi Hu , Chia-Hsuan Lee , Tianbao Xie , Tao Yu , Noah A. Smith , Mari Ostendorf

A novel semi-supervised learning technique is introduced based on a simple iterative learning cycle together with learned thresholding techniques and an ensemble decision support system. State-of-the-art model performance and increased…

计算机视觉与模式识别 · 计算机科学 2019-06-10 Robert Dupre , Jiri Fajtl , Vasileios Argyriou , Paolo Remagnin

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

The lack of labeled data is a major obstacle to learning high-quality sentence embeddings. Recently, self-supervised contrastive learning (SCL) is regarded as a promising way to address this problem. However, the existing works mainly rely…

计算与语言 · 计算机科学 2022-03-01 Junhan Yang , Zheng Liu , Shitao Xiao , Jianxun Lian , Lijun Wu , Defu Lian , Guangzhong Sun , Xing Xie

In-Context Learning (ICL) enables large language models (LLMs) to achieve rapid task adaptation by learning from demonstrations. With the increase in available context length of LLMs, recent experiments have shown that the performance of…

计算与语言 · 计算机科学 2024-08-27 Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Heda Wang , Yao Hu , Kan Li

Semi-supervised medical image segmentation has attracted much attention in recent years because of the high cost of medical image annotations. In this paper, we propose a novel Inherent Consistent Learning (ICL) method, aims to learn robust…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Ye Zhu , Jie Yang , Si-Qi Liu , Ruimao Zhang

Semi-supervised few-shot learning (SSFSL) formulates real-world applications like ''auto-annotation'', as it aims to learn a model over a few labeled and abundant unlabeled examples to annotate the unlabeled ones. Despite the availability…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Tian Liu , Anwesha Basu , James Caverlee , Shu Kong

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

计算与语言 · 计算机科学 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

Large language models (LLMs) have shown impressive capabilities across various tasks, but their performance on domain-specific tasks remains limited. While methods like retrieval augmented generation and fine-tuning can help to address…

计算与语言 · 计算机科学 2024-12-23 M. Mehdi Mojarradi , Lingyi Yang , Robert McCraith , Adam Mahdi

In-context learning (ICL) for large language models has proven to be a powerful approach for many natural language processing tasks. However, determining the best method to select examples for ICL is nontrivial as the results can vary…

计算与语言 · 计算机科学 2023-07-28 Subha Vadlamannati , Gözde Gül Şahin

Large Language Models (LLMs) have demonstrated an impressive capability known as In-context Learning (ICL), which enables them to acquire knowledge from textual demonstrations without the need for parameter updates. However, many studies…

计算与语言 · 计算机科学 2024-06-04 Yi Su , Yunpeng Tai , Yixin Ji , Juntao Li , Bowen Yan , Min Zhang

Self-training methods have been explored in recent years and have exhibited great performance in improving semi-supervised learning. This work presents a Simple instance-Adaptive self-Training method (SAT) for semi-supervised text…

计算与语言 · 计算机科学 2022-10-25 Hui Chen , Wei Han , Soujanya Poria

Preference-based reinforcement learning is an effective way to handle tasks where rewards are hard to specify but can be exceedingly inefficient as preference learning is often tabula rasa. We demonstrate that Large Language Models (LLMs)…

人工智能 · 计算机科学 2025-04-04 Chao Yu , Qixin Tan , Hong Lu , Jiaxuan Gao , Xinting Yang , Yu Wang , Yi Wu , Eugene Vinitsky

Language models, especially pre-trained large language models, have showcased remarkable abilities as few-shot in-context learners (ICL), adept at adapting to new tasks with just a few demonstrations in the input context. However, the…

计算与语言 · 计算机科学 2024-03-26 Man Luo , Xin Xu , Yue Liu , Panupong Pasupat , Mehran Kazemi

In-context learning (ICL) is an important yet not fully understood ability of pre-trained large language models (LLMs). It can greatly enhance task performance using a few examples, termed demonstrations, without fine-tuning. Although…

计算与语言 · 计算机科学 2025-06-03 Do Xuan Long , Duong Ngoc Yen , Do Xuan Trong , Luu Anh Tuan , Kenji Kawaguchi , Shafiq Joty , Min-Yen Kan , Nancy F. Chen

Learning algorithms normally assume that there is at most one annotation or label per data point. However, in some scenarios, such as medical diagnosis and on-line collaboration,multiple annotations may be available. In either case,…

机器学习 · 计算机科学 2012-03-19 Yan Yan , Romer Rosales , Glenn Fung , Jennifer Dy

Partial-label learning (PLL) generally focuses on inducing a noise-tolerant multi-class classifier by training on overly-annotated samples, each of which is annotated with a set of labels, but only one is the valid label. A basic promise of…

计算与语言 · 计算机科学 2021-06-03 Yunfeng Zhao , Guoxian Yu , Lei Liu , Zhongmin Yan , Lizhen Cui , Carlotta Domeniconi

Recent work has shown that, while large language models (LLMs) demonstrate strong word translation or bilingual lexicon induction (BLI) capabilities in few-shot setups, they still cannot match the performance of 'traditional' mapping-based…

计算与语言 · 计算机科学 2024-06-06 Yaoyiran Li , Anna Korhonen , Ivan Vulić

As the exorbitant expense of labeling autopilot datasets and the growing trend of utilizing unlabeled data, semi-supervised segmentation on point clouds becomes increasingly imperative. Intuitively, finding out more ``unspoken words''…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Yujun Chen , Xin Tan , Zhizhong Zhang , Yanyun Qu , Yuan Xie

In-context Learning (ICL) empowers large language models (LLMs) to swiftly adapt to unseen tasks at inference-time by prefixing a few demonstration examples before queries. Despite its versatility, ICL incurs substantial computational and…

机器学习 · 计算机科学 2025-02-26 Zhuowei Li , Zihao Xu , Ligong Han , Yunhe Gao , Song Wen , Di Liu , Hao Wang , Dimitris N. Metaxas