中文
相关论文

相关论文: Semi-Supervised Learning for Large Language Models…

200 篇论文

Semi-supervised learning approaches train on small sets of labeled data along with large sets of unlabeled data. Self-training is a semi-supervised teacher-student approach that often suffers from the problem of "confirmation bias" that…

机器学习 · 计算机科学 2023-01-19 Aswathnarayan Radhakrishnan , Jim Davis , Zachary Rabin , Benjamin Lewis , Matthew Scherreik , Roman Ilin

Due to the semantic complexity of the Relation extraction (RE) task, obtaining high-quality human labelled data is an expensive and noisy process. To improve the sample efficiency of the models, semi-supervised learning (SSL) methods aim to…

计算与语言 · 计算机科学 2023-06-21 Komal K. Teru

Computational social science (CSS) practitioners often rely on human-labeled data to fine-tune supervised text classifiers. We assess the potential for researchers to augment or replace human-generated training data with surrogate training…

计算与语言 · 计算机科学 2024-06-26 Nicholas Pangakis , Samuel Wolken

Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As…

计算与语言 · 计算机科学 2023-11-01 Dong-Ho Lee , Jay Pujara , Mohit Sewak , Ryen W. White , Sujay Kumar Jauhar

Lifelong learning aims to accumulate knowledge and alleviate catastrophic forgetting when learning tasks sequentially. However, existing lifelong language learning methods only focus on the supervised learning setting. Unlabeled data, which…

计算与语言 · 计算机科学 2022-11-24 Yingxiu Zhao , Yinhe Zheng , Bowen Yu , Zhiliang Tian , Dongkyu Lee , Jian Sun , Haiyang Yu , Yongbin Li , Nevin L. Zhang

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

计算与语言 · 计算机科学 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

The ever-increasing size of modern data sets combined with the difficulty of obtaining label information has made semi-supervised learning one of the problems of significant practical importance in modern data analysis. We revisit the…

机器学习 · 计算机科学 2014-11-06 Diederik P. Kingma , Danilo J. Rezende , Shakir Mohamed , Max Welling

Semi-supervised learning methods are motivated by the availability of large datasets with unlabeled features in addition to labeled data. Unlabeled data is, however, not guaranteed to improve classification performance and has in fact been…

机器学习 · 统计学 2019-10-25 Xiuming Liu , Dave Zachariah , Johan Wågberg , Thomas B. Schön

Training large language models to follow instructions makes them perform better on a wide range of tasks and generally become more helpful. However, a perfectly helpful model will follow even the most malicious instructions and readily…

计算与语言 · 计算机科学 2024-03-20 Federico Bianchi , Mirac Suzgun , Giuseppe Attanasio , Paul Röttger , Dan Jurafsky , Tatsunori Hashimoto , James Zou

In the burgeoning field of Large Language Models (LLMs), developing a robust safety mechanism, colloquially known as "safeguards" or "guardrails", has become imperative to ensure the ethical use of LLMs within prescribed boundaries. This…

密码学与安全 · 计算机科学 2024-06-06 Yi Dong , Ronghui Mu , Yanghao Zhang , Siqi Sun , Tianle Zhang , Changshun Wu , Gaojie Jin , Yi Qi , Jinwei Hu , Jie Meng , Saddek Bensalem , Xiaowei Huang

This study discusses the effect of semi-supervised learning in combination with pretrained language models for data-to-text generation. It is not known whether semi-supervised learning is still helpful when a large-scale language model is…

计算与语言 · 计算机科学 2022-07-15 Chris van der Lee , Thiago Castro Ferreira , Chris Emmery , Travis Wiltshire , Emiel Krahmer

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

While semi-supervised learning (SSL) algorithms provide an efficient way to make use of both labelled and unlabelled data, they generally struggle when the number of annotated samples is very small. In this work, we consider the problem of…

计算机视觉与模式识别 · 计算机科学 2020-04-23 Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Kai Han , Andrea Vedaldi , Andrew Zisserman

The state of the art in semantic segmentation is steadily increasing in performance, resulting in more precise and reliable segmentations in many different applications. However, progress is limited by the cost of generating labels for…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Viktor Olsson , Wilhelm Tranheden , Juliano Pinto , Lennart Svensson

Fine-tuning large language models (LLMs) based on human preferences, commonly achieved through reinforcement learning from human feedback (RLHF), has been effective in improving their performance. However, maintaining LLM safety throughout…

人工智能 · 计算机科学 2025-02-18 Yingshui Tan , Yilei Jiang , Yanshi Li , Jiaheng Liu , Xingyuan Bu , Wenbo Su , Xiangyu Yue , Xiaoyong Zhu , Bo Zheng

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

机器学习 · 计算机科学 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

信息检索 · 计算机科学 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

Recent breakthroughs in Large Language Models (LLMs) have led to their adoption across a wide range of tasks, ranging from code generation to machine translation and sentiment analysis, etc. Red teaming/Safety alignment efforts show that…

计算与语言 · 计算机科学 2024-09-25 Essa Jan , Nouar AlDahoul , Moiz Ali , Faizan Ahmad , Fareed Zaffar , Yasir Zaki

Recent advancements in semi-supervised deep learning have introduced effective strategies for leveraging both labeled and unlabeled data to improve classification performance. This work proposes a semi-supervised framework that utilizes a…

机器学习 · 计算机科学 2025-05-21 Aydin Abedinia , Shima Tabakhi , Vahid Seydi

Training AI models in cybersecurity with help of vast datasets offers significant opportunities to mimic real-world behaviors effectively. However, challenges like data drift and scarcity of labelled data lead to frequent updates of models…

机器学习 · 计算机科学 2026-02-04 Saurabh Anand , Shubham Malaviya , Manish Shukla , Sachin Lodha