English
Related papers

Related papers: Constructing Artificial Data for Fine-tuning for L…

200 papers

Prompt Tuning is emerging as a scalable and cost-effective method to fine-tune Pretrained Language Models (PLMs), which are often referred to as Large Language Models (LLMs). This study benchmarks the performance and computational…

Computation and Language · Computer Science 2024-04-15 Valentin Leonhard Buchner , Lele Cao , Jan-Christoph Kalo , Vilhelm von Ehrenheim

Standard methods for multi-label text classification largely rely on encoder-only pre-trained language models, whereas encoder-decoder models have proven more effective in other classification tasks. In this study, we compare four methods…

Computation and Language · Computer Science 2023-05-10 Yova Kementchedjhieva , Ilias Chalkidis

Self-training via pseudo labeling is a conventional, simple, and popular pipeline to leverage unlabeled data. In this work, we first construct a strong baseline of self-training (namely ST) for semi-supervised semantic segmentation via…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

Accurate segmentation of tissue in histopathological images can be very beneficial for defining regions of interest (ROI) for streamline of diagnostic and prognostic tasks. Still, adapting to different domains is essential for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Saul Fuster , Farbod Khoraminia , Trygve Eftestøl , Tahlita C. M. Zuiverloon , Kjersti Engan

Imperfect labels limit the quality of predictions learned by deep neural networks. This is particularly relevant in medical image segmentation, where reference annotations are difficult to collect and vary significantly even across expert…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Eugene Vorontsov , Samuel Kadoury

Automatic phenotype concept recognition from unstructured text remains a challenging task in biomedical text mining research. Previous works that address the task typically use dictionary-based matching methods, which can achieve high…

Computation and Language · Computer Science 2021-01-26 Ling Luo , Shankai Yan , Po-Ting Lai , Daniel Veltri , Andrew Oler , Sandhya Xirasagar , Rajarshi Ghosh , Morgan Similuk , Peter N. Robinson , Zhiyong Lu

Accurate classification of sleep stages based on bio-signals is fundamental not only for automatic sleep stage annotation, but also for clinical health management and continuous sleep monitoring. Traditionally, this task relies on…

Machine Learning · Computer Science 2025-09-09 Jingyu Li , Tiehua Zhang , Jinze Wang , Yi Zhang , Yuhuan Li , Yifan Zhao , Zhishu Shen , Libing Wu , Jiannan Liu

Wildlife camera trap images are being used extensively to investigate animal abundance, habitat associations, and behavior, which is complicated by the fact that experts must first classify the images manually. Artificial intelligence…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Ludwig Bothmann , Lisa Wimmer , Omid Charrakh , Tobias Weber , Hendrik Edelhoff , Wibke Peters , Hien Nguyen , Caryl Benjamin , Annette Menzel

The implementation of deep learning based computer aided diagnosis systems for the classification of mammogram images can help in improving the accuracy, reliability, and cost of diagnosing patients. However, training a deep learning model…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Saul Calderon-Ramirez , Diego Murillo-Hernandez , Kevin Rojas-Salazar , David Elizondo , Shengxiang Yang , Miguel Molina-Cabello

Active learning is a paradigm aimed at reducing the annotation effort by training the model on actively selected informative and/or representative samples. Another paradigm to reduce the annotation effort is self-training that learns from a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Javad Zolfaghari Bengar , Joost van de Weijer , Bartlomiej Twardowski , Bogdan Raducanu

Data annotation is a time-consuming and labor-intensive process for many NLP tasks. Although there exist various methods to produce pseudo data labels, they are often task-specific and require a decent amount of labeled data to start with.…

Computation and Language · Computer Science 2021-09-01 Shuohang Wang , Yang Liu , Yichong Xu , Chenguang Zhu , Michael Zeng

Image segmentation is one of the most essential biomedical image processing problems for different imaging modalities, including microscopy and X-ray in the Internet-of-Medical-Things (IoMT) domain. However, annotating biomedical images is…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Ziyuan Zhao , Zeng Zeng , Kaixin Xu , Cen Chen , Cuntai Guan

Pre-training a recognition model with contrastive learning on a large dataset of unlabeled data has shown great potential to boost the performance of a downstream task, e.g., image classification. However, in domains such as medical…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jizong Peng , Ping Wang , Chrisitian Desrosiers , Marco Pedersoli

Objective: Semantic indexing of biomedical literature is usually done at the level of MeSH descriptors with several related but distinct biomedical concepts often grouped together and treated as a single topic. This study proposes a new…

Computation and Language · Computer Science 2023-10-06 Anastasios Nentidis , Thomas Chatzopoulos , Anastasia Krithara , Grigorios Tsoumakas , Georgios Paliouras

The high cost of creating pixel-by-pixel gold-standard labels, limited expert availability, and presence of diverse tasks make it challenging to generate segmentation labels to train deep learning models for medical imaging tasks. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Tanvi Deshpande , Eva Prakash , Elsie Gyang Ross , Curtis Langlotz , Andrew Ng , Jeya Maria Jose Valanarasu

Scribble-based weakly supervised semantic segmentation leverages only a few annotated pixels as labels to train a segmentation model, presenting significant potential for reducing the human labor involved in the annotation process. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Xinliang Zhang , Lei Zhu , Shuang Zeng , Hangzhou He , Ourui Fu , Zhengjian Yao , Zhaoheng Xie , Yanye Lu

Automated medical image segmentation has achieved remarkable progress with fully labeled data. However, site-specific clinical priorities and the high cost of manual annotation often yield scans with only a subset of organs labeled, leading…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Qiaochu Zhao , Wei Wei , David Horowitz , Richard Bakst , Yading Yuan

Pre-trained code models have recently achieved substantial improvements in many code intelligence tasks. These models are first pre-trained on large-scale unlabeled datasets in a task-agnostic manner using self-supervised learning, and then…

Software Engineering · Computer Science 2024-01-11 Shuzheng Gao , Wenxin Mao , Cuiyun Gao , Li Li , Xing Hu , Xin Xia , Michael R. Lyu

Deep learning is very data hungry, and supervised learning especially requires massive labeled data to work well. Machine listening research often suffers from limited labeled data problem, as human annotations are costly to acquire, and…

Sound · Computer Science 2021-02-08 Ho-Hsiang Wu , Chieh-Chi Kao , Qingming Tang , Ming Sun , Brian McFee , Juan Pablo Bello , Chao Wang

To efficiently establish training databases for machine learning methods, collaborative and crowdsourcing platforms have been investigated to collectively tackle the annotation effort. However, when this concept is ported to the medical…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Martin Rajchl , Lisa M. Koch , Christian Ledig , Jonathan Passerat-Palmbach , Kazunari Misawa , Kensaku Mori , Daniel Rueckert