English
Related papers

Related papers: Shoring Up the Foundations: Fusing Model Embedding…

200 papers

In scenarios where training data is limited due to observation costs or data scarcity, enriching the label information associated with each instance becomes crucial for building high-accuracy classification models. In such contexts, it is…

Machine Learning · Computer Science 2025-07-25 Kosuke Sugiyama , Masato Uchida

Semi-weakly supervised semantic segmentation (SWSSS) aims to train a model to identify objects in images based on a small number of images with pixel-level labels, and many more images with only image-level labels. Most existing SWSSS…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Wonho Bae , Junhyug Noh , Milad Jalali Asadabadi , Danica J. Sutherland

We study the problem of learning neural text classifiers without using any labeled data, but only easy-to-provide rules as multiple weak supervision sources. This problem is challenging because rule-induced weak labels are often noisy and…

Computation and Language · Computer Science 2021-03-12 Wendi Ren , Yinghao Li , Hanting Su , David Kartchner , Cassie Mitchell , Chao Zhang

Based on the success of large-scale visual foundation models like CLIP in various downstream tasks, this paper initially attempts to explore their impact on Long-Tailed Semi-Supervised Learning (LTSSL) by employing the foundation model with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Enhao Zhang , Chaohua Li , Chuanxing Geng , Songcan Chen

Foundation vision or vision-language models are trained on large unlabeled or noisy data and learn robust representations that can achieve impressive zero- or few-shot performance on diverse tasks. Given these properties, they are a natural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Sanket Rajan Gupte , Josiah Aklilu , Jeffrey J. Nirschl , Serena Yeung-Levy

Partial label learning (PLL) seeks to train generalizable classifiers from datasets with inexact supervision, a common challenge in real-world applications. Existing studies have developed numerous approaches to progressively refine and…

Machine Learning · Computer Science 2025-06-06 Kuang He , Wei Tang , Tong Wei , Min-Ling Zhang

In this paper, we present a semi-supervised fine-tuning approach designed to improve the performance of pre-trained foundation models on downstream tasks with limited labeled data. By leveraging content-style decomposition within an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Mariia Drozdova , Vitaliy Kinakh , Yury Belousov , Erica Lastufka , Slava Voloshynovskiy

Recently, large-scale pre-trained models such as Segment-Anything Model (SAM) and Contrastive Language-Image Pre-training (CLIP) have demonstrated remarkable success and revolutionized the field of computer vision. These foundation vision…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Shichao Dong , Fayao Liu , Guosheng Lin

Embedding fusion has emerged as an effective approach for enhancing performance across various NLP tasks. However, systematic guidelines for selecting optimal layers and developing effective fusion strategies for the integration of LLMs…

Computation and Language · Computer Science 2025-04-09 Jiho Gwak , Yuchul Jung

Automated nodule segmentation is essential for computer-assisted diagnosis in ultrasound images. Nevertheless, most existing methods depend on precise pixel-level annotations by medical professionals, a process that is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xingyue Zhao , Peiqi Li , Xiangde Luo , Meng Yang , Shi Chang , Zhongyu Li

Recent advancements in large language models have sparked interest in their extraordinary and near-superhuman capabilities, leading researchers to explore methods for evaluating and optimizing these abilities, which is called…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Jianyuan Guo , Hanting Chen , Chengcheng Wang , Kai Han , Chang Xu , Yunhe Wang

In semi-supervised learning, methods that rely on confidence learning to generate pseudo-labels have been widely proposed. However, increasing research finds that when faced with noisy and biased data, the model's representation network is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Yanbiao Ma , Licheng Jiao , Fang Liu , Lingling Li , Shuyuan Yang , Xu Liu

We introduce a new data fusion method that utilizes multiple data sources to estimate a smooth, finite-dimensional parameter. Most existing methods only make use of fully aligned data sources that share common conditional distributions of…

Methodology · Statistics 2025-04-30 Sijia Li , Peter B. Gilbert , Rui Duan , Alex Luedtke

Weakly supervised semantic segmentation aims to achieve pixel-level predictions using image-level labels. Existing methods typically entangle semantic recognition and object localization, which often leads models to focus exclusively on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Qingze He , Fagui Liu , Dengke Zhang , Qingmao Wei , Quan Tang

Understanding sleep and activity patterns plays a crucial role in physical and mental health. This study introduces a novel approach for sleep detection using weakly supervised learning for scenarios where reliable ground truth labels are…

Machine Learning · Computer Science 2024-07-09 Matthias Boeker , Vajira Thambawita , Michael Riegler , Pål Halvorsen , Hugo L. Hammer

Weakly supervised data are widespread and have attracted much attention. However, since label quality is often difficult to guarantee, sometimes the use of weakly supervised data will lead to unsatisfactory performance, i.e., performance…

Machine Learning · Computer Science 2019-04-23 Lan-Zhe Guo , Yu-Feng Li , Ming Li , Jin-Feng Yi , Bo-Wen Zhou , Zhi-Hua Zhou

Frame-by-frame annotation of bounding boxes by clinical experts is often required to train fully supervised object detection models on medical video data. We propose a method for improving object detection in medical videos through weak…

Weakly-supervised object detection attempts to limit the amount of supervision by dispensing the need for bounding boxes, but still assumes image-level labels on the entire training set. In this work, we study the problem of training an…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Zhaohui Yang , Miaojing Shi , Chao Xu , Vittorio Ferrari , Yannis Avrithis

Verifiers can improve language model capabilities by scoring and ranking responses from generated candidates. Currently, high-quality verifiers are either unscalable (e.g., humans) or limited in utility (e.g., tools like Lean). While LM…

In practical machine learning applications, it is often challenging to assign accurate labels to data, and increasing the number of labeled instances is often limited. In such cases, Weakly Supervised Learning (WSL), which enables training…

Machine Learning · Computer Science 2026-03-24 Tomoya Tate , Kosuke Sugiyama , Masato Uchida