中文
相关论文

相关论文: Self-Supervised Learning at the Edge: The Cost of …

200 篇论文

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…

Semi-Supervised Learning (SSL) has advanced classification tasks by inputting both labeled and unlabeled data to train a model jointly. However, existing SSL methods only consider the unlabeled data whose predictions are beyond a fixed…

计算机视觉与模式识别 · 计算机科学 2022-05-24 Zechen Liang , Yuan-Gen Wang , Wei Lu , Xiaochun Cao

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

Semi-supervised learning (SSL) provides an effective means of leveraging unlabelled data to improve a model performance. Even though the domain has received a considerable amount of attention in the past years, most methods present the…

机器学习 · 统计学 2023-03-06 Hugo Schmutz , Olivier Humbert , Pierre-Alexandre Mattei

Deep learning is pushing the state-of-the-art in many computer vision applications. However, it relies on large annotated data repositories, and capturing the unconstrained nature of the real-world data is yet to be solved. Semi-supervised…

计算机视觉与模式识别 · 计算机科学 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

Labels are costly and sometimes unreliable. Noisy label learning, semi-supervised learning, and contrastive learning are three different strategies for designing learning processes requiring less annotation cost. Semi-supervised learning…

机器学习 · 计算机科学 2021-11-24 Xin Zhang , Zixuan Liu , Kaiwen Xiao , Tian Shen , Junzhou Huang , Wei Yang , Dimitris Samaras , Xiao Han

Federated Learning (FL) is transforming the ML training ecosystem from a centralized over-the-cloud setting to distributed training over edge devices in order to strengthen data privacy. An essential but rarely studied challenge in FL is…

机器学习 · 计算机科学 2021-10-07 Chaoyang He , Zhengyu Yang , Erum Mushtaq , Sunwoo Lee , Mahdi Soltanolkotabi , Salman Avestimehr

Image classification datasets exhibit a non-negligible fraction of mislabeled examples, often due to human error when one class superficially resembles another. This issue poses challenges in supervised contrastive learning (SCL), where the…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Zijun Long , George Killick , Lipeng Zhuang , Richard McCreadie , Gerardo Aragon Camarasa , Paul Henderson

Deep learning on graphs has recently achieved remarkable success on a variety of tasks, while such success relies heavily on the massive and carefully labeled data. However, precise annotations are generally very expensive and…

机器学习 · 计算机科学 2021-09-30 Lirong Wu , Haitao Lin , Zhangyang Gao , Cheng Tan , Stan. Z. Li

Deep learning has made revolutionary advances to diverse applications in the presence of large-scale labeled datasets. However, it is prohibitively time-costly and labor-expensive to collect sufficient labeled data in most realistic…

机器学习 · 计算机科学 2021-07-22 Ximei Wang , Jinghan Gao , Mingsheng Long , Jianmin Wang

Semi-supervised learning holds great promise for many real-world applications, due to its ability to leverage both unlabeled and expensive labeled data. However, most semi-supervised learning algorithms still heavily rely on the limited…

机器学习 · 计算机科学 2023-12-29 Huiling Qin , Xianyuan Zhan , Yuanxun Li , Yu Zheng

After a model is deployed on edge devices, it is desirable for these devices to learn from unlabeled data to continuously improve accuracy. Contrastive learning has demonstrated its great potential in learning from unlabeled data. However,…

机器学习 · 计算机科学 2021-06-08 Yawen Wu , Zhepeng Wang , Dewen Zeng , Yiyu Shi , Jingtong Hu

Sewerage infrastructure is among the most expensive modern investments requiring time-intensive manual inspections by qualified personnel. Our study addresses the need for automated solutions without relying on large amounts of labeled…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Daniel Otero , Rafael Mateus

Semi-supervised learning (SSL) can improve model performance by leveraging unlabeled images, which can be collected from public image sources with low costs. In recent years, synthetic images have become increasingly common in public image…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Zerun Wang , Jiafeng Mao , Liuyu Xiang , Toshihiko Yamasaki

Federated Learning allows the training of machine learning models by using the computation and private data resources of many distributed clients. Most existing results on Federated Learning (FL) assume the clients have ground-truth labels.…

机器学习 · 计算机科学 2022-10-12 Enmao Diao , Jie Ding , Vahid Tarokh

Self-supervised learning (SSL) leverages large datasets of unlabeled speech to reach impressive performance with reduced amounts of annotated data. The high number of proposed approaches fostered the emergence of comprehensive benchmarks…

音频与语音处理 · 电气工程与系统科学 2024-02-22 Salah Zaiem , Youcef Kemiche , Titouan Parcollet , Slim Essid , Mirco Ravanelli

We present a general methodology for using unlabeled data to design semi supervised learning (SSL) variants of the Empirical Risk Minimization (ERM) learning process. Focusing on generalized linear regression, we analyze of the…

机器学习 · 统计学 2022-03-08 Oren Yuval , Saharon Rosset

Self-supervised learning (SSL) is an effective method for exploiting unlabelled data to learn a high-level embedding space that can be used for various downstream tasks. However, existing methods to monitor the quality of the encoder --…

机器学习 · 计算机科学 2024-09-11 Isaac Xu , Scott Lowe , Thomas Trappenberg

There has been increasing attention to semi-supervised learning (SSL) approaches in machine learning to forming a classifier in situations where the training data for a classifier consists of a limited number of classified observations but…

机器学习 · 统计学 2021-11-10 Daniel Ahfock , Geoffrey J. McLachlan