English
Related papers

Related papers: Iceberg: Enhancing HLS Modeling with Synthetic Dat…

200 papers

Semantic noise in image classification datasets, where visually similar categories are frequently mislabeled, poses a significant challenge to conventional supervised learning approaches. In this paper, we explore the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yingxuan Li , Jiafeng Mao , Yusuke Matsui

Recent advances in semi-supervised learning (SSL) demonstrate that a combination of consistency regularization and pseudo-labeling can effectively improve image classification accuracy in the low-data regime. Compared to classification,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yuliang Zou , Zizhao Zhang , Han Zhang , Chun-Liang Li , Xiao Bian , Jia-Bin Huang , Tomas Pfister

As artificial neural networks, and specifically large language models, have improved rapidly in capabilities and quality, they have increasingly been deployed in real-world applications, from customer service to Google search, despite the…

Machine Learning · Computer Science 2026-02-02 Eugenia Iofinova , Dan Alistarh

The in-context learning ability of large language models (LLMs) enables them to generalize to novel downstream tasks with relatively few labeled examples. However, they require enormous computational resources to be deployed. Alternatively,…

Computation and Language · Computer Science 2024-01-09 Jean Kaddour , Qi Liu

High-Level Synthesis (HLS) serves as an agile hardware development tool that streamlines the circuit design by abstracting the register transfer level into behavioral descriptions, while allowing designers to customize the generated…

Hardware Architecture · Computer Science 2025-06-03 Runkai Li , Jia Xiong , Xi Wang

Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these synthetic data are mainly used in the pre-training phase…

Computation and Language · Computer Science 2024-06-26 Yixuan Wang , Baoxin Wang , Yijun Liu , Qingfu Zhu , Dayong Wu , Wanxiang Che

High-Level Synthesis (HLS) frameworks allow to easily specify a large number of variants of the same hardware design by only acting on optimization directives. Nonetheless, the hardware synthesis of implementations for all possible…

Hardware Architecture · Computer Science 2021-01-05 Lorenzo Ferretti , Jihye Kwon , Giovanni Ansaloni , Giuseppe Di Guglielmo , Luca Carloni , Laura Pozzi

A major limitation of prompt tuning is its dependence on large labeled training datasets. Under few-shot learning settings, prompt tuning lags far behind full-model fine-tuning, limiting its scope of application. In this paper, we leverage…

Computation and Language · Computer Science 2024-10-16 Xu Guo , Zilin Du , Boyang Li , Chunyan Miao

Deep learning approaches require enough training samples to perform well, but it is a challenge to collect enough real training data and label them manually. In this letter, we propose the use of realistic synthetic data with a wide…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Weixing Liu , Jun Liu , Bin Luo

Synthetic datasets are widely used for training urban scene recognition models, but even highly realistic renderings show a noticeable gap to real imagery. This gap is particularly pronounced when adapting to a specific target domain, such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Denis Zavadski , Damjan Kalšan , Tim Küchler , Haebom Lee , Stefan Roth , Carsten Rother

Real-world large-scale datasets are heteroskedastic and imbalanced -- labels have varying levels of uncertainty and label distributions are long-tailed. Heteroskedasticity and imbalance challenge deep learning algorithms due to the…

Machine Learning · Computer Science 2021-03-19 Kaidi Cao , Yining Chen , Junwei Lu , Nikos Arechiga , Adrien Gaidon , Tengyu Ma

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

Machine Learning · Computer Science 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick

The growing number of pretrained models in Machine Learning (ML) presents significant challenges for practitioners. Given a new dataset, they need to determine the most suitable deep learning (DL) pipeline, consisting of the pretrained…

Machine Learning · Computer Science 2025-06-17 Fabio Ferreira

A large labeled dataset is a key to the success of supervised deep learning, but for medical image segmentation, it is highly challenging to obtain sufficient annotated images for model training. In many scenarios, unannotated images are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hao Zheng , Jun Han , Hongxiao Wang , Lin Yang , Zhuo Zhao , Chaoli Wang , Danny Z. Chen

Medical datasets often face the problem of data scarcity, as ground truth labels must be generated by medical professionals. One mitigation strategy is to pretrain deep learning models on large, unlabelled datasets with self-supervised…

Machine Learning · Computer Science 2022-11-16 Jessica Y. Bo , Hen-Wei Huang , Alvin Chan , Giovanni Traverso

The success of Large Language Models (LLMs) is inherently linked to the availability of vast, diverse, and high-quality data for training and evaluation. However, the growth rate of high-quality data is significantly outpaced by the…

Computation and Language · Computer Science 2024-10-18 Ke Wang , Jiahui Zhu , Minjie Ren , Zeming Liu , Shiwei Li , Zongye Zhang , Chenkai Zhang , Xiaoyu Wu , Qiqi Zhan , Qingjie Liu , Yunhong Wang

Data augmentation is rapidly gaining attention in machine learning. Synthetic data can be generated by simple transformations or through the data distribution. In the latter case, the main challenge is to estimate the label associated to…

Machine Learning · Computer Science 2019-03-26 Maria Perez-Ortiz , Peter Tino , Rafal Mantiuk , Cesar Hervas-Martinez

Learning from noisy labels is a challenge that arises in many real-world applications where training data can contain incorrect or corrupted labels. When fine-tuning language models with noisy labels, models can easily overfit the label…

Computation and Language · Computer Science 2023-06-14 Yuchen Zhuang , Yue Yu , Lingkai Kong , Xiang Chen , Chao Zhang

Federated semi-supervised learning (FSSL) is primarily challenged by two factors: the scarcity of labeled data across clients and the non-independent and identically distribution (non-IID) nature of data among clients. In this paper, we…

Machine Learning · Computer Science 2025-01-07 Zhongwei Wang , Tong Wu , Zhiyong Chen , Liang Qian , Yin Xu , Meixia Tao

Finding relevant and high-quality datasets to train machine learning models is a major bottleneck for practitioners. Furthermore, to address ambitious real-world use-cases there is usually the requirement that the data come labelled with…

Machine Learning · Computer Science 2023-10-05 Georgios Papadopoulos , Fran Silavong , Sean Moran