English
Related papers

Related papers: On Noisy Evaluation in Federated Hyperparameter Tu…

200 papers

To tackle the scarcity and privacy issues associated with domain-specific datasets, the integration of federated learning in conjunction with fine-tuning has emerged as a practical solution. However, our findings reveal that federated…

Machine Learning · Computer Science 2024-01-26 Mengyao Du , Miao Zhang , Yuwen Pu , Kai Xu , Shouling Ji , Quanjun Yin

A key part of any evolutionary algorithm is fitness evaluation. When fitness evaluations are corrupted by noise, as happens in many real-world problems as a consequence of various types of uncertainty, a strategy is needed in order to cope…

Neural and Evolutionary Computing · Computer Science 2017-07-13 Simon M. Lucas , Jialin Liu , Diego Pérez-Liébana

An oft-cited challenge of federated learning is the presence of heterogeneity. \emph{Data heterogeneity} refers to the fact that data from different clients may follow very different distributions. \emph{System heterogeneity} refers to…

Machine Learning · Computer Science 2023-03-28 John Nguyen , Jianyu Wang , Kshitiz Malik , Maziar Sanjabi , Michael Rabbat

Machine learning from training data with a skewed distribution of examples per class can lead to models that favor performance on common classes at the expense of performance on rare ones. AudioSet has a very wide range of priors over its…

Machine Learning · Computer Science 2023-07-04 R. Channing Moore , Daniel P. W. Ellis , Eduardo Fonseca , Shawn Hershey , Aren Jansen , Manoj Plakal

To achieve state-of-the-art performance, one still needs to train NER models on large-scale, high-quality annotated data, an asset that is both costly and time-intensive to accumulate. In contrast, real-world applications often resort to…

Computation and Language · Computer Science 2023-10-26 Zhendong Chu , Ruiyi Zhang , Tong Yu , Rajiv Jain , Vlad I Morariu , Jiuxiang Gu , Ani Nenkova

Noise reduction techniques based on deep learning have demonstrated impressive performance in enhancing the overall quality of recorded speech. While these approaches are highly performant, their application in audio engineering can be…

Sound · Computer Science 2023-10-18 Christian J. Steinmetz , Thomas Walther , Joshua D. Reiss

Feature selection has remained a daunting challenge in machine learning and artificial intelligence, where increasingly complex, high-dimensional datasets demand principled strategies for isolating the most informative predictors. Despite…

Machine Learning · Statistics 2025-12-02 Mousam Sinha , Tirtha Sarathi Ghosh , Ridam Pal

Noise is a consequence of acquiring and pre-processing data from the environment, and shows fluctuations from different sources---e.g., from sensors, signal processing technology or even human error. As a machine learning technique, Genetic…

Neural and Evolutionary Computing · Computer Science 2017-07-05 Luis F. Miranda , Luiz Otavio V. B. Oliveira , Joao Francisco B. S. Martins , Gisele L. Pappa

A novel Decentralized Noisy Model Update Tracking Federated Learning algorithm (FedNMUT) is proposed that is tailored to function efficiently in the presence of noisy communication channels that reflect imperfect information exchange. This…

Machine Learning · Computer Science 2024-03-26 Vishnu Pandi Chellapandi , Antesh Upadhyay , Abolfazl Hashemi , Stanislaw H. Żak

Federated learning is a machine learning paradigm that leverages edge computing on client devices to optimize models while maintaining user privacy by ensuring that local data remains on the device. However, since all data is collected by…

Machine Learning · Computer Science 2025-06-11 Jingqiao Tang , Ryan Bausback , Feng Bao , Richard Archibald

In traditional machine learning, it is trivial to conduct model evaluation since all data samples are managed centrally by a server. However, model evaluation becomes a challenging problem in federated learning (FL), which is called…

Machine Learning · Computer Science 2023-05-22 Behnaz Soltani , Yipeng Zhou , Venus Haghighi , John C. S. Lui

Overparametrization is one of the most surprising and notorious phenomena in machine learning. Recently, there have been several efforts to study if, and how, Quantum Neural Networks (QNNs) acting in the absence of hardware noise can be…

Quantum Physics · Physics 2024-03-19 Diego García-Martín , Martin Larocca , M. Cerezo

In this paper, we argue that current safety alignment research efforts for large language models are hindered by many intertwined sources of noise, such as small datasets, methodological inconsistencies, and unreliable evaluation setups.…

Cryptography and Security · Computer Science 2026-05-19 Tim Beyer , Sophie Xhonneux , Simon Geisler , Gauthier Gidel , Leo Schwinn , Stephan Günnemann

Recent studies in deep learning have shown significant progress in named entity recognition (NER). Most existing works assume clean data annotation, yet a fundamental challenge in real-world scenarios is the large amount of noise from a…

Computation and Language · Computer Science 2021-04-13 Kun Liu , Yao Fu , Chuanqi Tan , Mosha Chen , Ningyu Zhang , Songfang Huang , Sheng Gao

Extracting noisy or incorrectly labeled samples from a labeled dataset with hard/difficult samples is an important yet under-explored topic. Two general and often independent lines of work exist, one focuses on addressing noisy labels, and…

Machine Learning · Computer Science 2023-07-21 Mahsa Forouzesh , Patrick Thiran

Federated learning (FL) is a distributed model training paradigm that preserves clients' data privacy. It has gained tremendous attention from both academia and industry. FL hyper-parameters (e.g., the number of selected clients and the…

Machine Learning · Computer Science 2022-11-28 Huanle Zhang , Lei Fu , Mi Zhang , Pengfei Hu , Xiuzhen Cheng , Prasant Mohapatra , Xin Liu

We consider federated learning of linearly-parameterized nonlinear systems. We establish theoretical guarantees on the effectiveness of federated nonlinear system identification compared to centralized approaches, demonstrating that the…

Machine Learning · Computer Science 2026-04-27 Omkar Tupe , Max Hartman , Lav R. Varshney , Saurav Prakash

In real dialogue scenarios, as there are unknown input noises in the utterances, existing supervised slot filling models often perform poorly in practical applications. Even though there are some studies on noise-robust models, these works…

Computation and Language · Computer Science 2023-10-06 Jiachi Liu , Liwen Wang , Guanting Dong , Xiaoshuai Song , Zechen Wang , Zhengyang Wang , Shanglin Lei , Jinzheng Zhao , Keqing He , Bo Xiao , Weiran Xu

For many machine learning algorithms, predictive performance is critically affected by the hyperparameter values used to train them. However, tuning these hyperparameters can come at a high computational cost, especially on larger datasets,…

Data-enabled predictive control (DeePC) leverages system measurements in characterizing system dynamics for optimal control. The performance of DeePC relies on optimizing its hyperparameters, especially in noisy systems where the optimal…

Optimization and Control · Mathematics 2025-06-02 Jinbao Wang , Shiliang Zhang , Jun Liu , Xuehui Ma , Haolin Liu
‹ Prev 1 4 5 6 7 8 10 Next ›