English
Related papers

Related papers: Advancing RVFL networks: Robust classification wit…

200 papers

We investigate robust nonparametric regression in the presence of heavy-tailed noise, where the hypothesis class may contain unbounded functions and robustness is ensured via a robust loss function $\ell_\sigma$. Using Huber regression as a…

Machine Learning · Computer Science 2025-10-14 Yunlong Feng , Qiang Wu

One of the main drawbacks of deep neural networks, like many other classifiers, is their vulnerability to adversarial attacks. An important reason for their vulnerability is assigning high confidence to regions with few or even no feature…

Machine Learning · Computer Science 2018-12-11 Pourya Habib Zadeh , Reshad Hosseini , Suvrit Sra

Robust loss minimization is an important strategy for handling robust learning issue on noisy labels. Current approaches for designing robust losses involve the introduction of noise-robust factors, i.e., hyperparameters, to control the…

Machine Learning · Computer Science 2023-09-06 Kehui Ding , Jun Shu , Deyu Meng , Zongben Xu

Reduced rank regression (RRR) is a fundamental tool for modeling multiple responses through low-dimensional latent structures, offering both interpretability and strong predictive performance in high-dimensional settings. Classical RRR…

Methodology · Statistics 2026-01-01 The Tien Mai

Loss function plays a vital role in supervised learning frameworks. The selection of the appropriate loss function holds the potential to have a substantial impact on the proficiency attained by the acquired model. The training of…

Machine Learning · Computer Science 2024-10-15 Mushir Akhtar , M. Tanveer , Mohd. Arshad

The development of the sixth generation (6G) of wireless networks is bound to streamline the transition of computation and learning towards the edge of the network. Hierarchical federated learning (HFL) becomes, therefore, a key paradigm to…

Information Theory · Computer Science 2024-07-11 Ruslan Zhagypar , Nour Kouzayha , Hesham ElSawy , Hayssam Dahrouj , Tareq Y. Al-Naffouri

High-dimensional linear regression is a fundamental tool in modern statistics, particularly when the number of predictors exceeds the sample size. The classical Lasso, which relies on the squared loss, performs well under Gaussian noise…

Methodology · Statistics 2025-06-10 The Tien Mai

We study the connection between the highly non-convex loss function of a simple model of the fully-connected feed-forward neural network and the Hamiltonian of the spherical spin-glass model under the assumptions of: i) variable…

Machine Learning · Computer Science 2015-01-23 Anna Choromanska , Mikael Henaff , Michael Mathieu , Gérard Ben Arous , Yann LeCun

Split Learning (SL) is a promising collaborative machine learning approach, enabling resource-constrained devices to train models without sharing raw data, while reducing computational load and preserving privacy simultaneously. However,…

Machine Learning · Computer Science 2024-11-22 Yunrui Sun , Gang Hu , Yinglei Teng , Dunbo Cai

In current practical face authentication systems, most face recognition (FR) algorithms are based on cosine similarity with softmax classification. Despite its reliable classification performance, this method struggles with hard samples. A…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Fan Xie , Yang Wang , Yikang Jiao , Zhenyu Yuan , Congxi Chen , Chuanxin Zhao

Support Vector Machines (SVMs) rely heavily on the choice of the kernel function to map data into high-dimensional feature spaces. While the Gaussian Radial Basis Function (RBF) is the industry standard, its exponential decay makes it…

Machine Learning · Computer Science 2026-03-17 Gustavo Dorrego

Recently, multi-view learning (MVL) has garnered significant attention due to its ability to fuse discriminative information from multiple views. However, real-world multi-view datasets are often heterogeneous and imperfect, which usually…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jie Xu , Na Zhao , Gang Niu , Masashi Sugiyama , Xiaofeng Zhu

In supervised machine learning, the choice of loss function implicitly assumes a particular noise distribution over the data. For example, the frequently used mean squared error (MSE) loss assumes a Gaussian noise distribution. The choice…

Machine Learning · Computer Science 2023-02-15 Thamsanqa Mlotshwa , Heinrich van Deventer , Anna Sergeevna Bosman

Multiview learning (MvL) is an advancing domain in machine learning, leveraging multiple data perspectives to enhance model performance through view-consistency and view-discrepancy. Despite numerous successful multiview-based SVM models,…

Machine Learning · Computer Science 2024-08-14 A. Quadir , Mushir Akhtar , M. Tanveer

This paper addresses the problem of localization, which is inherently non-convex and non-smooth in a federated setting where the data is distributed across a multitude of devices. Due to the decentralized nature of federated environments,…

Machine Learning · Computer Science 2023-09-04 Reza Mirzaeifard , Naveen K. D. Venkategowda , Stefan Werner

Functional linear regression is a widely used approach to model functional responses with respect to functional inputs. However, classical functional linear regression models can be severely affected by outliers. We therefore introduce a…

Methodology · Statistics 2019-09-02 Harjit Hullait , David S. Leslie , Nicos G. Pavlidis , Steve King

Random Recurrent Neural Networks (RRNN) are the simplest recurrent networks to model and extract features from sequential data. The simplicity however comes with a price; RRNN are known to be susceptible to diminishing/exploding gradient…

Machine Learning · Computer Science 2025-06-10 Yang Zheng , Eli Shlizerman

Heterogeneous Face Recognition (HFR) is a task that matches faces across two different domains such as visible light (VIS), near-infrared (NIR), or the sketch domain. Due to the lack of databases, HFR methods usually exploit the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 MyeongAh Cho , Taeoh Kim , Ig-Jae Kim , Kyungjae Lee , Sangyoun Lee

Electricity load forecasting is crucial for the power systems' planning and maintenance. However, its un-stationary and non-linear characteristics impose significant difficulties in anticipating future demand. This paper proposes a novel…

Machine Learning · Computer Science 2022-06-14 Ruobin Gao , Liang Du , P. N. Suganthan , Qin Zhou , Kum Fai Yuen

Deep-learning (DL) has emerged as a powerful machine-learning technique for several classic problems encountered in generic wireless communications. Specifically, random Fourier Features (RFF) based deep-learning has emerged as an…

Information Theory · Computer Science 2021-01-14 Rangeet Mitra , Georges Kaddoum