English
Related papers

Related papers: Improve the Fitting Accuracy of Deep Learning for …

200 papers

Deep metric learning (DML) aims to learn a discriminative high-dimensional embedding space for downstream tasks like classification, clustering, and retrieval. Prior literature predominantly focuses on pair-based and proxy-based methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiruo Jiang , Yazhou Yao , Xili Dai , Fumin Shen , Xian-Sheng Hua , Heng-Tao Shen

Federated learning is a distributed machine learning paradigm that allows multiple participants to train a shared model by exchanging model updates instead of their raw data. However, its performance is degraded compared to centralized…

Machine Learning · Computer Science 2025-08-07 Hyungbin Kim , Incheol Baek , Yon Dohn Chung

We propose an improved convergence analysis technique that characterizes the distributed learning paradigm of federated learning (FL) with imperfect/noisy uplink and downlink communications. Such imperfect communication scenarios arise in…

Machine Learning · Computer Science 2023-07-17 Antesh Upadhyay , Abolfazl Hashemi

This paper proposes Friedrichs learning as a novel deep learning methodology that can learn the weak solutions of PDEs via a minmax formulation, which transforms the PDE problem into a minimax optimization problem to identify weak…

Numerical Analysis · Mathematics 2023-01-03 Fan Chen , Jianguo Huang , Chunmei Wang , Haizhao Yang

Deep Neural Networks (DNNs) have already become a crucial computational approach to revealing the spatial patterns in the human brain; however, there are three major shortcomings in utilizing DNNs to detect the spatial patterns in…

Machine Learning · Computer Science 2022-05-26 Wei Zhang , Yu Bao

Federated Learning (FL) is a distributed learning scheme that enables deep learning to be applied to sensitive data streams and applications in a privacy-preserving manner. This paper focuses on the use of FL for analyzing smart energy…

Machine Learning · Computer Science 2024-04-05 Abhishek Duttagupta , Jin Zhao , Shanker Shreejith

Conventional research attributes the improvements of generalization ability of deep neural networks either to powerful optimizers or the new network design. Different from them, in this paper, we aim to link the generalization ability of a…

Machine Learning · Computer Science 2018-11-06 Hui-Ling Zhen , Xi Lin , Alan Z. Tang , Zhenhua Li , Qingfu Zhang , Sam Kwong

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

Federated learning (FL) offers a privacy-preserving framework for distributed machine learning, enabling collaborative model training across diverse clients without centralizing sensitive data. However, statistical heterogeneity,…

Machine Learning · Statistics 2025-04-08 Hengrui Hu , Anai N. Kothari , Anjishnu Banerjee

Physics-informed deep learning has emerged as a promising framework for solving partial differential equations (PDEs). Nevertheless, training these models on complex problems remains challenging, often leading to limited accuracy and…

Machine Learning · Statistics 2025-11-13 Wenqian Chen , Amanda Howard , Panos Stinis

As a promising distributed machine learning paradigm, Federated Learning (FL) enables all the involved devices to train a global model collaboratively without exposing their local data privacy. However, for non-IID scenarios, the…

Machine Learning · Computer Science 2022-02-28 Ming Hu , Tian Liu , Zhiwei Ling , Zhihao Yue , Mingsong Chen

This paper proposes a deep-learning-based domain decomposition method (DeepDDM), which leverages deep neural networks (DNN) to discretize the subproblems divided by domain decomposition methods (DDM) for solving partial differential…

Numerical Analysis · Mathematics 2020-04-13 Wuyang Li , Xueshuang Xiang , Yingxiang Xu

In this paper, a linearized semi-implicit finite difference scheme is proposed for solving the two-dimensional (2D) space fractional nonlinear Schr\"{o}dinger equation (SFNSE).The scheme has the property of mass and energy conservation on…

Numerical Analysis · Mathematics 2021-07-27 Hongling Hu , Xianlin Jin , Dongdong He , Kejia Pan , Qifeng Zhang

Federated Learning (FL) with pre-trained Vision-Language Models (VLMs) has emerged as a promising paradigm for various downstream tasks. By leveraging its strong representations, recent studies improve task adaptation under insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yuting Ma , Lechao Cheng , Xiaohua Xu

Miscalibration - a mismatch between a model's confidence and its correctness - of Deep Neural Networks (DNNs) makes their predictions hard to rely on. Ideally, we want networks to be accurate, calibrated and confident. We show that, as…

Machine Learning · Computer Science 2020-10-27 Jishnu Mukhoti , Viveka Kulharia , Amartya Sanyal , Stuart Golodetz , Philip H. S. Torr , Puneet K. Dokania

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

Objective: Long-axial field-of-view (LAFOV) positron emission tomography (PET) systems allow higher sensitivity, with an increased number of detected lines of response induced by a larger angle of acceptance. However, this extended angle…

Most existing federated learning algorithms are based on the vanilla FedAvg scheme. However, with the increase of data complexity and the number of model parameters, the amount of communication traffic and the number of iteration rounds for…

Machine Learning · Computer Science 2024-01-30 Xiaolin Zheng , Senci Ying , Fei Zheng , Jianwei Yin , Longfei Zheng , Chaochao Chen , Fengqin Dong

In this article, we propose a model-driven deep learning (DL) approach that combines DL with the expert knowledge to replace the existing orthogonal frequency-division multiplexing (OFDM) receiver in wireless communications. Different from…

Signal Processing · Electrical Eng. & Systems 2018-10-23 Xuanxuan Gao , Shi Jin , Chao-Kai Wen , Geoffrey Ye Li

The energy efficiency of deep spiking neural networks (SNNs) aligns with the constraints of resource-limited edge devices, positioning SNNs as a promising foundation for intelligent applications leveraging the extensive data collected by…

Machine Learning · Computer Science 2025-07-21 Di Yu , Xin Du , Linshan Jiang , Huijing Zhang , Shuiguang Deng