English
Related papers

Related papers: Novel Machine Learning and Differentiable Programm…

200 papers

Foundational Machine Learning Potentials can resolve the accuracy and transferability limitations of classical force fields. They enable microscopic insights into material behavior through Molecular Dynamics simulations, which can crucially…

Computational Physics · Physics 2025-12-04 Paul Fuchs , Julija Zavadlav

Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater…

Machine Learning · Computer Science 2021-10-08 Minseok Ryu , Kibaek Kim

Differentially private SGD (DP-SGD) is one of the most popular methods for solving differentially private empirical risk minimization (ERM). Due to its noisy perturbation on each gradient update, the error rate of DP-SGD scales with the…

Machine Learning · Computer Science 2021-04-27 Yingxue Zhou , Zhiwei Steven Wu , Arindam Banerjee

Public Safety Power Shutoffs (PSPS) force rapid topology changes that can render standard operating points infeasible, requiring operators to quickly identify corrective transmission switching actions that reduce load shedding while…

Systems and Control · Electrical Eng. & Systems 2026-02-18 Mohamad Chehade , Hao Zhu

Several recent studies in privacy-preserving learning have considered the trade-off between utility or risk and the level of differential privacy guaranteed by mechanisms for statistical query processing. In this paper we study this…

Machine Learning · Computer Science 2009-12-01 Benjamin I. P. Rubinstein , Peter L. Bartlett , Ling Huang , Nina Taft

Silicon carbide (SiC) divacancies are attractive candidates for spin defect qubits possessing long coherence times and optical addressability. The high activation barriers associated with SiC defect formation and motion pose challenges for…

In this paper, we consider a finite difference grid-based semi-Lagrangian approach in solving the Vlasov-Poisson (VP) system. Many of existing methods are based on dimensional splitting, which decouples the problem into solving linear…

Numerical Analysis · Mathematics 2016-03-01 Jing-Mei Qiu , Giovanni Russo

In recent centralized nonconvex distributed learning and federated learning, local methods are one of the promising approaches to reduce communication time. However, existing work has mainly focused on studying first-order optimality…

Machine Learning · Computer Science 2022-10-13 Tomoya Murata , Taiji Suzuki

In the domain of deep learning, the challenge of protecting sensitive data while maintaining model utility is significant. Traditional Differential Privacy (DP) techniques such as Differentially Private Stochastic Gradient Descent (DP-SGD)…

Machine Learning · Computer Science 2024-11-06 Tao Huang , Qingyu Huang , Xin Shi , Jiayang Meng , Guolong Zheng , Xu Yang , Xun Yi

This paper studies the problem of differentially private empirical risk minimization (DP-ERM) for binary linear classification. We obtain an efficient $(\varepsilon,\delta)$-DP algorithm with an empirical zero-one risk bound of…

Machine Learning · Computer Science 2025-06-02 Erchi Wang , Yuqing Zhu , Yu-Xiang Wang

Scalability is a significant challenge when it comes to applying differential privacy to training deep neural networks. The commonly used DP-SGD algorithm struggles to maintain a high level of privacy protection while achieving high…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Kamil Adamczewski , Yingchen He , Mijung Park

An open problem in differentially private deep learning is hyperparameter optimization (HPO). DP-SGD introduces new hyperparameters and complicates existing ones, forcing researchers to painstakingly tune hyperparameters with hundreds of…

Machine Learning · Computer Science 2024-05-07 Ashwinee Panda , Xinyu Tang , Saeed Mahloujifar , Vikash Sehwag , Prateek Mittal

The discovery of Partial Differential Equations (PDEs) is an essential task for applied science and engineering. However, data-driven discovery of PDEs is generally challenging, primarily stemming from the sensitivity of the discovered…

Machine Learning · Statistics 2024-03-27 Aoxue Chen , Yifan Du , Liyao Mars Gao , Guang Lin

We introduce a new numerical method based on machine learning to approximate the solution of elliptic partial differential equations with collocation using a set of sigmoidal functions. We show that a feedforward neural network with a…

Numerical Analysis · Mathematics 2023-03-24 Francesco Calabrò , Gianluca Fabiani , Constantinos Siettos

Enforcing exact macroscopic conservation laws, such as mass and energy, in neural partial differential equation (PDE) solvers is computationally challenging in high dimensions. Traditional discrete projections rely on deterministic…

Machine Learning · Computer Science 2026-04-01 Zhangyong Liang

Large-scale distributed training of deep neural networks results in models with worse generalization performance as a result of the increase in the effective mini-batch size. Previous approaches attempt to address this problem by varying…

Machine Learning · Computer Science 2020-02-17 Kazuki Osawa , Yohei Tsuji , Yuichiro Ueno , Akira Naruse , Chuan-Sheng Foo , Rio Yokota

Differentially Private methods for training Deep Neural Networks (DNNs) have progressed recently, in particular with the use of massive batches and aggregated data augmentations for a large number of training steps. These techniques require…

Machine Learning · Computer Science 2023-05-25 Tom Sander , Pierre Stock , Alexandre Sablayrolles

This paper studies a fundamental problem in convex optimization, which is to solve semidefinite programming (SDP) with high accuracy. This paper follows from the existing robust SDP-based interior point method analysis due to [Huang, Jiang,…

Quantum Physics · Physics 2023-02-08 Baihe Huang , Shunhua Jiang , Zhao Song , Runzhou Tao , Ruizhe Zhang

We apply a novel method with machine learning to calibrate sub-grid models within numerical simulation codes to achieve convergence with observations and between different codes. It utilizes active learning and neural density estimators.…

Astrophysics of Galaxies · Physics 2022-10-07 Boon Kiat Oh , Hongjun An , Eun-jin Shin , Ji-hoon Kim , Sungwook E. Hong