English
Related papers

Related papers: Novel Machine Learning and Differentiable Programm…

200 papers

Semidefinite programming (SDP) is a fundamental convex optimization problem with wide-ranging applications. However, solving large-scale instances remains computationally challenging due to the high cost of solving linear systems and…

Optimization and Control · Mathematics 2025-12-22 Hantao Nie , Dong An , Zaiwen Wen

When applying machine learning to medical image classification, data leakage is a critical issue. Previous methods, such as adding noise to gradients for differential privacy, work well on large datasets like MNIST and CIFAR-100, but fail…

Machine Learning · Computer Science 2025-07-10 Xiaobo Huang , Fang Xie

Releasing data once and for all under noninteractive Local Differential Privacy (LDP) enables complete data reusability, but the resulting noise may create bias in subsequent analyses. In this work, we leverage the Weierstrass transform to…

Machine Learning · Computer Science 2026-02-19 Jean Dufraiche , Paul Mangold , Michaël Perrot , Marc Tommasi

Large language models (LLMs) frequently memorize sensitive or personal information, raising significant privacy concerns. Existing variants of differential privacy stochastic gradient descent (DPSGD) inject uniform noise into every gradient…

Machine Learning · Computer Science 2025-09-30 Manjiang Yu , Priyanka Singh , Xue Li , Yang Cao

Load shedding has been one of the most widely used and effective emergency control approaches against voltage instability. With increased uncertainties and rapidly changing operational conditions in power systems, existing methods have…

Systems and Control · Electrical Eng. & Systems 2020-12-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Xinya Li , Ang Li , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Many nonconvex problems in robotics can be relaxed into convex formulations via Semi-Definite Programming (SDP) that can be solved to global optimality. The practical quality of these solutions, however, critically depends on rounding them…

Robotics · Computer Science 2025-10-02 Liangting Wu , Roberto Tron

Differential privacy (DP) has been applied in deep learning for preserving privacy of the underlying training sets. Existing DP practice falls into three categories - objective perturbation, gradient perturbation and output perturbation.…

Cryptography and Security · Computer Science 2022-04-28 Zhigang Lu , Hassan Jameel Asghar , Mohamed Ali Kaafar , Darren Webb , Peter Dickinson

Stochastic variance-reduced gradient (SVRG) algorithms have been shown to work favorably in solving large-scale learning problems. Despite the remarkable success, the stochastic gradient complexity of SVRG-type algorithms usually scales…

Machine Learning · Computer Science 2020-09-22 Pan Zhou , Xiaotong Yuan

Fine-tuning large language models on downstream tasks is crucial for realizing their cross-domain potential but often relies on sensitive data, raising privacy concerns. Differential privacy (DP) offers rigorous privacy guarantees and has…

Machine Learning · Computer Science 2026-01-19 Lele Zheng , Xiang Wang , Tao Zhang , Yang Cao , Ke Cheng , Yulong Shen

Resistive AC-coupled Silicon Detectors (RSDs) are based on the Low Gain Avalanche Diode (LGAD) technology, characterized by a continuous gain layer, and by the innovative introduction of resistive read-out. Thanks to a novel electrode…

In this paper, we consider the maximum a posteriori (MAP) estimation for the multiple measurement vectors (MMV) problem with application to direction-of-arrival (DOA) estimation, which is classically formulated as a regularized…

Signal Processing · Electrical Eng. & Systems 2024-10-21 Tianyi Liu , Frederic Matter , Alexander Sorg , Marc E. Pfetsch , Martin Haardt , Marius Pesavento

This paper addresses the problem of nearly optimal Vapnik--Chervonenkis dimension (VC-dimension) and pseudo-dimension estimations of the derivative functions of deep neural networks (DNNs). Two important applications of these estimations…

Machine Learning · Computer Science 2023-05-16 Yahong Yang , Haizhao Yang , Yang Xiang

This work considers stochastic Galerkin approximations of linear elliptic partial differential equations (PDEs) with stochastic forcing terms and stochastic diffusion coefficients, that cannot be bounded uniformly away from zero and…

Numerical Analysis · Mathematics 2026-01-12 Fabio Musco , Andrea Barth

In this paper, we analyze the symbol error rate (SER) performance of the simultaneous wireless information and power transfer (SWIPT) enabled three-node differential decode-and-forward (DDF) relay networks, which adopt the power splitting…

Information Theory · Computer Science 2020-05-08 Yuxin Lu , Wai Ho Mow

In this paper, we propose an efficient two-stage decoding algorithm for non-adaptive Group Testing (GT) with general correlated prior statistics. The proposed solution can be applied to any correlated statistical prior represented in…

Information Theory · Computer Science 2026-03-03 Ayelet C. Portnoy , Amit Solomon , Alejandro Cohen

High-dimensional partial differential equations (PDE) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment (CVA) models, or portfolio optimization models. The PDEs in…

Numerical Analysis · Mathematics 2020-07-15 Christian Beck , Weinan E , Arnulf Jentzen

The JSNS2-II (the second phase of JSNS2, J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment aimed at searching for sterile neutrinos. This experiment has entered its second phase, employing two liquid…

Differential learning rate (DLR), a technique that applies different learning rates to different model parameters, has been widely used in deep learning and achieved empirical success via its various forms. For example, parameter-efficient…

Machine Learning · Computer Science 2025-05-20 Shiyun Xu , Zhiqi Bu , Yiliang Zhang , Ian Barnett

Differentially Private Stochastic Gradient Descent (DP-SGD) is a key method for applying privacy in the training of deep learning models. It applies isotropic Gaussian noise to gradients during training, which can perturb these gradients in…

Machine Learning · Computer Science 2023-11-28 Pedro Faustini , Natasha Fernandes , Shakila Tonni , Annabelle McIver , Mark Dras

Physics-informed neural networks (PINNs) have attracted significant attention for solving partial differential equations (PDEs) in recent years because they alleviate the curse of dimensionality that appears in traditional methods. However,…

Machine Learning · Computer Science 2024-03-15 Yihang Gao , Ka Chun Cheung , Michael K. Ng