English
Related papers

Related papers: Fast-MWEM: Private Data Release in Sublinear Time

200 papers

Tensor-based discrete density estimation requires flexible modeling and proper divergence criteria to enable effective learning; however, traditional approaches using $\alpha$-divergence face analytical challenges due to the $\alpha$-power…

Machine Learning · Statistics 2025-05-26 Kazu Ghalamkari , Jesper Løve Hinrich , Morten Mørup

The Matrix Element Method (MEM) is a powerful method to extract information from measured events at collider experiments. Compared to multivariate techniques built on large sets of experimental data, the MEM does not rely on an…

High Energy Physics - Experiment · Physics 2021-04-07 Florian Bury , Christophe Delaere

Extreme learning machine (ELM) as an emerging branch of shallow networks has shown its excellent generalization and fast learning speed. However, for blended data, the robustness of ELM is weak because its weights and biases of hidden nodes…

Machine Learning · Computer Science 2014-09-24 Bo Han , Bo He , Mengmeng Ma , Tingting Sun , Tianhong Yan , Amaury Lendasse

Exponential Moving Average (EMA) is a widely used weight averaging (WA) regularization to learn flat optima for better generalizations without extra cost in deep neural network (DNN) optimization. Despite achieving better flatness, existing…

Machine Learning · Computer Science 2024-10-08 Siyuan Li , Zicheng Liu , Juanxi Tian , Ge Wang , Zedong Wang , Weiyang Jin , Di Wu , Cheng Tan , Tao Lin , Yang Liu , Baigui Sun , Stan Z. Li

We present the Wavelet-based Edge Multiscale Parareal (WEMP) Algorithm, recently proposed in [Li and Hu, {\it J. Comput. Phys.}, 2021], for efficiently solving subdiffusion equations with heterogeneous coefficients in long time. This…

Numerical Analysis · Mathematics 2024-06-14 Guanglian Li

Data is continuously generated by modern data sources, and a recent challenge in machine learning has been to develop techniques that perform well in an incremental (streaming) setting. In this paper, we investigate the problem of private…

Data Structures and Algorithms · Computer Science 2017-01-05 Shiva Prasad Kasiviswanathan , Kobbi Nissim , Hongxia Jin

Weight pruning of deep neural networks (DNNs) has been proposed to satisfy the limited storage and computing capability of mobile edge devices. However, previous pruning methods mainly focus on reducing the model size and/or improving…

Machine Learning · Computer Science 2022-03-29 Yifan Gong , Zheng Zhan , Zhengang Li , Wei Niu , Xiaolong Ma , Wenhao Wang , Bin Ren , Caiwen Ding , Xue Lin , Xiaolin Xu , Yanzhi Wang

The weight matrix (WM) of a neural network (NN) is its program. The programs of many traditional NNs are learned through gradient descent in some error function, then remain fixed. The WM of a self-referential NN, however, can keep rapidly…

Machine Learning · Computer Science 2022-06-20 Kazuki Irie , Imanol Schlag , Róbert Csordás , Jürgen Schmidhuber

The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of…

Machine Learning · Statistics 2022-11-15 Hideitsu Hino , Shotaro Akaho , Noboru Murata

Motivated by applications in clustering and synthetic data generation, we consider the problem of releasing a minimum spanning tree (MST) under edge-weight differential privacy constraints where a graph topology $G=(V,E)$ with $n$ vertices…

Data Structures and Algorithms · Computer Science 2024-08-14 Rasmus Pagh , Lukas Retschmeier

State-of-the-art differentially private synthetic tabular data has been defined by adaptive 'select-measure-generate' frameworks, exemplified by methods like AIM. These approaches iteratively measure low-order noisy marginals and fit…

Machine Learning · Computer Science 2025-11-14 Samuel Maddock , Shripad Gade , Graham Cormode , Will Bullock

A critical factor in adopting machine learning for time-sensitive financial tasks is computational speed, including model training and inference. This paper demonstrates that a broad class of such problems, especially those previously…

Computational Finance · Quantitative Finance 2025-05-27 Liexin Cheng , Xue Cheng , Shuaiqiang Liu

To directly simulate rare events using atomistic molecular dynamics is a significant challenge in computational biophysics. Well-established enhanced-sampling techniques do exist to obtain the thermodynamic functions for such systems. But…

Statistical Mechanics · Physics 2020-07-21 Dhiman Ray , Ioan Andricioaei

Quantum Extreme Learning Machine (QELM) is an emerging hybrid quantum machine learning framework that leverages quantum system dynamics to enhance classical models. However, QELM can suffer from the exponential concentration problem, where…

Quantum Physics · Physics 2026-04-24 Payal D. Solanki , Anh Pham

Differential privacy is the dominant standard for formal and quantifiable privacy and has been used in major deployments that impact millions of people. Many differentially private algorithms for query release and synthetic data contain…

Machine Learning · Computer Science 2024-12-10 Brett Mullins , Miguel Fuentes , Yingtai Xiao , Daniel Kifer , Cameron Musco , Daniel Sheldon

Latent Gaussian models have a rich history in statistics and machine learning, with applications ranging from factor analysis to compressed sensing to time series analysis. The classical method for maximizing the likelihood of these models…

Machine Learning · Computer Science 2023-06-07 Alexander Lin , Bahareh Tolooshams , Yves Atchadé , Demba Ba

Deep directed generative models have attracted much attention recently due to their expressive representation power and the ability of ancestral sampling. One major difficulty of learning directed models with many latent variables is the…

Machine Learning · Computer Science 2015-06-16 Siqi Nie , Qiang Ji

There have been several recent advancements in Machine Learning community on the Entity Matching (EM) problem. However, their lack of scalability has prevented them from being applied in practical settings on large real-life datasets.…

Databases · Computer Science 2011-03-15 Vibhor Rastogi , Nilesh Dalvi , Minos Garofalakis

Linear regression is a fundamental tool for statistical analysis. This has motivated the development of linear regression methods that also satisfy differential privacy and thus guarantee that the learned model reveals little about any one…

Machine Learning · Computer Science 2023-03-20 Kareem Amin , Matthew Joseph , Mónica Ribero , Sergei Vassilvitskii

In this paper, we address the identification problem for the systems characterized by linear time-invariant dynamics with bilinear observation models. More precisely, we consider a suitable parametric description of the system and formulate…

Systems and Control · Electrical Eng. & Systems 2025-02-24 Diyou Liu , Mohammad Khosravi