English
Related papers

Related papers: Applying Automatic Differentiation to Optimize Dif…

200 papers

Adaptive Demodulation (ADM) is a newly proposed rate-adaptive system which operates without requiring Channel State Information (CSI) at the transmitter (unlike adaptive modulation) by using adaptive decision region boundaries at the…

Information Theory · Computer Science 2016-11-17 J. David Brown , Jamshid Abouei , Konstantinos N. Plataniotis , Subbarayan Pasupathy

Local differential privacy (LDP) is a strong privacy standard that has been adopted by popular software systems. The main idea is that each individual perturbs their own data locally, and only submits the resulting noisy version to a data…

Cryptography and Security · Computer Science 2024-04-04 Fei Wei , Ergute Bao , Xiaokui Xiao , Yin Yang , Bolin Ding

User and item features of side information are crucial for accurate recommendation. However, the large number of feature dimensions, e.g., usually larger than 10^7, results in expensive storage and computational cost. This prohibits fast…

Information Retrieval · Computer Science 2018-09-20 Han Liu , Xiangnan He , Fuli Feng , Liqiang Nie , Rui Liu , Hanwang Zhang

Since space-domain information can be utilized, microphone array beamforming is often used to enhance the quality of the speech by suppressing directional disturbance. However, with the increasing number of microphone, the complexity would…

Sound · Computer Science 2020-05-20 Lu Ma , Xin Zhao , Pei Zhao , Tengrong Su

We extend a primal-dual fixed point algorithm (PDFP) proposed in [5] to solve two kinds of separable multi-block minimization problems, arising in signal processing and imaging science. This work shows the flexibility of applying PDFP…

Optimization and Control · Mathematics 2016-02-02 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

Federated Learning (FL) is an emerging framework for distributed processing of large data volumes by edge devices subject to limited communication bandwidths, heterogeneity in data distributions and computational resources, as well as…

Machine Learning · Computer Science 2022-04-11 Yonghai Gong , Yichuan Li , Nikolaos M. Freris

Multi-channel speech enhancement aims to recover clean speech from noisy multi-channel recordings. Most deep learning methods employ discriminative training, which can lead to non-linear distortions from regression-based objectives,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-26 Zhongweiyang Xu , Ashutosh Pandey , Juan Azcarreta , Zhaoheng Ni , Sanjeel Parekh , Buye Xu

Automated respiratory sound classification faces practical challenges from background noise and insufficient denoising in existing systems. We propose Adaptive Differential Denoising network, that integrates noise suppression and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-04 Gaoyang Dong , Zhicheng Zhang , Ping Sun , Minghui Zhang

Due to the low impedance and high feeding currents, it is naturally challenging to design super-directive antenna arrays that perfectly match the feed line, and this becomes almost impossible as the number of elements increases. In this…

Signal Processing · Electrical Eng. & Systems 2024-02-13 Ihsan Kanbaz , Okan Yurduseven , Michail Matthaiou

Automating radio frequency (RF) amplifier design remains challenging because existing methods suffer from the curse of dimensionality, weak use of domain knowledge, and poor transferability, leading to low data efficiency. Meanwhile,…

Hardware Architecture · Computer Science 2026-05-12 Hang Lu , Guochang Li , Qianyu Chen , Huiyan Gao , Shaogang Wang , Xuanyu He , Yiwei Liu , Gaopeng Chen , Nayu Li , Xiaokang Qi , Chunyi Song , Zhiwei Xu

In this paper, we propose an algorithmic framework, dubbed inertial alternating direction methods of multipliers (iADMM), for solving a class of nonconvex nonsmooth multiblock composite optimization problems with linear constraints. Our…

Optimization and Control · Mathematics 2023-01-26 Le Thi Khanh Hien , Duy Nhat Phan , Nicolas Gillis

Nonnegative matrix factorization (NMF) often relies on the separability condition for tractable algorithm design. Separability-based NMF is mainly handled by two types of approaches, namely, greedy pursuit and convex programming. A notable…

Signal Processing · Electrical Eng. & Systems 2022-07-20 Tri Nguyen , Xiao Fu , Ruiyuan Wu

Federated learning is a distributed learning framework where clients collaboratively train a global model without sharing their raw data. FedAvg is a popular algorithm for federated learning, but it often suffers from slow convergence due…

Machine Learning · Computer Science 2025-05-19 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa

Linearized alternating direction method of multipliers (ADMM) as an extension of ADMM has been widely used to solve linearly constrained problems in signal processing, machine leaning, communications, and many other fields. Despite its…

Optimization and Control · Mathematics 2017-11-02 Qinghua Liu , Xinyue Shen , Yuantao Gu

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

The Differential Privacy (DP) literature often centers on meeting privacy constraints by introducing noise to the query, typically using a pre-specified parametric distribution model with one or two degrees of freedom. However, this…

Cryptography and Security · Computer Science 2024-09-30 Sachin Kadam , Anna Scaglione , Nikhil Ravi , Sean Peisert , Brent Lunghino , Aram Shumavon

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

This paper develops a novel differentially private framework to solve convex optimization problems with sensitive optimization data and complex physical or operational constraints. Unlike standard noise-additive algorithms, that act…

Cryptography and Security · Computer Science 2020-06-23 Vladimir Dvorkin , Ferdinando Fioretto , Pascal Van Hentenryck , Jalal Kazempour , Pierre Pinson

Recently, the research on ad-hoc microphone arrays with deep learning has drawn much attention, especially in speech enhancement and separation. Because an ad-hoc microphone array may cover such a large area that multiple speakers may…

Sound · Computer Science 2020-12-02 Ziye Yang , Shanzheng Guan , Xiao-Lei Zhang

Automatic differentiation (autodiff) has revolutionized machine learning. It allows to express complex computations by composing elementary ones in creative ways and removes the burden of computing their derivatives by hand. More recently,…