English
Related papers

Related papers: Applying Automatic Differentiation to Optimize Dif…

200 papers

Low-rank Adaptation (LoRA) models have revolutionized the personalization of pre-trained diffusion models by enabling fine-tuning through low-rank, factorized weight matrices specifically optimized for attention layers. These models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Mert Sonmezer , Matthew Zheng , Pinar Yanardag

The alternating direction method of multipliers (ADMM) has been popular for solving many signal processing problems, convex or nonconvex. In this paper, we study an asynchronous implementation of the ADMM for solving a nonconvex nonsmooth…

Information Theory · Computer Science 2014-12-19 Mingyi Hong

In this paper, we propose Distributed Mirror Descent (DMD) algorithm for constrained convex optimization problems on a (strongly-)connected multi-agent network. We assume that each agent has a private objective function and a constraint…

Optimization and Control · Mathematics 2015-04-28 Chenguang Xi , Qiong Wu , Usman A. Khan

Spatial division multiple access (SDMA) is essential to improve the spectrum efficiency for multi-user multiple-input multiple-output (MIMO) communications. The classical SDMA for massive MIMO with hybrid precoding heavily relies on the…

Signal Processing · Electrical Eng. & Systems 2023-01-24 Zidong Wu , Linglong Dai

Traditional volumetric noise control typically relies on multipoint error minimization to suppress sound energy across a region, but offers limited flexibility in shaping spatial responses. This paper introduces a time domain formulation…

Sound · Computer Science 2025-09-19 Manan Mittal , Ryan M. Corey , Andrew C. Singer

Recently, large language models (LLMs) have achieved remarkable breakthroughs, revolutionizing the natural language processing domain and beyond. Due to immense parameter sizes, fine-tuning these models with private data for diverse…

Machine Learning · Computer Science 2025-05-06 Zheng Lin , Yuxin Zhang , Zhe Chen , Zihan Fang , Xianhao Chen , Praneeth Vepakomma , Wei Ni , Jun Luo , Yue Gao

In this paper, we propose a novel directional modulation (DM) scheme based on random frequency diverse arrays with artificial noise (RFDA-DM-AN) to enhance physical layer security of wireless communications. Specifically, we first design…

Information Theory · Computer Science 2016-12-21 Jinsong Hu , Shihao Yan , Feng Shu , Jiangzhou Wang , Jun Li , Yijin Zhang

Dynamic mode decomposition (DMD) is a widely used data-driven algorithm for predicting the future states of dynamical systems. However, its standard formulation often struggles with poor long-term predictive accuracy. To address this…

Numerical Analysis · Mathematics 2026-04-21 Qiuqi Li , Chang Liu , Yifei Yang

Ptychography is a lensless imaging method that allows for wavefront sensing and phase-sensitive microscopy from a set of diffraction patterns. Recently, it has been shown that the optimization task in ptychography can be achieved via…

Image and Video Processing · Electrical Eng. & Systems 2021-01-13 Jacob Seifert , Dorian Bouchet , Lars Loetgering , Allard P. Mosk

Interfering sources, background noise and reverberation degrade speech quality and intelligibility in hearing aid applications. In this paper, we present an adaptive algorithm aiming at dereverberation, noise and interferer reduction and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Henri Gode , Simon Doclo

The dynamic mode decomposition (DMD) has become a leading tool for data-driven modeling of dynamical systems, providing a regression framework for fitting linear dynamical models to time-series measurement data. We present a simple…

Numerical Analysis · Mathematics 2017-04-11 Travis Askham , J. Nathan Kutz

The frequency-diverse array (FDA) offers a time-varying beamforming capability without the use of phase shifters. The autoscanning property is achieved by applying a frequency offset between the antennas. This paper analyzes the performance…

Signal Processing · Electrical Eng. & Systems 2025-02-13 Marcin Wachowiak , André Bourdoux , Sofie Pollin

We augment the nonnegative matrix factorization method for audio source separation with cues about directionality of sound propagation. This improves separation quality greatly and removes the need for training data, with only a twofold…

Machine Learning · Statistics 2017-05-30 Noah D. Stein

Gradient-based methods are well-suited for derivative-free optimization (DFO), where finite-difference (FD) estimates are commonly used as gradient surrogates. Traditional stochastic approximation methods, such as Kiefer-Wolfowitz (KW) and…

Optimization and Control · Mathematics 2025-03-03 Guo Liang , Guangwu Liu , Kun Zhang

A new Efficient-bandwidth code-division-multiple-access (CDMA) for band-limited channels is introduced which is based on finite field transforms. A multilevel code division multiplex exploits orthogonality properties of nonbinary sequences…

Information Theory · Computer Science 2015-05-18 H. M. de Oliveira , R. M. Campello de Souza , A. N. Kauffman

This work presents two novel optimization methods based on integer linear programming (ILP) that minimize the number of adders used to implement a direct/transposed finite impulse response (FIR) filter adhering to a given frequency…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Martin Kumm , Anastasia Volkova , Silviu-Ioan Filip

Federated learning (FL) has emerged as a key technique for distributed machine learning (ML). Most literature on FL has focused on ML model training for (i) a single task/model, with (ii) a synchronous scheme for updating model parameters,…

Machine Learning · Computer Science 2024-02-19 Zhan-Lun Chang , Seyyedali Hosseinalipour , Mung Chiang , Christopher G. Brinton

We present a system for the automatic differentiation of a higher-order functional array-processing language. The core functional language underlying this system simultaneously supports both source-to-source automatic differentiation and…

Mathematical Software · Computer Science 2018-06-07 Amir Shaikhha , Andrew Fitzgibbon , Dimitrios Vytiniotis , Simon Peyton Jones , Christoph Koch

Spatial division multiple access (SDMA) is essential to improve the spectrum efficiency for multi-user multiple-input multiple-output (MIMO) communications. The classical SDMA for massive MIMO with hybrid precoding heavily relies on the…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Zidong Wu , Linglong Dai

Beamforming techniques use massive antenna arrays to formulate narrow Line-of-Sight signal sectors to address the increased signal attenuation in millimeter Wave (mmWave). However, traditional sector selection schemes involve extensive…

Networking and Internet Architecture · Computer Science 2025-10-07 Lucas Pacheco , Torsten Braun , Kaushik Chowdhury , Denis Rosário , Batool Salehi , Eduardo Cerqueira