English
Related papers

Related papers: PRISM: Structured Optimization via Anisotropic Spe…

200 papers

Advances in numerical optimization have supported breakthroughs in several areas of signal processing. This paper focuses on the recent enhanced variants of the proximal gradient numerical optimization algorithm, which combine quasi-Newton…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Niccolò Antonello , Lorenzo Stella , Panagiotis Patrinos , Toon van Waterschoot

Processing-in-DRAM (DRAM-PIM) has emerged as a promising technology for accelerating memory-intensive operations in modern applications, such as Large Language Models (LLMs). Despite its potential, current software stacks for DRAM-PIM face…

Hardware Architecture · Computer Science 2025-06-03 Yongwon Shin , Dookyung Kang , Hyojin Sung

Standard gradient descent methods are susceptible to a range of issues that can impede training, such as high correlations and different scaling in parameter space.These difficulties can be addressed by second-order approaches that apply a…

Machine Learning · Computer Science 2020-04-29 Ted Moskovitz , Rui Wang , Janice Lan , Sanyam Kapoor , Thomas Miconi , Jason Yosinski , Aditya Rawal

Programmable optical devices provide performance enhancement and flexibility to spatial multiplexing systems enabling transmission of tributaries in high-order eigenmodes of spatially-diverse transmission media, like multimode fiber (MMF).…

Supported by the recent contributions in multiple branches, the first-order splitting algorithms became central for structured nonsmooth optimization. In the large-scale or noisy contexts, when only stochastic information on the smooth part…

Optimization and Control · Mathematics 2020-10-05 Andrei Patrascu , Paul Irofti

A class of preconditioners is introduced to enhance geometry optimisation and transition state search of molecular systems. We start from the Hessian of molecular mechanical terms, decompose it and retain only its positive definite part to…

Chemical Physics · Physics 2018-04-06 Letif Mones , Gabor Csanyi , Christoph Ortner

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Numerous renowned algorithms for tackling the compressed sensing problem…

Information Theory · Computer Science 2026-03-11 Xu Zhu , Yufei Ma , Xiaoguang Li , Tiejun Li

In this paper, we present a surface remeshing method with high approximation quality based on Principal Component Analysis. Given a triangular mesh and a user assigned polygon/vertex budget, traditional methods usually require the extra…

Graphics · Computer Science 2018-04-10 Yiqi Cai , Xiaohu Guo , Yang Liu , Wenping Wang , Weihua Mao , Zichun Zhong

The focus of this paper is on spatial precoding in correlated multi-antenna channels, where the number of independent data-streams is adapted to trade-off the data-rate with the transmitter complexity. Towards the goal of a low-complexity…

Information Theory · Computer Science 2009-09-29 Vasanthan Raghavan , Akbar Sayeed , Venu Veeravalli

With the proposal of the Segment Anything Model (SAM), fine-tuning SAM for medical image segmentation (MIS) has become popular. However, due to the large size of the SAM model and the significant domain gap between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Jinfeng Wang , Sifan Song , Xinkun Wang , Yiyi Wang , Yiyi Miao , Jionglong Su , S. Kevin Zhou

In this correspondence, we propose a space domain index modulation (IM) scheme for the downlink of multiuser multiple-input multiple-output (MU-MIMO) systems. Instead of the most common approach where spatial bits select active receiver…

Signal Processing · Electrical Eng. & Systems 2020-07-23 Nuno Souto , Américo Correia

In this paper, we propose a descent method for composite optimization problems with linear operators. Specifically, we first design a structure-exploiting preconditioner tailored to the linear operator so that the resulting preconditioned…

Optimization and Control · Mathematics 2026-03-20 Jian Chen , Xinmin Yang

We consider probabilistic shaping to maximize the achievable information rate of coded modulation (CM) with hard decision decoding. The proposed scheme using binary staircase codes outperforms its uniform CM counterpart by more than 1.3 dB…

Information Theory · Computer Science 2017-05-08 Alireza Sheikh , Alexandre Graell i Amat , Gianluigi Liva

We are presenting a modification of the well-known Alternating Direction Method of Multipliers (ADMM) algorithm with additional preconditioning that aims at solving convex optimisation problems with nonlinear operator constraints.…

Numerical Analysis · Mathematics 2020-02-13 Martin Benning , Florian Knoll , Carola-Bibiane Schönlieb , Tuomo Valkonen

We describe Substitutional Neural Image Compression (SNIC), a general approach for enhancing any neural image compression model, that requires no data or additional tuning of the trained model. It boosts compression performance toward a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Xiao Wang , Wei Jiang , Wei Wang , Shan Liu , Brian Kulis , Peter Chin

Large model training beyond tens of thousands of GPUs is an uncharted territory. At such scales, disruptions to the training process are not a matter of if, but a matter of when -- a stochastic process degrading training productivity.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Alicia Golden , Michael Kuchnik , Samuel Hsia , Zachary DeVito , Gu-Yeon Wei , David Brooks , Carole-Jean Wu

We demonstrate that Muon, the simplest instantiation of a second-order optimizer, explicitly expands the Pareto frontier over AdamW on the compute-time tradeoff. We find that Muon is more effective than AdamW in retaining data efficiency at…

We consider binary continuous phase modulation (CPM) signals used in some recent low-cost and low-power consumption telecommunications standard. When these signals are generated through a low-cost transmitter, the real modulation index can…

Information Theory · Computer Science 2015-09-14 Malek Messai , Colavolpe Giulio , Amis Karine , Guilloud Frederic

Structured illumination microscopy (SIM) is a very important super-resolution microscopy technique, which provides high speed super-resolution with about two-fold spatial resolution enhancement. Several attempts aimed at improving the…

Computer Vision and Pattern Recognition · Computer Science 2016-02-23 Amit Lal , Chunyan Shan , Peng Xi

Benefiting from the rapid development of metamaterials and metasurfaces, the holographic multiple-input and multiple-output surface (HMIMOS) has been regarded as a promising solution for future wireless networks recently. By densely packing…

Signal Processing · Electrical Eng. & Systems 2025-11-10 Haochen Wu , Yuanbin Chen , Yang Ming , Zhaocheng Wang