English
Related papers

Related papers: Characterizing High-Dimensional Optical Systems wi…

200 papers

In this paper, a very effective method to solve the contiguous face occlusion recognition problem is proposed. It utilizes the robust image gradient direction features together with a variety of mapping functions and adopts a hierarchical…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Cho-Ying Wu , Jian-Jiun Ding

In this paper, we present a novel approach to reconstruct a unique image of an observed scene with widely distributed radar sensors. The problem is posed as a constrained optimization problem in which the global image which represents the…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Ahmed Murtada , Ruizhi Hu , Bhavani Shankar Mysore Rama Rao , Udo Schroeder

Modern foundation models such as large language models (LLMs) and large multi-modal models (LMMs) require a massive amount of computational and memory resources. We propose a new framework to convert such LLMs/LMMs into a reduced-dimension…

Machine Learning · Computer Science 2025-05-27 Toshiaki Koike-Akino , Xiangyu Chen , Jing Liu , Ye Wang , Pu , Wang , Matthew Brand

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

The recently proposed fully-connected tensor network (FCTN) decomposition has demonstrated significant advantages in correlation characterization and transpositional invariance, and has achieved notable achievements in multi-dimensional…

Machine Learning · Computer Science 2026-02-16 Wenjin Qin , Hailin Wang , Jiangjun Peng , Jianjun Wang , Tingwen Huang

We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz

We propose Adaptive Compressed Gradient Descent (AdaCGD) - a novel optimization algorithm for communication-efficient training of supervised machine learning models with adaptive compression level. Our approach is inspired by the recently…

Machine Learning · Computer Science 2022-11-02 Maksim Makarenko , Elnur Gasanov , Rustem Islamov , Abdurakhmon Sadiev , Peter Richtarik

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various convex or nonconvex composite problems that arise in the fields of image & signal processing and machine…

Optimization and Control · Mathematics 2014-12-08 Fenghui Wang , Zongben Xu , Hong-Kun Xu

We propose both serial and parallel proximal (linearized) alternating direction method of multipliers (ADMM) algorithms for training residual neural networks. In contrast to backpropagation-based approaches, our methods inherently mitigate…

Machine Learning · Computer Science 2025-04-01 Jintao Xu , Yifei Li , Wenxun Xing

Quantum entanglement is a critical resource for quantum information and quantum computation. However, entanglement of a quantum system is subjected to change due to the interaction with the environment. One typical result of the interaction…

Quantum Physics · Physics 2015-06-11 Zeyang Liao , M. Al-Amri , M. Suhail Zubairy

We present a compressive radar design that combines multitone linear frequency modulated (LFM) waveforms in the transmitter with a classical stretch processor and sub-Nyquist sampling in the receiver. The proposed compressive illumination…

Information Theory · Computer Science 2022-04-13 Nithin Sugavanam , Siddharth Baskar , Emre Ertin

This paper presents three distributed techniques to find a sparse solution of the underdetermined linear problem $\textbf{g}=\textbf{Hu}$ with a norm-1 regularization, based on the Alternating Direction Method of Multipliers (ADMM). These…

Computational Engineering, Finance, and Science · Computer Science 2018-11-15 Juan Heredia-Juesas , Ali Molaei , Luis Tirado , Jose A. Martinez-Lorenzo

We present a flexible Alternating Direction Method of Multipliers (F-ADMM) algorithm for solving optimization problems involving a strongly convex objective function that is separable into $n \geq 2$ blocks, subject to (non-separable)…

Optimization and Control · Mathematics 2015-03-24 Daniel P. Robinson , Rachael E. H. Tappenden

The Johnson-Lindenstrauss transform allows one to embed a dataset of $n$ points in $\mathbb{R}^d$ into $\mathbb{R}^m,$ while preserving the pairwise distance between any pair of points up to a factor $(1 \pm \varepsilon)$, provided that $m…

Data Structures and Algorithms · Computer Science 2022-07-08 Ora Nova Fandina , Mikael Møller Høgsgaard , Kasper Green Larsen

In this paper, we propose two low-complexity optimization methods to reduce peak-to-average power ratio (PAPR) values of orthogonal frequency division multiplexing (OFDM) signals via alternating direction method of multipliers (ADMM).…

Signal Processing · Electrical Eng. & Systems 2018-12-26 Yongchao Wang , Yanjiao Wang , Qingjiang Shi

In this paper, we discuss a family of robust, high-dimensional regression models for quantile and composite quantile regression, both with and without an adaptive lasso penalty for variable selection. We reformulate these quantile…

Computation · Statistics 2020-06-29 Matthew Pietrosanu , Jueyu Gao , Linglong Kong , Bei Jiang , Di Niu

We propose a distributed algorithm, named Distributed Alternating Direction Method of Multipliers (D-ADMM), for solving separable optimization problems in networks of interconnected nodes or agents. In a separable optimization problem there…

Optimization and Control · Mathematics 2013-04-26 João F. C. Mota , João M. F. Xavier , Pedro M. Q. Aguiar , Markus Püschel

In this paper, we design low correlation binary sequences favorable in wireless communication and radar applications. First, we formulate the designing problem as a nonconvex combination optimization problem with flexible correlation…

Signal Processing · Electrical Eng. & Systems 2021-10-07 Jiangtao Wang , Yongchao Wang

In real-world, many problems can be formulated as the alignment between two geometric patterns. Previously, a great amount of research focus on the alignment of 2D or 3D patterns, especially in the field of computer vision. Recently, the…

Machine Learning · Computer Science 2018-11-20 Hu Ding , Mingquan Ye

In this paper, we propose a new unified optimization algorithm for general tensor decomposition which is formulated as an inverse problem for low-rank tensors in the general linear observation models. The proposed algorithm supports three…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Manabu Mukai , Hidekata Hontani , Tatsuya Yokota