English
Related papers

Related papers: Alternating Optimization Approach for Computing $\…

200 papers

This work presents non-orthogonal multiple access (NOMA) enabled energy-efficient alternating optimization framework for backscatter aided wireless powered uplink sensors communications for beyond 5G intelligent transportation system (ITS).…

Signal Processing · Electrical Eng. & Systems 2022-05-17 Asim Ihsan , Wen Chen , Wali Ullah Khan , Qingqing Wu , Kunlun Wang

Successful applications of InfoNCE and its variants have popularized the use of contrastive variational mutual information (MI) estimators in machine learning. While featuring superior stability, these estimators crucially depend on costly…

Machine Learning · Statistics 2022-10-25 Qing Guo , Junya Chen , Dong Wang , Yuewei Yang , Xinwei Deng , Lawrence Carin , Fan Li , Jing Huang , Chenyang Tao

Classical computing is beginning to encounter fundamental limits of energy efficiency. This presents a challenge that can no longer be solved by strategies such as increasing circuit density or refining standard semiconductor processes. The…

Hardware Architecture · Computer Science 2026-04-07 Keshava Katti , Pratik Chaudhari , Deep Jariwala

We propose a globally convergent alternating minimization (AM) algorithm for image reconstruction in transmission tomography, which extends automatic relevance determination (ARD) to Poisson noise models with Beer's law. The algorithm…

Recent advances in maximizing mutual information (MI) between the source and target have demonstrated its effectiveness in text generation. However, previous works paid little attention to modeling the backward network of MI (i.e.,…

Computation and Language · Computer Science 2020-07-02 Boyuan Pan , Yazheng Yang , Kaizhao Liang , Bhavya Kailkhura , Zhongming Jin , Xian-Sheng Hua , Deng Cai , Bo Li

Conventional multiple-input multiple-output (MIMO) systems mainly rely on fixed antenna arrays, which limits their capability to adapt the effective channel matrix to the propagation environment. Rotatable antennas (RAs), which enable…

Information Theory · Computer Science 2026-04-30 Zheng Ailing , Wu Qingqing , Peng Xingxiang , Peng Qiaoyan , Zheng Ziyuan , Chen Wen

In this paper, we examine the fundamental trade-off between radiated power and achieved throughput in wireless multi-carrier, multiple-input and multiple-output (MIMO) systems that vary with time in an unpredictable fashion (e.g. due to…

Information Theory · Computer Science 2015-03-10 Ioannis Stiakogiannakis , Panayotis Mertikopoulos , Corinne Touati

Distributed optimization algorithms are essential for training machine learning models on very large-scale datasets. However, they often suffer from communication bottlenecks. Confronting this issue, a communication-efficient primal-dual…

Optimization and Control · Mathematics 2017-11-16 Chenxin Ma , Martin Jaggi , Frank E. Curtis , Nathan Srebro , Martin Takáč

Proposed hybrid algorithms encode a combinatorial cost function into a problem Hamiltonian and optimize its energy by varying over a set of states with low circuit complexity. Classical processing is typically only used for the choice of…

Quantum Physics · Physics 2022-08-25 Libor Caha , Alexander Kliesch , Robert Koenig

In decision-making under uncertainty, several criteria have been studied to aggregate the performance of a solution over multiple possible scenarios. This paper introduces a novel variant of ordered weighted averaging (OWA) for optimization…

Optimization and Control · Mathematics 2024-01-30 Werner Baak , Marc Goerigk , Adam Kasperski , Paweł Zieliński

We propose a framework for online meta-optimization of parameters that govern optimization, called Amortized Proximal Optimization (APO). We first interpret various existing neural network optimizers as approximate stochastic proximal point…

Machine Learning · Computer Science 2022-03-02 Juhan Bae , Paul Vicol , Jeff Z. HaoChen , Roger Grosse

Given a multivariate data set, sparse principal component analysis (SPCA) aims to extract several linear combinations of the variables that together explain the variance in the data as much as possible, while controlling the number of…

Machine Learning · Statistics 2020-05-08 Peter Richtárik , Majid Jahani , Selin Damla Ahipaşaoğlu , Martin Takáč

In this paper, we focus on an asynchronous distributed optimization problem. In our problem, each node is endowed with a convex local cost function, and is able to communicate with its neighbors over a directed communication network.…

Optimization and Control · Mathematics 2023-09-12 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

Recent advancements in Mixed Integer Optimization (MIO) algorithms, paired with hardware enhancements, have led to significant speedups in resolving MIO problems. These strategies have been utilized for optimal subset selection,…

Methodology · Statistics 2024-03-27 Madhav Sankaranarayanan , Intekhab Hossain , Tom Chen

In this paper we describe a new algorithm called Fast Adaptive Sequencing Technique (FAST) for maximizing a monotone submodular function under a cardinality constraint $k$ whose approximation ratio is arbitrarily close to $1-1/e$, is…

Machine Learning · Computer Science 2019-07-16 Adam Breuer , Eric Balkanski , Yaron Singer

Adaptive gradient-based optimizers such as Adagrad and Adam are crucial for achieving state-of-the-art performance in machine translation and language modeling. However, these methods maintain second-order statistics for each parameter,…

Machine Learning · Computer Science 2019-09-13 Rohan Anil , Vineet Gupta , Tomer Koren , Yoram Singer

Variational approaches based on neural networks are showing promise for estimating mutual information (MI) between high dimensional variables. However, they can be difficult to use in practice due to poorly understood bias/variance…

Machine Learning · Computer Science 2020-03-25 Jiaming Song , Stefano Ermon

In this paper, we enriched Ant Colony Optimization (ACO) with interval outranking to develop a novel multiobjective ACO optimizer to approach problems with many objective functions. This proposal is suitable if the preferences of the…

Neural and Evolutionary Computing · Computer Science 2021-07-16 Gilberto Rivera , Carlos A. Coello Coello , Laura Cruz-Reyes , Eduardo R. Fernandez , Claudia Gomez-Santillan , Nelson Rangel-Valdez

This paper investigates an innovative movable antenna (MA)-enhanced multiple-input multiple-output (MIMO) system designed to enhance communication performance. We aim to maximize the energy efficiency (EE) under statistical channel state…

Information Theory · Computer Science 2025-01-22 Xintai Chen , Biqian Feng , Yongpeng Wu , Wenjun Zhang

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren