English
Related papers

Related papers: $\alpha$-approximate Reductions: a Novel Source of…

200 papers

Recently, supervised hashing methods have attracted much attention since they can optimize retrieval speed and storage cost while preserving semantic information. Because hashing codes learning is NP-hard, many methods resort to some form…

Machine Learning · Computer Science 2017-12-05 Zihao Hu , Xiyi Luo , Hongtao Lu , Yong Yu

This paper is devoted to a new modification of a recently proposed adaptive stochastic mirror descent algorithm for constrained convex optimization problems in the case of several convex functional constraints. Algorithms, standard and its…

Optimization and Control · Mathematics 2020-01-22 Mohammad S. Alkousa

We consider the problem of planning with participation constraints introduced in [Zhang et al., 2022]. In this problem, a principal chooses actions in a Markov decision process, resulting in separate utilities for the principal and the…

Computer Science and Game Theory · Computer Science 2022-05-17 Hanrui Zhang , Yu Cheng , Vincent Conitzer

We give sublinear-time approximation algorithms for some optimization problems arising in machine learning, such as training linear classifiers and finding minimum enclosing balls. Our algorithms can be extended to some kernelized versions…

Machine Learning · Computer Science 2010-10-22 Kenneth L. Clarkson , Elad Hazan , David P. Woodruff

A rational approximation by a ratio of polynomial functions is a flexible alternative to polynomial approximation. In particular, rational functions exhibit accurate estimations to nonsmooth and non- Lipschitz functions, where polynomial…

Optimization and Control · Mathematics 2020-02-27 V. Peiris , N. Sharon , N. Sukhorukova J. Ugon

Approximate algorithms for structured prediction problems---such as LP relaxations and the popular alpha-expansion algorithm (Boykov et al. 2001)---typically far exceed their theoretical performance guarantees on real-world instances. These…

Machine Learning · Statistics 2018-04-24 Hunter Lang , David Sontag , Aravindan Vijayaraghavan

In this work, we present a comprehensive framework for approximating the weakly singular power-law kernel $t^{\alpha-1}$ of fractional integral and differential operators, where $\alpha \in (0,1)$ and $t \in [\delta,T]$ with…

Numerical Analysis · Mathematics 2025-08-29 Renu Chaudhary , Kai Diethelm , Afshin Farhadi , Fred A. Fuchs

To enable DNNs on edge devices like mobile phones, low-rank approximation has been widely adopted because of its solid theoretical rationale and efficient implementations. Several previous works attempted to directly approximate a…

Machine Learning · Computer Science 2020-05-01 Yuhui Xu , Yuxi Li , Shuai Zhang , Wei Wen , Botao Wang , Yingyong Qi , Yiran Chen , Weiyao Lin , Hongkai Xiong

Incorporating a non-Euclidean variable metric to first-order algorithms is known to bring enhancement. However, due to the lack of an optimal choice, such an enhancement appears significantly underestimated. In this work, we establish a…

Optimization and Control · Mathematics 2023-11-21 Yifan Ran

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Large language models (LLMs) have transformed the way we think about language understanding and generation, enthralling both researchers and developers. However, deploying LLMs for inference has been a significant challenge due to their…

Machine Learning · Computer Science 2025-01-03 Dibakar Gope , David Mansell , Danny Loh , Ian Bratt

Recht, Fazel, and Parrilo provided an analogy between rank minimization and $\ell_0$-norm minimization. Subject to the rank-restricted isometry property, nuclear norm minimization is a guaranteed algorithm for rank minimization. The…

Numerical Analysis · Mathematics 2009-05-01 Kiryung Lee , Yoram Bresler

In data exploration, executing complex non-aggregate queries over large databases can be time-consuming. Our paper introduces a novel approach to address this challenge, focusing on finding an optimized subset of data, referred to as the…

Databases · Computer Science 2024-01-31 Susan B. Davidson , Tova Milo , Kathy Razmadze , Gal Zeevi

This paper aims at the algorithmic/theoretical core of reinforcement learning (RL) by introducing the novel class of proximal Bellman mappings. These mappings are defined in reproducing kernel Hilbert spaces (RKHSs), to benefit from the…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Yuki Akiyama , Konstantinos Slavakis

In the past decade, many parameterized algorithms were developed for packing problems. Our goal is to obtain tradeoffs that improve the running times of these algorithms at the cost of computing approximate solutions. Consider a packing…

Data Structures and Algorithms · Computer Science 2015-05-05 Meirav Zehavi

Clustering is a long-standing research problem and a fundamental tool in AI and data analysis. The traditional k-center problem, a fundamental theoretical challenge in clustering, has a best possible approximation ratio of 2, and any…

Machine Learning · Computer Science 2026-04-28 Chaoqi Jia , Longkun Guo , Kewen Liao , Zhigang Lu , Chao Chen , Jason Xue

Parametric optimization solves a family of optimization problems as a function of parameters. It is a critical component in situations where optimal decision making is repeatedly performed for updated parameter values, but computation…

Optimization and Control · Mathematics 2023-08-22 Hyunglip Bae , Jang Ho Kim , Woo Chang Kim

In this work we discuss the problem of selecting suitable approximators from families of parameterized elementary functions that are known to be dense in a Hilbert space of functions. We consider and analyze published procedures, both…

Numerical Analysis · Computer Science 2016-09-01 Alexander N. Gorban , Ivan Yu. Tyukin , Danil V. Prokhorov , Konstantin I. Sofeikov

Fair resource allocation is a fundamental optimization problem with applications in operations research, networking, and economic and game theory. Research in these areas has led to the general acceptance of a class of $\alpha$-fair utility…

Data Structures and Algorithms · Computer Science 2020-11-17 Jelena Diakonikolas , Maryam Fazel , Lorenzo Orecchia

Building on the blueprint from Goemans and Williamson (1995) for the Max-Cut problem, we construct a polynomial-time approximation algorithm for orthogonally constrained quadratic optimization problems. First, we derive a semidefinite…

Optimization and Control · Mathematics 2026-03-17 Ryan Cory-Wright , Jean Pauphilet