English
Related papers

Related papers: Optimizing Rank-based Metrics with Blackbox Differ…

200 papers

Benchmarks are a useful tool for empirical performance comparisons. However, one of the main shortcomings of existing benchmarks is that it remains largely unclear how they relate to real-world problems. What does an algorithm's performance…

Neural and Evolutionary Computing · Computer Science 2020-04-15 Koen van der Blom , Timo M. Deist , Tea Tušar , Mariapia Marchi , Yusuke Nojima , Akira Oyama , Vanessa Volz , Boris Naujoks

Most of object detection algorithms can be categorized into two classes: two-stage detectors and one-stage detectors. Recently, many efforts have been devoted to one-stage detectors for the simple yet effective architecture. Different from…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Qi Qian , Lei Chen , Hao Li , Rong Jin

This paper introduces ROI-Packing, an efficient image compression method tailored specifically for machine vision. By prioritizing regions of interest (ROI) critical to end-task accuracy and packing them efficiently while discarding less…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Md Eimran Hossain Eimon , Alena Krause , Ashan Perera , Juan Merlos , Hari Kalva , Velibor Adzic , Borko Furht

Classification tasks are usually evaluated in terms of accuracy. However, accuracy is discontinuous and cannot be directly optimized using gradient ascent. Popular methods minimize cross-entropy, hinge loss, or other surrogate losses, which…

Machine Learning · Computer Science 2024-07-25 Ivan Karpukhin , Stanislav Dereka , Sergey Kolesnikov

In this paper, we explore and evaluate the use of ranking-based objective functions for learning simultaneously a word string and a word image encoder. We consider retrieval frameworks in which the user expects a retrieval list ranked…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Pau Riba , Adrià Molina , Lluis Gomez , Oriol Ramos-Terrades , Josep Lladós

Monitoring machine learning systems post deployment is critical to ensure the reliability of the systems. Particularly importance is the problem of monitoring the performance of machine learning systems across all the data subgroups…

Machine Learning · Computer Science 2022-12-19 Huong Ha

Offline model-based optimization (MBO) aims to identify a design that maximizes a black-box function using only a fixed, pre-collected dataset of designs and their corresponding scores. A common approach in offline MBO is to train a…

Machine Learning · Computer Science 2025-05-05 Rong-Xi Tan , Ke Xue , Shen-Huan Lyu , Haopu Shang , Yao Wang , Yaoyuan Wang , Sheng Fu , Chao Qian

Non-convex gradient descent is a common approach for estimating a low-rank $n\times n$ ground truth matrix from noisy measurements, because it has per-iteration costs as low as $O(n)$ time, and is in theory capable of converging to a…

Optimization and Control · Mathematics 2024-02-29 Gavin Zhang , Hong-Ming Chiu , Richard Y. Zhang

Current differentiable renderers provide light transport gradients with respect to arbitrary scene parameters. However, the mere existence of these gradients does not guarantee useful update steps in an optimization. Instead, inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Michael Fischer , Tobias Ritschel

In this paper, a reduced-rank scheme with joint iterative optimization is presented for direction of arrival estimation. A rank-reduction matrix and an auxiliary reduced-rank parameter vector are jointly optimized to calculate the output…

Data Structures and Algorithms · Computer Science 2016-11-17 L. Wang , R. C. de Lamare , M. Haardt

We propose a new framework for black-box convex optimization which is well-suited for situations where gradient computations are expensive. We derive a new method for this framework which leverages several concepts from convex optimization,…

Optimization and Control · Mathematics 2016-02-17 Sébastien Bubeck , Yin-Tat Lee

Affine rank minimization algorithms typically rely on calculating the gradient of a data error followed by a singular value decomposition at every iteration. Because these two steps are expensive, heuristic approximations are often used to…

Optimization and Control · Mathematics 2013-06-04 Stephen Becker , Volkan Cevher , Anastasios Kyrillidis

This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition…

Numerical Analysis · Mathematics 2020-08-12 Rishi Advani , Madison Crim , Sean O'Hagan

Much research work in computer vision is being spent on optimizing existing network architectures to obtain a few more percentage points on benchmarks. Recent AutoML approaches promise to relieve us from this effort. However, they are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Tonmoy Saikia , Yassine Marrakchi , Arber Zela , Frank Hutter , Thomas Brox

We consider robust discrete minimization problems where uncertainty is defined by a convex set in the objective. We show how an integrality gap verifier for the linear programming relaxation of the non-robust version of the problem can be…

Data Structures and Algorithms · Computer Science 2019-07-17 Khaled Elbassioni

Sparse reduced rank regression is an essential statistical learning method. In the contemporary literature, estimation is typically formulated as a nonconvex optimization that often yields to a local optimum in numerical computation. Yet,…

Methodology · Statistics 2022-12-06 Canhong Wen , Ruipeng Dong , Xueqin Wang , Weiyu Li , Heping Zhang

Despite the recent development in machine learning, most learning systems are still under the concept of "black box", where the performance cannot be understood and derived. With the rise of safety and privacy concerns in public, designing…

Machine Learning · Computer Science 2023-06-30 Shuai Zhang

Learning-to-rank has been intensively studied and has shown significantly increasing values in a wide range of domains. The performance of learning-to-rank methods is commonly evaluated using rank-sensitive metrics, such as average…

Information Retrieval · Computer Science 2020-09-01 Hai-Tao Yu

The paper presents a simple and effective learning-based method for computing a discriminative 3D point cloud descriptor for place recognition purposes. Recent state-of-the-art methods have relatively complex architectures such as…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Jacek Komorowski

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

Machine Learning · Computer Science 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi