English
Related papers

Related papers: Optimizing Rank-based Metrics with Blackbox Differ…

200 papers

This paper considers a large class of problems where we seek to recover a low rank matrix and/or sparse vector from some set of measurements. While methods based on convex relaxations suffer from a (possibly large) estimator bias, and other…

Machine Learning · Statistics 2021-09-28 April Sagan , John E. Mitchell

Performance disparities of image recognition across demographic groups are known to exist in deep learning-based models, due to imbalanced group representations or spurious correlation between group and target labels. Previous work has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Miao Zhang , Rumi Chunara

Community detection is one of the fundamental problems of network analysis, for which a number of methods have been proposed. Most model-based or criteria-based methods have to solve an optimization problem over a discrete set of labels to…

Machine Learning · Statistics 2015-05-12 Can M. Le , Elizaveta Levina , Roman Vershynin

To alleviate the cost of obtaining accurate bounding boxes for training today's state-of-the-art object detection models, recent weakly supervised detection work has proposed techniques to learn from image-level labels. However, requiring…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Keren Ye , Mingda Zhang , Wei Li , Danfeng Qin , Adriana Kovashka , Jesse Berent

The matrix rank minimization problem has applications in many fields such as system identification, optimal control, low-dimensional embedding, etc. As this problem is NP-hard in general, its convex relaxation, the nuclear norm minimization…

Optimization and Control · Mathematics 2011-01-04 Donald Goldfarb , Shiqian Ma

Rank minimization is of interest in machine learning applications such as recommender systems and robust principal component analysis. Minimizing the convex relaxation to the rank minimization problem, the nuclear norm, is an effective…

Optimization and Control · Mathematics 2021-03-30 April Sagan , John E. Mitchell

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

Statistics Theory · Mathematics 2024-03-06 Xin Li , Dongya Wu

Robust low-rank matrix estimation is a topic of increasing interest, with promising applications in a variety of fields, from computer vision to data mining and recommender systems. Recent theoretical results establish the ability of such…

Information Theory · Computer Science 2011-09-29 Ignacio Ramírez , Guillermo Sapiro

Low-rank modeling generally refers to a class of methods that solve problems by representing variables of interest as low-rank matrices. It has achieved great success in various fields including computer vision, data mining, signal…

Computer Vision and Pattern Recognition · Computer Science 2014-10-24 Xiaowei Zhou , Can Yang , Hongyu Zhao , Weichuan Yu

Black-box optimization is primarily important for many compute-intensive applications, including reinforcement learning (RL), robot control, etc. This paper presents a novel theoretical framework for black-box optimization, in which our…

Machine Learning · Computer Science 2020-09-10 Yueming Lyu , Ivor W. Tsang

We consider learning to optimize a classification metric defined by a black-box function of the confusion matrix. Such black-box learning settings are ubiquitous, for example, when the learner only has query access to the metric of…

Machine Learning · Computer Science 2021-06-25 Gaurush Hiranandani , Jatin Mathur , Harikrishna Narasimhan , Mahdi Milani Fard , Oluwasanmi Koyejo

Direct optimization of IR metrics has often been adopted as an approach to devise and develop ranking-based recommender systems. Most methods following this approach aim at optimizing the same metric being used for evaluation, under the…

Information Retrieval · Computer Science 2021-06-07 Roger Zhe Li , Julián Urbano , Alan Hanjalic

In this work, we study different approaches to self-supervised pretraining of object detection models. We first design a general framework to learn a spatially consistent dense representation from an image, by randomly sampling and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Trung Dang , Simon Kornblith , Huy Thong Nguyen , Peter Chin , Maryam Khademi

Standard approaches to stochastic gradient estimation, with only noisy black-box function evaluations, use the finite-difference method or its variants. While natural, it is open to our knowledge whether their statistical accuracy is the…

Statistics Theory · Mathematics 2020-11-13 Henry Lam , Haidong Li , Xuhui Zhang

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde

In this paper, we propose a novel approach to the rank minimization problem, termed rank residual constraint (RRC) model. Different from existing low-rank based approaches, such as the well-known nuclear norm minimization (NNM) and the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Zhiyuan Zha , Xin Yuan , Bihan Wen , Jiantao Zhou , Jiachao Zhang , Ce Zhu

Extraction of local feature descriptors is a vital stage in the solution pipelines for numerous computer vision tasks. Learning-based approaches improve performance in certain tasks, but still cannot replace handcrafted features in general.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-19 Kun He , Yan Lu , Stan Sclaroff

In this note, we investigate how well we can reconstruct the best rank-$r$ approximation of a large matrix from a small number of its entries. We show that even if a data matrix is of full rank and cannot be approximated well by a low-rank…

Methodology · Statistics 2021-11-12 Shun Xu , Ming Yuan

Object counting is an important task in computer vision due to its growing demand in applications such as surveillance, traffic monitoring, and counting everyday objects. State-of-the-art methods use regression-based optimization where they…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Issam H. Laradji , Negar Rostamzadeh , Pedro O. Pinheiro , David Vazquez , Mark Schmidt

Visual place recognition is a critical task in computer vision, especially for localization and navigation systems. Existing methods often rely on contrastive learning: image descriptors are trained to have small distance for similar images…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 María Leyva-Vallina , Nicola Strisciuglio , Nicolai Petkov