English
Related papers

Related papers: Beyond Logit Adjustment: A Residual Decomposition …

200 papers

Learning-to-rank techniques have proven to be extremely useful for prioritization problems, where we rank items in order of their estimated probabilities, and dedicate our limited resources to the top-ranked items. This work exposes a…

Machine Learning · Statistics 2018-02-22 Cynthia Rudin , Yining Wang

We present a natural generalization of the recent low rank + sparse matrix decomposition and consider the decomposition of matrices into components of multiple scales. Such decomposition is well motivated in practice as data matrices often…

Systems and Control · Computer Science 2016-08-04 Frank Ong , Michael Lustig

In this work, we introduce a novel strategy for long-tail recognition that addresses the tail classes' few-shot problem via training-free knowledge transfer. Our objective is to transfer knowledge acquired from information-rich common…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sarah Parisot , Pedro M. Esperanca , Steven McDonagh , Tamas J. Madarasz , Yongxin Yang , Zhenguo Li

Long-horizon execution in Large Language Models (LLMs) remains unstable even when high-level strategies are provided. Evaluating on controlled algorithmic puzzles, we demonstrate that while decomposition is essential for stability, extreme…

Artificial Intelligence · Computer Science 2026-04-23 Denys Pushkin , Emmanuel Abbe

Multimodal Large Language Models (MLLMs) have shown strong performance in multi-image cross-modal retrieval, yet suffer from severe position bias, where predictions are dominated by input order rather than semantic relevance. Through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Mingtao Xian , Yifeng Yang , Qinying Gu , Xinbing Wang , Nanyang Ye

Reranking methods in machine translation aim to close the gap between common evaluation metrics (e.g. BLEU) and maximum likelihood learning and decoding algorithms. Prior works address this challenge by training models to rerank beam search…

Computation and Language · Computer Science 2022-12-20 Lior Vassertail , Omer Levy

In predictive tasks, real-world datasets often present different degrees of imbalanced (i.e., long-tailed or skewed) distributions. While the majority (the head) classes have sufficient samples, the minority (the tail) classes can be…

Machine Learning · Computer Science 2021-09-14 Chongsheng Zhang , Paolo Soda , Jingjun Bi , Gaojuan Fan , George Almpanidis , Salvador Garcia

Multi-relational learning has received lots of attention from researchers in various research communities. Most existing methods either suffer from superlinear per-iteration cost, or are sensitive to the given ranks. To address both issues,…

Machine Learning · Computer Science 2016-01-19 Fanhua Shang , James Cheng , Hong Cheng

The problem of bipartite ranking, where instances are labeled positive or negative and the goal is to learn a scoring function that minimizes the probability of mis-ranking a pair of positive and negative instances (or equivalently, that…

Machine Learning · Computer Science 2014-08-13 Shivani Agarwal

Natural data are often long-tail distributed over semantic classes. Existing recognition methods tackle this imbalanced classification by placing more emphasis on the tail data, through class re-balancing/re-weighting or ensembling over…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xudong Wang , Long Lian , Zhongqi Miao , Ziwei Liu , Stella X. Yu

We focus on the real-world problem of training accurate deep models for image classification of a small number of rare categories. In these scenarios, almost all images belong to the background category in the dataset (>95% of the dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Ravi Teja Mullapudi , Fait Poms , William R. Mark , Deva Ramanan , Kayvon Fatahalian

The imbalanced distribution of long-tailed data presents a considerable challenge for deep learning models, as it causes them to prioritize the accurate classification of head classes but largely disregard tail classes. The biased decision…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Mengke Li , Zhikai Hu , Yang Lu , Weichao Lan , Yiu-ming Cheung , Hui Huang

In this paper we consider general rank minimization problems with rank appearing in either objective function or constraint. We first establish that a class of special rank minimization problems has closed-form solutions. Using this result,…

Optimization and Control · Mathematics 2012-05-30 Zhaosong Lu , Yong Zhang

The dominant paradigm in image retrieval systems today is to search large databases using global image features, and re-rank those initial results with local image feature matching techniques. This design, dubbed global-to-local, stems from…

Information Retrieval · Computer Science 2025-09-08 Dror Aiger , Bingyi Cao , Kaifeng Chen , Andre Araujo

Despite the widespread use of LLMs due to their superior performance in various tasks, their high computational costs often lead potential users to opt for the pretraining-finetuning pipeline. However, biases prevalent in manually…

Computation and Language · Computer Science 2024-12-20 Shuo Yang , Bardh Prenkaj , Gjergji Kasneci

The fine-tuning paradigm in addressing long-tail learning tasks has sparked significant interest since the emergence of foundation models. Nonetheless, how fine-tuning impacts performance in long-tail learning was not explicitly quantified.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jiang-Xin Shi , Tong Wei , Zhi Zhou , Jie-Jing Shao , Xin-Yan Han , Yu-Feng Li

Clinicians need ranking systems that work in real time and still justify their choices. Motivated by the need for a low-latency, decoder-based reranker, we present OG-Rank, a single-decoder approach that pairs a pooled first-token scoring…

Artificial Intelligence · Computer Science 2025-10-21 Praphul Singh , Corey Barrett , Sumana Srivasta , Irfan Bulu , Sri Gadde , Krishnaram Kenthapadi

Real-world data often follows a long-tailed distribution, which makes the performance of existing classification algorithms degrade heavily. A key issue is that samples in tail categories fail to depict their intra-class diversity. Humans…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Xiaohua Chen , Yucan Zhou , Dayan Wu , Wanqian Zhang , Yu Zhou , Bo Li , Weiping Wang

Visual place recognition is a critical task in computer vision, especially for localization and navigation systems. Existing methods often rely on contrastive learning: image descriptors are trained to have small distance for similar images…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 María Leyva-Vallina , Nicola Strisciuglio , Nicolai Petkov

In learning-to-rank (LTR), optimizing only the relevance (or the expected ranking utility) can cause representational harm to certain categories of items. Moreover, if there is implicit bias in the relevance scores, LTR models may fail to…

Machine Learning · Computer Science 2023-08-28 Sruthi Gorantla , Eshaan Bhansali , Amit Deshpande , Anand Louis