English
Related papers

Related papers: Joint Upper & Lower Bound Normalization for IR Eva…

200 papers

Recent advances show that two-dimensional linear discriminant analysis (2DLDA) is a successful matrix based dimensionality reduction method. However, 2DLDA may encounter the singularity issue theoretically and the sensitivity to outliers.…

Machine Learning · Computer Science 2018-10-26 Chun-Na Li , Yuan-Hai Shao , Wei-Jie Chen , Zhen Wang , Nai-Yang Deng

Incorporating a non-Euclidean variable metric to first-order algorithms is known to bring enhancement. However, due to the lack of an optimal choice, such an enhancement appears significantly underestimated. In this work, we establish a…

Optimization and Control · Mathematics 2023-11-21 Yifan Ran

Generating unbiased summaries in real-world settings such as political perspective summarization remains a crucial application of Large Language Models (LLMs). Yet, existing evaluation frameworks rely on traditional metrics for measuring…

Computation and Language · Computer Science 2025-06-23 Narutatsu Ri , Nicholas Deas , Kathleen McKeown

Neural networks have recently been proposed for multi-label classification because they are able to capture and model label dependencies in the output layer. In this work, we investigate limitations of BP-MLL, a neural network (NN)…

Machine Learning · Computer Science 2020-12-09 Jinseok Nam , Jungi Kim , Eneldo Loza Mencía , Iryna Gurevych , Johannes Fürnkranz

Neural Information Retrieval models hold the promise to replace lexical matching models, e.g. BM25, in modern search engines. While their capabilities have fully shone on in-domain datasets like MS MARCO, they have recently been challenged…

Information Retrieval · Computer Science 2021-12-14 Thibault Formal , Benjamin Piwowarski , Stéphane Clinchant

Large language models (LLMs) are increasingly used as automated judges and synthetic labelers, especially in low-label settings. Yet these systems are stochastic and often overconfident, which makes deployment decisions difficult when…

Machine Learning · Computer Science 2026-03-19 Maxim Khomiakov , Jes Frellsen

With the rapid development of Large Language Models (LLMs), recent studies employed LLMs as recommenders to provide personalized information services for distinct users. Despite efforts to improve the accuracy of LLM-based recommendation…

Information Retrieval · Computer Science 2024-11-04 Chumeng Jiang , Jiayin Wang , Weizhi Ma , Charles L. A. Clarke , Shuai Wang , Chuhan Wu , Min Zhang

Large Language Models (LLMs) are increasingly being adopted as tools for learning; however, most tools remain text-only, limiting their usefulness for domains where visualizations are essential, such as mathematics. Recent work shows that…

Artificial Intelligence · Computer Science 2025-11-12 Vishal Kumar , Shubhra Mishra , Rebecca Hao , Rizwaan Malik , David Broman , Dorottya Demszky

In this work, we propose norm-bounded low-rank adaptation (NB-LoRA) for parameter-efficient fine tuning. NB-LoRA is a novel parameterization of low-rank weight adaptations that admits explicit bounds on each singular value of the adaptation…

Machine Learning · Computer Science 2025-09-30 Ruigang Wang , Krishnamurthy Dvijotham , Ian R. Manchester

This study aims to optimize the evaluation metric of multimodal multi-objective optimization problems using a Regionalized Metric Framework, which provides a certain boost to research in this field. Existing evaluation metrics usually use…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Jintai Chen , Fangqing Liu , Xueming Yan , Han Huang

In this paper, we develop a relative error bound for nuclear norm regularized matrix completion, with the focus on the completion of full-rank matrices. Under the assumption that the top eigenspaces of the target matrix are incoherent, we…

Machine Learning · Computer Science 2024-05-30 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

We establish some new non-asymptotical lower bounds for deviation of regular unbiased estimation of unknown parameter from its true value in different norms, alike the classical Rao-Kramer's inequality. We show that if the new norm is…

Statistics Theory · Mathematics 2014-07-17 E. Ostrovsky , L. Sirota

Many Artificial Intelligence tasks cannot be evaluated with a single quality criterion and some sort of weighted combination is needed to provide system rankings. A problem of weighted combination measures is that slight changes in the…

Artificial Intelligence · Computer Science 2014-01-21 Enrique Amigó , Julio Gonzalo , Javier Artiles , Felisa Verdejo

In NLG meta-evaluation, evaluation metrics are typically assessed based on their consistency with humans. However, we identify some limitations in traditional NLG meta-evaluation approaches, such as issues in handling human ratings and…

Computation and Language · Computer Science 2025-08-18 Xinyu Hu , Mingqi Gao , Li Lin , Zhenghan Yu , Xiaojun Wan

Neural information retrieval (IR) systems have progressed rapidly in recent years, in large part due to the release of publicly available benchmarking tasks. Unfortunately, some dimensions of this progress are illusory: the majority of the…

People frequently interact with information retrieval (IR) systems, however, IR models exhibit biases and discrimination towards various demographics. The in-processing fair ranking methods provide a trade-offs between accuracy and fairness…

Information Retrieval · Computer Science 2022-05-20 Yuantong Li , Xiaokai Wei , Zijian Wang , Shen Wang , Parminder Bhatia , Xiaofei Ma , Andrew Arnold

MAP inference for general energy functions remains a challenging problem. While most efforts are channeled towards improving the linear programming (LP) based relaxation, this work is motivated by the quadratic programming (QP) relaxation.…

Machine Learning · Computer Science 2012-06-22 Patrick Pletscher , Sharon Wulff

Several new estimation methods have been recently proposed for the linear regression model with observation error in the design. Different assumptions on the data generating process have motivated different estimators and analysis. In…

Statistics Theory · Mathematics 2014-12-24 Alexandre Belloni , Mathieu Rosenbaum , Alexandre B. Tsybakov

A spatially regularized Gaussian mixture model, LapGM, is proposed for the bias field correction and magnetic resonance normalization problem. The proposed spatial regularizer gives practitioners fine-tuned control between balancing bias…

Medical Physics · Physics 2022-09-29 Luciano Vinas , Arash A. Amini , Jade Fischer , Atchar Sudhyadhom

Low-rank inducing unitarily invariant norms have been introduced to convexify problems with low-rank/sparsity constraint. They are the convex envelope of a unitary invariant norm and the indicator function of an upper bounding rank…

Optimization and Control · Mathematics 2022-02-17 Christian Grussler , Pontus Giselsson