English
Related papers

Related papers: Ranked from Within: Ranking Large Multimodal Model…

200 papers

Large language models (LLMs) frequently achieve impressive scores on standardized benchmarks, yet accuracy alone offers a limited view of their capabilities. Evaluating open-source LLMs through leaderboards faces persistent issues like data…

Benchmarks have emerged as the central approach for evaluating Large Language Models (LLMs). The research community often relies on a model's average performance across the test prompts of a benchmark to evaluate the model's performance.…

Computation and Language · Computer Science 2024-06-07 Melissa Ailem , Katerina Marazopoulou , Charlotte Siska , James Bono

Reward models (RMs) guide the alignment of large language models (LLMs), steering them toward behaviors preferred by humans. Evaluating RMs is the key to better aligning LLMs. However, the current evaluation of RMs may not directly…

Computation and Language · Computer Science 2025-04-07 Enyu Zhou , Guodong Zheng , Binghai Wang , Zhiheng Xi , Shihan Dou , Rong Bao , Wei Shen , Limao Xiong , Jessica Fan , Yurong Mou , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Many popular linear classifiers, such as logistic regression, boosting, or SVM, are trained by optimizing a margin-based risk function. Traditionally, these risk functions are computed based on a labeled dataset. We develop a novel…

Machine Learning · Computer Science 2010-07-23 Krishnakumar Balasubramanian , Pinar Donmez , Guy Lebanon

Grammar competency estimation is essential for assessing linguistic proficiency in both written and spoken language; however, the spoken modality presents additional challenges due to its spontaneous, unstructured, and disfluent nature.…

Computation and Language · Computer Science 2025-11-18 Sourya Dipta Das , Shubham Kumar , Kuldeep Yadav

We introduce LLaVA-Critic, the first open-source large multimodal model (LMM) designed as a generalist evaluator to assess performance across a wide range of multimodal tasks. LLaVA-Critic is trained using a high-quality critic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Tianyi Xiong , Xiyao Wang , Dong Guo , Qinghao Ye , Haoqi Fan , Quanquan Gu , Heng Huang , Chunyuan Li

Large Multimodal Models (LMMs) are increasingly applied to scientific research, yet it remains unclear whether they can reliably understand and reason over the multimodal complexity of papers. A central challenge lies in detecting and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Lukas Selch , Yufang Hou , M. Jehanzeb Mirza , Sivan Doveh , James Glass , Rogerio Feris , Wei Lin

Current techniques for post-training Large Language Models (LLMs) rely either on costly human supervision or on external verifiers to boost performance on tasks such as mathematical reasoning and code generation. However, as LLMs improve…

Computation and Language · Computer Science 2026-01-21 Mukesh Ghimire , Aosong Feng , Liwen You , Youzhi Luo , Fang Liu , Xuan Zhu

In this work, we present a systematic and comprehensive empirical evaluation of state-of-the-art reranking methods, encompassing large language model (LLM)-based, lightweight contextual, and zero-shot approaches, with respect to their…

Computation and Language · Computer Science 2025-08-26 Abdelrahman Abdallah , Bhawna Piryani , Jamshid Mozafari , Mohammed Ali , Adam Jatowt

Training Learning-to-Rank models for e-commerce product search ranking can be challenging due to the lack of a gold standard of ranking relevance. In this paper, we decompose ranking relevance into content-based and engagement-based…

Information Retrieval · Computer Science 2024-09-27 Qi Liu , Atul Singh , Jingbo Liu , Cun Mu , Zheng Yan

One of the ways to make artificial intelligence more natural is to give it some room for doubt. Two main questions should be resolved in that way. First, how to train a model to estimate uncertainties of its own predictions? And then, what…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Alexey Kornaev , Elena Kornaeva , Oleg Ivanov , Ilya Pershin , Danis Alukaev

Vision-Language Models (VLMs) have demonstrated remarkable generalization capabilities across a wide range of tasks. However, their performance often remains suboptimal when directly applied to specific downstream scenarios without…

Machine Learning · Computer Science 2025-08-08 Hao Dong , Lijun Sheng , Jian Liang , Ran He , Eleni Chatzi , Olga Fink

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Large Language Models (LLMs) are increasingly used for recommendation tasks due to their general-purpose capabilities. While LLMs perform well in rich-context settings, their behavior in cold-start scenarios, where only limited signals such…

Information Retrieval · Computer Science 2025-09-09 Alexandre Andre , Gauthier Roy , Eva Dyer , Kai Wang

This paper presents several novel findings on the explainability of vision reflection in large multimodal models (LMMs). First, we show that prompting an LMM to verify the prediction of a specialized vision model can improve recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Guoyuan An , JaeYoon Kim , SungEui Yoon

Multi-label classification deals with the problem where each instance is associated with multiple class labels. Because evaluation in multi-label classification is more complicated than single-label setting, a number of performance measures…

Machine Learning · Computer Science 2020-07-07 Xi-Zhu Wu , Zhi-Hua Zhou

Reliable Large Language Models (LLMs) should abstain when confidence is insufficient. However, prior studies often treat refusal as a generic "I don't know'', failing to distinguish input-level ambiguity (data uncertainty) from capability…

Computation and Language · Computer Science 2026-04-21 Jingyi Ren , Ante Wang , Yunghwei Lai , Xiaolong Wang , Linlu Gong , Weitao Li , Weizhi Ma , Yang Liu

Medical Large language models achieve strong scores on standard benchmarks; however, the transfer of those results to safe and reliable performance in clinical workflows remains a challenge. This survey reframes evaluation through a…

Future self-adaptive robots are expected to operate in highly dynamic environments while effectively managing uncertainties. However, identifying the sources and impacts of uncertainties in such robotic systems and defining appropriate…

Robotics · Computer Science 2025-10-13 Hassan Sartaj , Jalil Boudjadar , Mirgita Frasheri , Shaukat Ali , Peter Gorm Larsen

The popular success of text-based large language models (LLM) has streamlined the attention of the multimodal community to combine other modalities like vision and audio along with text to achieve similar multimodal capabilities. In this…

Computation and Language · Computer Science 2025-05-20 Debarpan Bhattacharya , Apoorva Kulkarni , Sriram Ganapathy