English
Related papers

Related papers: SimBA: Simplifying Benchmark Analysis Using Perfor…

200 papers

As large language models (LLMs) continue to advance, the need for up-to-date and well-organized benchmarks becomes increasingly critical. However, many existing datasets are scattered, difficult to manage, and make it challenging to perform…

Machine Learning · Computer Science 2025-06-03 Eunsu Kim , Haneul Yoo , Guijin Son , Hitesh Patel , Amit Agarwal , Alice Oh

Answering reasoning-based complex questions over text and hybrid sources, including tables, is a challenging task. Recent advances in large language models (LLMs) have enabled in-context learning (ICL), allowing LLMs to acquire proficiency…

Efficient benchmarking techniques aim to lower the computational cost of evaluating LLMs by predicting full benchmark scores using only a subset of a benchmark's questions. By reframing this problem as an instance of multiple regression…

Machine Learning · Statistics 2026-05-26 Sam Bowyer , Acyr Locatelli , Kris Cao

Large language models (LLMs) often appear to excel on public benchmarks, but these high scores may mask an overreliance on dataset-specific surface cues rather than true language understanding. We introduce the Chameleon Benchmark Overfit…

Computation and Language · Computer Science 2025-09-18 Nurit Cohen-Inger , Yehonatan Elisha , Bracha Shapira , Lior Rokach , Seffi Cohen

Efficiently modeling sequences with infinite context length has long been a challenging problem. Previous approaches have either suffered from quadratic computational complexity or limited extrapolation ability in length generalization. In…

Computation and Language · Computer Science 2025-03-03 Liliang Ren , Yang Liu , Yadong Lu , Yelong Shen , Chen Liang , Weizhu Chen

Prior studies have demonstrated that approaches to generate an answer summary for a given technical query in Software Question and Answer (SQA) sites are desired. We find that existing approaches are assessed solely through user studies.…

Software Engineering · Computer Science 2022-09-23 Yang Chengran , Bowen Xu , Ferdian Thung , Yucen Shi , Ting Zhang , Zhou Yang , Xin Zhou , Jieke Shi , Junda He , DongGyun Han , David Lo

While many neuroscience questions aim to understand the human brain, much current knowledge has been gained using animal models, which replicate genetic, structural, and connectivity aspects of the human brain. While voxel-based analysis…

Current evaluations of large language models (LLMs) rely on benchmark scores, but it is difficult to interpret what these individual scores reveal about a model's overall skills. Specifically, as a community we lack understanding of how…

Computation and Language · Computer Science 2025-07-29 Aviya Maimon , Amir DN Cohen , Gal Vishne , Shauli Ravfogel , Reut Tsarfaty

Smartphone agents are increasingly important for helping users control devices efficiently, with (Multimodal) Large Language Model (MLLM)-based approaches emerging as key contenders. Fairly comparing these agents is essential but…

In the current machine learning landscape, we face a "model lake" phenomenon: Given a task, there is a proliferation of trained models with similar performances despite different behavior. For model users attempting to navigate and select…

Machine Learning · Computer Science 2025-07-04 Shravan Doda , Shashidhar Reddy Javaji , Zining Zhu

In the competitive landscape of sponsored search, balancing retrieval quality with production latency is a critical challenge. While large retrieval models based on Small Language Models (SLMs) such as Qwen3-Embedding-4B/8B set strong upper…

Information Retrieval · Computer Science 2026-05-25 Vipul Gupta , Shikhar Mohan , Lakshya Kumar , Pranjal Chitale , Nikit Begwani , Amit Singh , Manik Varma

The rapid evolution of large language models (LLMs) has transformed conversational agents, enabling complex human-machine interactions. However, evaluation frameworks often focus on single tasks, failing to capture the dynamic nature of…

Computation and Language · Computer Science 2025-02-10 Pietro Alessandro Aluffi , Patrick Zietkiewicz , Marya Bazzi , Matt Arderne , Vladimirs Murevics

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

Computation and Language · Computer Science 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

Automatic test generation plays a critical role in software quality assurance. While the recent advances in Search-Based Software Testing (SBST) and Large Language Models (LLMs) have shown promise in generating useful tests, these…

Software Engineering · Computer Science 2025-07-16 Chen Yang , Junjie Chen , Bin Lin , Ziqi Wang , Jianyi Zhou

Reasoning is an essential capacity for large language models (LLMs) to address complex tasks, where the identification of process errors is vital for improving this ability. Recently, process-level reward models (PRMs) were proposed to…

Artificial Intelligence · Computer Science 2025-03-18 Zhaopan Xu , Pengfei Zhou , Jiaxin Ai , Wangbo Zhao , Kai Wang , Xiaojiang Peng , Wenqi Shao , Hongxun Yao , Kaipeng Zhang

Training automatic summary fact verifiers often faces the challenge of a lack of human-labeled data. In this paper, we explore alternative way of leveraging Large Language Model (LLM) generated feedback to address the inherent limitation of…

Computation and Language · Computer Science 2024-12-17 Jihwan Oh , Jeonghwan Choi , Nicole Hee-Yeon Kim , Taewon Yun , Hwanjun Song

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal…

Machine Learning · Computer Science 2025-05-12 Ruxue Shi , Hengrui Gu , Xu Shen , Xin Wang

Tackling complex optimization problems often relies on expert-designed heuristics, typically crafted through extensive trial and error. Recent advances demonstrate that large language models (LLMs), when integrated into well-designed…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Ziyao Huang , Weiwei Wu , Kui Wu , Jianping Wang , Wei-Bin Lee

This paper presents a novel approach to represent enterprise web application structures using Large Language Models (LLMs) to enable intelligent quality engineering at scale. We introduce a hierarchical representation methodology that…

Artificial Intelligence · Computer Science 2025-01-14 Zaber Al Hassan Ayon , Gulam Husain , Roshankumar Bisoi , Waliur Rahman , Dr Tom Osborn

In this work, we address the challenge of multilingual category relevance judgment in e-commerce search, where traditional ensemble-based systems improve accuracy but at the cost of heavy training, inference, and maintenance complexity. To…

Information Retrieval · Computer Science 2026-01-12 Haotao Xie , Ruilin Chen , Yicheng Wu , Zhan Zhao , Yuanyuan Liu