English
Related papers

Related papers: Elliot: a Comprehensive and Rigorous Framework for…

200 papers

Evaluation is pivotal for refining Large Language Models (LLMs), pinpointing their capabilities, and guiding enhancements. The rapid development of LLMs calls for a lightweight and easy-to-use framework for swift evaluation deployment.…

Computation and Language · Computer Science 2024-07-23 Chaoqun He , Renjie Luo , Shengding Hu , Yuanqian Zhao , Jie Zhou , Hanghao Wu , Jiajie Zhang , Xu Han , Zhiyuan Liu , Maosong Sun

Progress in Prognostics and Health Management (PHM) is hindered by the lack of standardized and reusable evaluation practices across tasks, datasets, and application domains. Reported results are often difficult to reproduce and compare, as…

Artificial Intelligence · Computer Science 2026-05-28 Lev Telyatnikov , Raffael Theiler , Leandro Von Krannichfeldt , Olga Fink

This survey paper provides a comprehensive analysis of big data algorithms in recommendation systems, addressing the lack of depth and precision in existing literature. It proposes a two-pronged approach: a thorough analysis of current…

Information Retrieval · Computer Science 2024-02-07 Kamal Taha , Paul D. Yoo , Aya Taha

Reproducibility is a fundamental requirement for validating scientific claims in computational research. Stochastic computational models are widely used in fields such as systems biology, financial modeling and environmental sciences.…

In recent years, neural networks and other complex models have dominated recommender systems, often setting new benchmarks for state-of-the-art performance. Yet, despite these advancements, award-winning research has demonstrated that…

Information Retrieval · Computer Science 2026-04-20 Pedro R. Pires , Rafael T. Sereicikas , Gregorio F. Azevedo , Tiago A. Almeida

Recommender systems are among the most impactful AI applications, interacting with billions of users every day, guiding them to relevant products, services, or information tailored to their preferences. However, the research and development…

The Extract, Transform, Load (ETL) workflow is fundamental for populating and maintaining data warehouses and other data stores accessed by analysts for downstream tasks. A major shortcoming of modern ETL solutions is the extensive need for…

Software Engineering · Computer Science 2025-08-01 Mattia Di Profio , Mingjun Zhong , Yaji Sripada , Marcel Jaspars

Expert elicitation is an invaluable tool for gaining insights into the degree of clinical knowledge surrounding parameters of interest when designing, or supplementing trial data when analysing, a clinical trial. Elicitation is considered…

Applications · Statistics 2025-08-11 Laura M. Morgan , James M. S. Wason , Kevin J. Wilson , Nina Wilson

Universities serve as a hub for academic collaboration, promoting the exchange of diverse ideas and perspectives among students and faculty through interdisciplinary dialogue. However, as universities expand in size, conventional networking…

Information Retrieval · Computer Science 2025-09-03 Sangeetha N , Harish Thangaraj , Varun Vashisht , Eshaan Joshi , Kanishka Verma , Diya Katariya

Effective methodologies for evaluating recommender systems are critical, so that such systems can be compared in a sound manner. A commonly overlooked aspect of recommender system evaluation is the selection of the data splitting strategy.…

Information Retrieval · Computer Science 2020-07-28 Zaiqiao Meng , Richard McCreadie , Craig Macdonald , Iadh Ounis

Recommender systems play a fundamental role in web applications in filtering massive information and matching user interests. While many efforts have been devoted to developing more effective models in various scenarios, the exploration on…

Machine Learning · Computer Science 2020-08-24 Ninghao Liu , Yong Ge , Li Li , Xia Hu , Rui Chen , Soo-Hyun Choi

In this paper, we propose a pragmatic approach to improve reproducibility of experimental analyses of traffic engineering (TE) algorithms, whose implementation, evaluation and comparison are currently hard to replicate. Our envisioned goal…

Networking and Internet Architecture · Computer Science 2017-10-25 Steven Gay , Pierre Schaus , Stefano Vissicchio

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples. This makes it hard for data-driven RSs to cater to a diverse set of users due to the varying properties…

Information Retrieval · Computer Science 2024-05-03 Kirandeep Kaur , Chirag Shah

Industrial recommendation systems (RS) rely on the multi-stage pipeline to balance effectiveness and efficiency when delivering items from a vast corpus to users. Existing RS benchmark datasets primarily focus on the exposure space, where…

Information Retrieval · Computer Science 2024-10-29 Qi Liu , Kai Zheng , Rui Huang , Wuchao Li , Kuo Cai , Yuan Chai , Yanan Niu , Yiqun Hui , Bing Han , Na Mou , Hongning Wang , Wentian Bao , Yunen Yu , Guorui Zhou , Han Li , Yang Song , Defu Lian , Kun Gai

Expert-level scientific reasoning remains challenging for large language models, particularly on benchmarks such as Humanity's Last Exam (HLE), where rigid tool pipelines, brittle multi-agent coordination, and inefficient test-time scaling…

Artificial Intelligence · Computer Science 2026-02-05 Zhentao Tang , Yuqi Cui , Shixiong Kai , Wenqian Zhao , Ke Ye , Xing Li , Anxin Tian , Zehua Pei , Hui-Ling Zhen , Shoubo Hu , Xiaoguang Li , Yunhe Wang , Mingxuan Yuan

Online recommender systems (RS) aim to match user needs with the vast amount of resources available on various platforms. A key challenge is to model user preferences accurately under the condition of data sparsity. To address this…

Information Retrieval · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Jian Pei , Daxin Jiang

The inverse-free extreme learning machine (ELM) algorithm proposed in [4] was based on an inverse-free algorithm to compute the regularized pseudo-inverse, which was deduced from an inverse-free recursive algorithm to update the inverse of…

Machine Learning · Computer Science 2019-11-13 Hufei Zhu , Chenghao Wei

Recommender systems are a vital tool that helps us to overcome the information overload problem. They are being used by most e-commerce web sites and attract the interest of a broad scientific community. A recommender system uses data on…

Information Retrieval · Computer Science 2017-02-22 Fei Yu , An Zeng , Sebastien Gillard , Matus Medo

Collaborative filtering is an important technique for recommendation. Whereas it has been repeatedly shown to be effective in previous work, its performance remains unsatisfactory in many real-world applications, especially those where the…

Information Retrieval · Computer Science 2018-08-15 Zhiyu Min , Dahua Lin

Literature recommendation is essential for researchers to find relevant articles in an ever-growing academic field. However, traditional methods often struggle due to data limitations and methodological challenges. In this work, we…

Applications · Statistics 2025-03-04 Kun Liu , Yan Zhang , Rui Pan , Tianchen Gao , Hansheng Wang