English
Related papers

Related papers: Procrustean Bed for AI-Driven Retrosynthesis: A Un…

200 papers

Data analysis in fundamental sciences nowadays is an essential process that pushes frontiers of our knowledge and leads to new discoveries. At the same time we can see that complexity of those analyses increases fast due to a)~enormous…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Tatiana Likhomanenko , Alex Rogozhnikov , Alexander Baranov , Egor Khairullin , Andrey Ustyuzhanin

In the era of increasingly complex AI models for time series forecasting, progress is often measured by marginal improvements on benchmark leaderboards. However, this approach suffers from a fundamental flaw: standard evaluation metrics…

Machine Learning · Computer Science 2026-05-28 Wanjin Feng , Yuan Yuan , Jingtao Ding , Yong Li

Selecting efficient multi-step synthetic routes is a central challenge in organic synthesis, particularly in medicinal and process chemistry, where route choice directly impacts feasibility, cost, and development efficiency. Data-driven…

Evaluating Retrieval-Augmented Generation (RAG) systems remains a challenging task: existing metrics often collapse heterogeneous behaviors into single scores and provide little insight into whether errors arise from retrieval,reasoning, or…

Computation and Language · Computer Science 2026-01-09 Keerthana Murugaraj , Salima Lamsiyah , Martin Theobald

While the OneRec series has successfully unified the fragmented recommendation pipeline into an end-to-end generative framework, a significant gap remains between recommendation systems and general intelligence. Constrained by isolated…

We present an extension of our Molecular Transformer architecture combined with a hyper-graph exploration strategy for automatic retrosynthesis route planning without human intervention. The single-step retrosynthetic model sets a new state…

The rapid expansion of Earth Science data from satellite observations, reanalysis products, and numerical simulations has created a critical bottleneck in scientific discovery, namely identifying relevant datasets for a given research…

Databases · Computer Science 2026-03-03 Youran Sun , Yixin Wen , Haizhao Yang

A significant challenge in wet lab experiments with current drug design generative models is the trade-off between pharmacological properties and synthesizability. Molecules predicted to have highly desirable properties are often difficult…

Machine Learning · Computer Science 2025-04-04 Songtao Liu , Dandan Zhang , Zhengkai Tu , Hanjun Dai , Peng Liu

The reproduction and replication of research results has become a major issue for a number of scientific disciplines. In computer science and related computational disciplines such as systems biology, the challenges closely revolve around…

Software Engineering · Computer Science 2017-07-31 Tom Crick , Benjamin A. Hall , Samin Ishtiaq

Traditional fixed test sets fall short in evaluating open-ended capabilities of foundation models. To address this, we propose ONEBench(OpeN-Ended Benchmarking), a new testing paradigm that consolidates individual evaluation datasets into a…

Machine Learning · Computer Science 2025-06-18 Adhiraj Ghosh , Sebastian Dziadzio , Ameya Prabhu , Vishaal Udandarao , Samuel Albanie , Matthias Bethge

As artificial intelligence plays an increasingly important role in our society, there are ethical and moral obligations for both businesses and researchers to ensure that their machine learning models are designed, deployed, and maintained…

Machine Learning · Computer Science 2020-07-07 Shubham Sharma , Jette Henderson , Joydeep Ghosh

Evaluating the quality of retrieval-augmented generation (RAG) and document reranking systems remains challenging due to the lack of scalable, user-centric, and multi-perspective evaluation tools. We introduce RankArena, a unified platform…

Information Retrieval · Computer Science 2025-08-08 Abdelrahman Abdallah , Mahmoud Abdalla , Bhawna Piryani , Jamshid Mozafari , Mohammed Ali , Adam Jatowt

Single-cell RNA sequencing (scRNA-seq) technology enables systematic delineation of cellular states and interactions, providing crucial insights into cellular heterogeneity. Building on this potential, numerous computational methods have…

Genomics · Quantitative Biology 2025-11-11 Ping Xu , Zaitian Wang , Zhirui Wang , Pengjiang Li , Ran Zhang , Gaoyang Li , Hanyu Xie , Jiajia Wang , Yuanchun Zhou , Pengfei Wang

Recent success in fine-tuning large models, that are pretrained on broad data at scale, on downstream tasks has led to a significant paradigm shift in deep learning, from task-centric model design to task-agnostic representation learning…

Machine Learning · Computer Science 2022-10-10 Ching-Yun Ko , Pin-Yu Chen , Jeet Mohapatra , Payel Das , Luca Daniel

Computational reproducibility is fundamental to trustworthy science, yet remains difficult to achieve in practice across various research workflows, including Jupyter notebooks published alongside scholarly articles. Environment drift,…

Software Engineering · Computer Science 2026-04-02 Sheeba Samuel , Daniel Mietchen , Hemanta Lo , Martin Gaedke

As an important problem in modern data analytics, classification has witnessed varieties of applications from different domains. Different from conventional classification approaches, fair classification concerns the issues of unintentional…

Machine Learning · Statistics 2020-12-25 Qing Ye , Weijun Xie

The rapid growth of Retrieval-Augmented Generation (RAG) has created a proliferation of toolkits, yet a fundamental gap remains between experimental prototypes and robust, production-ready systems. We present SearchGym, a modular…

Information Retrieval · Computer Science 2026-03-06 Jerome Tze-Hou Hsu

Chemical synthesis remains a critical bottleneck in the discovery and manufacture of functional small molecules. AI-based synthesis planning models could be a potential remedy to find effective syntheses, and have made progress in recent…

Retrieval quality is the primary bottleneck for accuracy and robustness in retrieval-augmented generation (RAG). Current evaluation relies on heuristically constructed query sets, which introduce a hidden intrinsic bias. We formalize…

Information Retrieval · Computer Science 2026-04-23 Andrew Klearman , Radu Revutchi , Rohin Garg , Rishav Chakravarti , Samuel Marc Denton , Yuan Xue

In recent years, the research community, but also the general public, has raised serious questions about the reproducibility and replicability of scientific work. Since many studies include some kind of computational work, these issues are…

Software Engineering · Computer Science 2025-03-14 Lázaro Costa , Susana Barbosa , Jácome Cunha