English
Related papers

Related papers: DatasetResearch: Benchmarking Agent Systems for De…

200 papers

Physical reasoning is a crucial aspect in the development of general AI systems, given that human learning starts with interacting with the physical world before progressing to more complex concepts. Although researchers have studied and…

Artificial Intelligence · Computer Science 2023-12-19 Andrew Melnik , Robin Schiewer , Moritz Lange , Andrei Muresanu , Mozhgan Saeidi , Animesh Garg , Helge Ritter

Artificial Intelligence (AI) is making a profound impact in almost every domain. A vital enabler of its great success is the availability of abundant and high-quality data for building machine learning models. Recently, the role of data in…

Machine Learning · Computer Science 2023-06-13 Daochen Zha , Zaid Pervaiz Bhat , Kwei-Herng Lai , Fan Yang , Zhimeng Jiang , Shaochen Zhong , Xia Hu

Artificial intelligence (AI) systems built on incomplete or biased data will often exhibit problematic outcomes. Current methods of data analysis, particularly before model development, are costly and not standardized. The Dataset Nutrition…

Databases · Computer Science 2018-05-11 Sarah Holland , Ahmed Hosny , Sarah Newman , Joshua Joseph , Kasia Chmielinski

Deep Research Agents (DRAs) aim to answer complex questions by searching the web, checking evidence, and synthesizing conclusions across heterogeneous sources. We introduce a category-theoretic framework for evaluating and improving such…

Machine Learning · Computer Science 2026-04-30 Shuoling Liu , Zhiquan Tan , Kun Yi , Hui Wu , Yihan Li , Jiangpeng Yan , Liyuan Chen , Kai Chen , Qiang Yang

The advent of large reasoning models, such as OpenAI o1 and DeepSeek R1, has significantly advanced complex reasoning tasks. However, their capabilities in multilingual complex reasoning remain underexplored, with existing efforts largely…

Computation and Language · Computer Science 2025-05-27 Wenyang Luo , Wayne Xin Zhao , Jing Sha , Shijin Wang , Ji-Rong Wen

Deep learning (DL) has proven to be a highly effective approach for developing models in diverse contexts, including visual perception, speech recognition, and machine translation. However, the end-to-end process for applying DL is not…

Machine Learning · Computer Science 2022-05-18 Xuanyi Dong , David Jacob Kedziora , Katarzyna Musial , Bogdan Gabrys

The growing demand for data-driven decision-making has created an urgent need for data agents that can integrate structured and unstructured data for analysis. While data agents show promise for enabling users to perform complex analytics…

Databases · Computer Science 2025-09-03 Ziting Wang , Shize Zhang , Haitao Yuan , Jinwei Zhu , Shifu Li , Wei Dong , Gao Cong

Search-augmented LLMs often struggle with complex reasoning tasks due to ineffective multi-hop retrieval and limited reasoning ability. We propose AceSearcher, a cooperative self-play framework that trains a single large language model…

Computation and Language · Computer Science 2025-09-30 Ran Xu , Yuchen Zhuang , Zihan Dong , Jonathan Wang , Yue Yu , Joyce C. Ho , Linjun Zhang , Haoyu Wang , Wenqi Shi , Carl Yang

Recent progress in Large Language Models (LLMs) has drawn attention to their potential for accelerating drug discovery. However, a central problem remains: translating theoretical ideas into robust implementations in the highly specialized…

Machine Learning · Computer Science 2025-03-06 Sizhe Liu , Yizhou Lu , Siyu Chen , Xiyang Hu , Jieyu Zhao , Yingzhou Lu , Yue Zhao

Multi-step agentic retrieval systems based on large language models (LLMs) have demonstrated remarkable performance in complex information search tasks. However, these systems still face significant challenges in practical applications,…

Machine Learning · Computer Science 2025-10-16 Chuzhan Hao , Wenfeng Feng , Yuewei Zhang , Hao Wang

Artificial intelligence (AI), machine learning, and deep learning have become transformative forces in big data analytics and management, enabling groundbreaking advancements across diverse industries. This article delves into the…

In business and marketing, analyzing the reasons behind buying is a fundamental step towards understanding consumer behaviors, shaping business strategies, and predicting market outcomes. Prior research on purchase reason has relied on…

Information Retrieval · Computer Science 2024-11-19 Tao Chen , Siqi Zuo , Cheng Li , Mingyang Zhang , Qiaozhu Mei , Michael Bendersky

In the rapidly evolving field of artificial intelligence, the ability to harness and integrate knowledge across various domains stands as a paramount challenge and opportunity. This study introduces a novel approach to cross-domain…

Deep learning technologies have brought us many models that outperform human beings on a few benchmarks. An interesting question is: can these models well solve real-world problems with similar settings (e.g., identical input/output) to the…

Information Retrieval · Computer Science 2023-08-22 Mengying Yu , Aixin Sun

Mathematical problem solving remains a challenging test of reasoning for large language and multimodal models, yet existing benchmarks are limited in size, language coverage, and task diversity. We introduce MathNet, a high-quality,…

Artificial Intelligence · Computer Science 2026-04-21 Shaden Alshammari , Kevin Wen , Abrar Zainal , Mark Hamilton , Navid Safaei , Sultan Albarakati , William T. Freeman , Antonio Torralba

Autonomous AI research agents aim to accelerate scientific discovery by automating the research pipeline, from hypothesis generation to peer review. However, existing benchmarks rarely test a fundamental bottleneck: whether Large Language…

Machine Learning · Computer Science 2026-05-29 Sy-Tuyen Ho , Minghui Liu , Huy Nghiem , Furong Huang

AI research agents can now generate research ideas, design experiments, run code, and draft papers, raising the possibility of large-scale AI-assisted scientific discovery. Many current agent frameworks explicitly encourage the generation…

Computation and Language · Computer Science 2026-05-28 Yixuan Tang , Yi Yang

Retrieval-augmented generation (RAG) systems improve large language model outputs by incorporating external knowledge, enabling more informed and context-aware responses. However, the effectiveness and trustworthiness of these systems…

Computation and Language · Computer Science 2025-08-27 Ilias Driouich , Hongliu Cao , Eoin Thomas

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

Computation and Language · Computer Science 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty

Large Language Models (LLMs) have recently achieved impressive performance in math and reasoning benchmarks. However, they often struggle with logic problems and puzzles that are relatively easy for humans. To further investigate this, we…

Artificial Intelligence · Computer Science 2025-09-16 Nasim Borazjanizadeh , Roei Herzig , Trevor Darrell , Rogerio Feris , Leonid Karlinsky
‹ Prev 1 8 9 10 Next ›