English
Related papers

Related papers: SciNet: Evaluating AI Agents in Relation-Aware Sci…

200 papers

AI alignment research is the field of study dedicated to ensuring that artificial intelligence (AI) benefits humans. As machine intelligence gets more advanced, this research is becoming increasingly important. Researchers in the field…

Computers and Society · Computer Science 2022-06-08 Jan H. Kirchner , Logan Smith , Jacques Thibodeau , Kyle McDonell , Laria Reynolds

Artificial intelligence (AI) agents are emerging as transformative tools in drug discovery, with the ability to autonomously reason, act, and learn through complicated research workflows. Building on large language models (LLMs) coupled…

One of the grand challenges of artificial general intelligence is developing agents capable of conducting scientific research and discovering new knowledge. While frontier models have already been used as aides to human scientists, e.g. for…

Artificial Intelligence · Computer Science 2024-09-04 Chris Lu , Cong Lu , Robert Tjarko Lange , Jakob Foerster , Jeff Clune , David Ha

As the number of people who use scientific literature databases grows, the demand for literature retrieval services has been steadily increased. One of the most popular retrieval services is to find a set of papers similar to the paper…

Digital Libraries · Computer Science 2011-09-07 Seok-Ho Yoon , Sang-Wook Kim , Sunju Park

The exponential growth of scientific literature poses unprecedented challenges for researchers attempting to synthesize knowledge across rapidly evolving fields. We present \textbf{Agentic AutoSurvey}, a multi-agent framework for automated…

Information Retrieval · Computer Science 2025-09-24 Yixin Liu , Yonghui Wu , Denghui Zhang , Lichao Sun

To provide AI researchers with modern tools for dealing with the explosive growth of the research literature in their field, we introduce a new platform, AI Research Navigator, that combines classical keyword search with neural retrieval to…

Computation and Language · Computer Science 2020-11-03 Marzieh Fadaee , Olga Gureenkova , Fernando Rejon Barrera , Carsten Schnober , Wouter Weerkamp , Jakub Zavrel

We introduce SciEvalKit, a unified benchmarking toolkit designed to evaluate AI models for science across a broad range of scientific disciplines and task capabilities. Unlike general-purpose evaluation platforms, SciEvalKit focuses on the…

Recent advancements in large language model (LLM) agents have significantly accelerated scientific discovery automation, yet concurrently raised critical ethical and safety concerns. To systematically address these challenges, we introduce…

Artificial Intelligence · Computer Science 2025-05-30 Kunlun Zhu , Jiaxun Zhang , Ziheng Qi , Nuoxing Shang , Zijia Liu , Peixuan Han , Yue Su , Haofei Yu , Jiaxuan You

AI agents augment large language models with external tools such as web retrieval, enabling grounded and up-to-date responses. However, incorporating external content into the generation pipeline can weaken the safety alignment mechanisms…

Computation and Language · Computer Science 2026-05-29 Aditya Nawal , Manit Baser , Mohan Gurusamy

Systematic literature reviews are the highest quality of evidence in research. However, the review process is hindered by significant resource and data constraints. The Literature Review Network (LRN) is the first of its kind explainable AI…

Digital Libraries · Computer Science 2024-08-13 Joshua Morriss , Tod Brindle , Jessica Bah Rösman , Daniel Reibsamen , Andreas Enz

Autonomous science agents built on large language models (LLMs) are increasingly used to generate hypotheses, design experiments, and produce reports. However, prior work mainly targets open-ended scientific problems with subjective outputs…

Computation and Language · Computer Science 2026-03-24 Tianshu Zhang , Huan Sun

Document-level relation extraction (RE) aims to identify relations between two entities in a given document. Compared with its sentence-level counterpart, document-level RE requires complex reasoning. Previous research normally completed…

Computation and Language · Computer Science 2022-03-29 Liang Zhang , Yidong Cheng

The exponential increase in academic publications has made it increasingly difficult for researchers to remain up to date and systematically synthesize knowledge scattered across vast and fragmented research domains. Literature reviews,…

Digital Libraries · Computer Science 2025-06-12 Kiran Sharmaa , Parul Khurana , Ziya Uddina

We introduce DRBench, a benchmark for evaluating AI agents on complex, open-ended deep research tasks in enterprise settings. Unlike prior benchmarks that focus on simple questions or web-only queries, DRBench evaluates agents on multi-step…

We envision "AI scientists" as systems capable of skeptical learning and reasoning that empower biomedical research through collaborative agents that integrate AI models and biomedical tools with experimental platforms. Rather than taking…

Information extraction from the scientific literature is one of the main techniques to transform unstructured knowledge hidden in the text into structured data which can then be used for decision-making in down-stream tasks. One such area…

Computation and Language · Computer Science 2024-12-17 Melanie McGrath , Harrison Bailey , Necva Bölücü , Xiang Dai , Sarvnaz Karimi , Cecile Paris

The rapid growth of scientific literature demands robust tools for automated survey-generation. However, current large language model (LLM)-based methods often lack in-depth analysis, structural coherence, and reliable citations. To address…

Artificial Intelligence · Computer Science 2025-07-22 Xiaofeng Shi , Qian Kou , Yuduo Li , Ning Tang , Jinxin Xie , Longbin Yu , Songjing Wang , Hua Zhou

The rapid progress of Large Language Models (LLMs) has given rise to a new category of autonomous AI systems, referred to as Deep Research (DR) agents. These agents are designed to tackle complex, multi-turn informational research tasks by…

Artificial Intelligence · Computer Science 2025-09-04 Yuxuan Huang , Yihang Chen , Haozheng Zhang , Kang Li , Huichi Zhou , Meng Fang , Linyi Yang , Xiaoguang Li , Lifeng Shang , Songcen Xu , Jianye Hao , Kun Shao , Jun Wang

Data wrangling tasks such as obtaining and linking data from various sources, transforming data formats, and correcting erroneous records, can constitute up to 80% of typical data engineering work. Despite the rise of machine learning and…

The accelerating pace of scientific publication makes it difficult to identify truly original research among incremental work. We propose a framework for estimating the conceptual novelty of research papers by combining semantic…

Machine Learning · Computer Science 2026-01-06 Zhengxu Yan , Han Li , Yuming Feng