English
Related papers

Related papers: SciNet: Evaluating AI Agents in Relation-Aware Sci…

200 papers

Artificial intelligence (AI) has acquired notorious relevance in modern computing as it effectively solves complex tasks traditionally done by humans. AI provides methods to represent and infer knowledge, efficiently manipulate texts and…

Information Retrieval · Computer Science 2024-01-23 José de la Torre-López , Aurora Ramírez , José Raúl Romero

This paper is devoted to the study of methods for information extraction (entity recognition and relation classification) from scientific texts on information technology. Scientific publications provide valuable information into…

Computation and Language · Computer Science 2020-12-29 Elena Bruches , Alexey Pauls , Tatiana Batura , Vladimir Isachenko

Large language models (LLMs) have created new opportunities to enhance the efficiency of scholarly activities; however, challenges persist in the ethical deployment of AI assistance, including (1) the trustworthiness of AI-generated…

Computation and Language · Computer Science 2026-02-27 Mengze Hong , Di Jiang , Chen Jason Zhang , Zichang Guo , Yawen Li , Jun Chen , Shaobo Cui , Zhiyang Su

Scientific research is being reshaped by AI systems that move beyond isolated assistance toward longer-horizon workflows spanning literature grounding, hypothesis generation, experimentation, validation, reporting, and revision. This shift…

Extracting information from full documents is an important problem in many domains, but most previous work focus on identifying relationships within a sentence or a paragraph. It is challenging to create a large-scale information extraction…

Computation and Language · Computer Science 2020-05-04 Sarthak Jain , Madeleine van Zuylen , Hannaneh Hajishirzi , Iz Beltagy

Automated relation extraction (RE) from biomedical literature is critical for many downstream text mining applications in both research and real-world settings. However, most existing benchmarking datasets for bio-medical RE only focus on…

Computation and Language · Computer Science 2022-07-20 Ling Luo , Po-Ting Lai , Chih-Hsuan Wei , Cecilia N Arighi , Zhiyong Lu

The extent to which Artificial Intelligence (AI) technologies can trigger generalized paradigm shifts in science is unclear. Although these technologies have revolutionized data collection and analysis in specific fields, their overall…

Digital Libraries · Computer Science 2026-05-13 Andrés F. Castro Torres , Joan Giner-Miguelez , Mercè Crosas

In the artificial intelligence area, one of the ultimate goals is to make computers understand human language and offer assistance. In order to achieve this ideal, researchers of computer science have put forward a lot of models and…

Computation and Language · Computer Science 2015-12-07 Mengyun Cao , Jiao Tian , Dezhi Cheng , Jin Liu , Xiaoping Sun

The increasing availability of large-scale datasets has fueled rapid progress across many scientific fields, creating unprecedented opportunities for research and discovery while posing significant analytical challenges. Recent advances in…

Artificial Intelligence · Computer Science 2025-12-01 Erzhuo Shao , Yifang Wang , Yifan Qian , Zhenyu Pan , Han Liu , Dashun Wang

Deep research systems powered by LLM agents have transformed complex information seeking by automating the iterative retrieval, filtering, and synthesis of insights from massive-scale web sources. However, existing systems predominantly…

Information Retrieval · Computer Science 2026-03-16 Bo Pan , Lunke Pan , Yitao Zhou , Qi Jiang , Zhen Wen , Minfeng Zhu , Wei Chen

Scientific discovery is a complex cognitive process that has driven human knowledge and technological progress for centuries. While artificial intelligence (AI) has made significant advances in automating aspects of scientific reasoning,…

Machine Learning · Computer Science 2024-12-24 Chandan K Reddy , Parshin Shojaee

The potential of AI researchers in scientific discovery remains largely untapped. Over the past decade, AI for Science (AI4Science) publications in 145 Nature Index journals have increased fifteen-fold, yet they still account for less than…

Computers and Society · Computer Science 2025-09-24 Hengjie Yu , Shuya Liu , Haiyun Yang , Yuping Yan , Maozhen Qu , Yaochu Jin

Scientific literature is typically dense, requiring significant background knowledge and deep comprehension for effective engagement. We introduce SciDQA, a new dataset for reading comprehension that challenges LLMs for a deep understanding…

Computation and Language · Computer Science 2024-11-11 Shruti Singh , Nandan Sarkar , Arman Cohan

Artificial intelligence systems are transforming scientific discovery by accelerating specific research tasks, from protein structure prediction to materials design, yet remain confined to narrow domains requiring substantial human…

Artificial Intelligence · Computer Science 2026-01-30 Gabrielle Wehr , Reuben Rideaux , Amaya J. Fox , David R. Lightfoot , Jason Tangen , Jason B. Mattingley , Shane E. Ehrhardt

Autonomous AI research agents aim to accelerate scientific discovery by automating the research pipeline, from hypothesis generation to peer review. However, existing benchmarks rarely test a fundamental bottleneck: whether Large Language…

Machine Learning · Computer Science 2026-05-29 Sy-Tuyen Ho , Minghui Liu , Huy Nghiem , Furong Huang

The pace of scientific research, vital for improving human life, is complex, slow, and needs specialized expertise. Meanwhile, novel, impactful research often stems from both a deep understanding of prior work, and a cross-pollination of…

Computation and Language · Computer Science 2025-02-11 Jinheon Baek , Sujay Kumar Jauhar , Silviu Cucerzan , Sung Ju Hwang

Scientific information expresses human understanding of nature. This knowledge is largely disseminated in different forms of text, including scientific papers, news articles, and discourse among people on social media. While important for…

Computation and Language · Computer Science 2025-07-01 Dustin Wright

The rapid adoption of large language models (LLMs) in scientific writing raises serious concerns regarding authorship integrity and the reliability of scholarly publications. Existing detection approaches mainly rely on document-level…

Computation and Language · Computer Science 2025-10-02 Zhen Yin , Shenghua Wang

Agentic search such as Deep Research systems-where agents autonomously browse the web, synthesize information, and return comprehensive citation-backed answers-represents a major shift in how users interact with web-scale information. While…

Artificial Intelligence (AI) systems are transforming critical sectors such as healthcare, finance, and transportation, enhancing operational efficiency and decision-making processes. However, their deployment in high-stakes domains has…

Computers and Society · Computer Science 2025-08-01 Diego Russo , Gian Marco Orlando , Valerio La Gatta , Vincenzo Moscato