English
Related papers

Related papers: VILLA: Versatile Information Retrieval From Scient…

200 papers

Large language models (LLMs) have great potential for synthetic data generation. This work shows that useful data can be synthetically generated even for tasks that cannot be solved directly by LLMs: for problems with structured outputs, it…

Computation and Language · Computer Science 2023-10-31 Martin Josifoski , Marija Sakota , Maxime Peyrard , Robert West

Large language models (LLMs) have ushered in a new era for processing complex information in various fields, including science. The increasing amount of scientific literature allows these models to acquire and understand scientific…

Computation and Language · Computer Science 2024-08-21 Huy Quoc To , Ming Liu , Guangyan Huang

Scientific literature is growing exponentially, creating a critical bottleneck for researchers to efficiently synthesize knowledge. While general-purpose Large Language Models (LLMs) show potential in text processing, they often fail to…

Computation and Language · Computer Science 2025-09-11 Fengyu She , Nan Wang , Hongfei Wu , Ziyi Wan , Jingmian Wang , Chang Wang

Context: Study screening in systematic literature reviews is costly, inconsistency-prone, and risk-asymmetric, since false negatives can compromise validity. Despite rapid uptake of Large Language Models (LLMs), there is limited evidence on…

Software Engineering · Computer Science 2026-05-01 Gilberto Sussumu Hida , Danilo Monteiro Ribeiro , Erika Yahata

Retrieval-augmented Generation (RAG) extends large language models (LLMs) with external knowledge but faces key challenges: restricted effective context length and redundancy in retrieved documents. Pure compression-based approaches reduce…

Computation and Language · Computer Science 2025-07-09 Yiqiao Jin , Kartik Sharma , Vineeth Rakesh , Yingtong Dou , Menghai Pan , Mahashweta Das , Srijan Kumar

Large language models (LLMs) possess impressive linguistic capabilities but often fail to faithfully retain factual knowledge, leading to hallucinations and unreliable outputs. Understanding LLMs' knowledge deficiencies by exhaustively…

Computation and Language · Computer Science 2025-04-01 Linxin Song , Xuwei Ding , Jieyu Zhang , Taiwei Shi , Ryotaro Shimizu , Rahul Gupta , Yang Liu , Jian Kang , Jieyu Zhao

As AI becomes fundamental in sectors like healthcare, explainable AI (XAI) tools are essential for trust and transparency. However, traditional user studies used to evaluate these tools are often costly, time consuming, and difficult to…

Artificial Intelligence · Computer Science 2024-10-24 Francesco Bombassei De Bona , Gabriele Dominici , Tim Miller , Marc Langheinrich , Martin Gjoreski

Despite advances in scientific AI, a coherent framework for Scientific General Intelligence (SGI)-the ability to autonomously conceive, investigate, and reason across scientific domains-remains lacking. We present an operational SGI…

Recent progress in large language model (LLM) reasoning has focused on domains like mathematics and coding, where abundant high-quality data and objective evaluation metrics are readily available. In contrast, progress in LLM reasoning…

Artificial Intelligence · Computer Science 2026-01-12 Tengxiao Liu , Deepak Nathani , Zekun Li , Kevin Yang , William Yang Wang

Generation with source attribution is important for enhancing the verifiability of retrieval-augmented generation (RAG) systems. However, existing approaches in RAG primarily link generated content to document-level references, making it…

Information Retrieval · Computer Science 2024-12-20 Xueguang Ma , Shengyao Zhuang , Bevan Koopman , Guido Zuccon , Wenhu Chen , Jimmy Lin

The rapid growth of scientific literature has made manual extraction of structured knowledge increasingly impractical. To address this challenge, we introduce SCILIRE, a system for creating datasets from scientific literature. SCILIRE has…

Computation and Language · Computer Science 2026-03-16 Necva Bölücü , Jessica Irons , Changhyun Lee , Brian Jin , Maciej Rybinski , Huichen Yang , Andreas Duenser , Stephen Wan

Considering the limited internal parametric knowledge, retrieval-augmented generation (RAG) has been widely used to extend the knowledge scope of large language models (LLMs). Despite the extensive efforts on RAG research, in existing…

Computation and Language · Computer Science 2024-11-22 Yuhao Wang , Ruiyang Ren , Junyi Li , Wayne Xin Zhao , Jing Liu , Ji-Rong Wen

Safe and trustworthy use of Large Language Models (LLM) in the processing of healthcare documents and scientific papers could substantially help clinicians, scientists and policymakers in overcoming information overload and focusing on the…

Scientific literature understanding is crucial for extracting targeted information and garnering insights, thereby significantly advancing scientific discovery. Despite the remarkable success of Large Language Models (LLMs), they face…

Machine Learning · Computer Science 2025-04-21 Sihang Li , Jin Huang , Jiaxi Zhuang , Yaorui Shi , Xiaochen Cai , Mingjun Xu , Xiang Wang , Linfeng Zhang , Guolin Ke , Hengxing Cai

This research pioneers the use of fine-tuned Large Language Models (LLMs) to automate Systematic Literature Reviews (SLRs), presenting a significant and novel contribution in integrating AI to enhance academic research methodologies. Our…

Computation and Language · Computer Science 2025-02-21 Teo Susnjak , Peter Hwang , Napoleon H. Reyes , Andre L. C. Barczak , Timothy R. McIntosh , Surangika Ranathunga

Large-scale scientific collaborations, such as the Compact Muon Solenoid (CMS) at CERN, produce a vast and ever-growing corpus of internal documentation. Navigating this complex information landscape presents a significant challenge for…

Information Retrieval · Computer Science 2026-03-12 Abhishikth Mallampalli , Sridhara Dasu

The cycle of scientific discovery is frequently bottlenecked by the slow, manual creation of software to support computational experiments\cite{hannay2009how}. To address this, we present Empirical Research Assistance (ERA), an AI system…

Large Language Models (LLMs) are increasingly used for cybersecurity threat analysis, but their deployment in security-sensitive environments raises trust and safety concerns. With over 21,000 vulnerabilities disclosed in 2025, manual…

Cryptography and Security · Computer Science 2025-09-04 Reza Fayyazi , Michael Zuzak , Shanchieh Jay Yang

Large language models (LLMs) have achieved significant advancements in reasoning capabilities through reinforcement learning (RL) via environmental exploration. As the intrinsic properties of the environment determine the abilities that…

Computation and Language · Computer Science 2026-05-04 Peng Yu , Zeyuan Zhao , Shao Zhang , Luoyi Fu , Xinbing Wang , Ying Wen

Large language models (LLMs) have significantly transformed the landscape of artificial intelligence by demonstrating their ability in generating human-like text across diverse topics. However, despite their impressive capabilities, LLMs…