English
Related papers

Related papers: DocGenome: An Open Large-scale Scientific Document…

200 papers

We are faced with an unprecedented production in scholarly publications worldwide. Stakeholders in the digital libraries posit that the document-based publishing paradigm has reached the limits of adequacy. Instead, structured,…

Computation and Language · Computer Science 2022-05-25 Jennifer D'Souza

Current publicly available knowledge work data collections lack diversity, extensive annotations, and contextual information about the users and their documents. These issues hinder objective and comparable data-driven evaluations and…

Artificial Intelligence · Computer Science 2024-10-25 Desiree Heim , Christian Jilek , Adrian Ulges , Andreas Dengel

Recent advances in multimodal large language models (MLLMs) have significantly improved medical AI, enabling it to unify the understanding of visual and textual information. However, as medical knowledge continues to evolve, it is critical…

Artificial Intelligence · Computer Science 2025-08-08 Dexuan Xu , Jieyi Wang , Zhongyan Chai , Yongzhi Cao , Hanpin Wang , Huamin Zhang , Yu Huang

The rapid advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced capabilities in Document Understanding. However, prevailing benchmarks like DocVQA and ChartQA predominantly comprise \textit{scanned or digital}…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 An-Lan Wang , Jingqun Tang , Liao Lei , Hao Feng , Qi Liu , Xiang Fei , Jinghui Lu , Han Wang , Weiwei Liu , Hao Liu , Yuliang Liu , Xiang Bai , Can Huang

We address the task of hierarchical multi-label classification (HMC) of scientific documents at an industrial scale, where hundreds of thousands of documents must be classified across thousands of dynamic labels. The rapid growth of…

Artificial Intelligence · Computer Science 2024-12-09 Seyed Amin Tabatabaei , Sarah Fancher , Michael Parsons , Arian Askari

Multimodal documents contain diverse elements, such as tables, figures, and layouts, which can complicate retrieval tasks. While current approaches typically combine dense visual embedding models with supervised rerankers to achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ruofan Hu , Menghui Zhu , Jieming Zhu , Bo Chen , Shengyang Xu , Minjie Hong , Xiaoda Yang , Sashuai Zhou , Li Tang , Tao Jin , Zhou Zhao

Biomedical data is inherently multimodal, consisting of electronic health records, medical imaging, digital pathology, genome sequencing, wearable sensors, and more. The application of artificial intelligence tools to these multifaceted…

Machine Learning · Computer Science 2024-08-26 Shentong Mo , Paul Pu Liang

Over the last several decades, software has been woven into the fabric of every aspect of our society. As software development surges and code infrastructure of enterprise applications ages, it is now more critical than ever to increase…

In response to the growing complexity and volume of scientific literature, this paper introduces the LLMs4Synthesis framework, designed to enhance the capabilities of Large Language Models (LLMs) in generating high-quality scientific…

Computation and Language · Computer Science 2024-09-30 Hamed Babaei Giglou , Jennifer D'Souza , Sören Auer

With the increasing use of RetrievalAugmented Generation (RAG), strong retrieval models have become more important than ever. In healthcare, multimodal retrieval models that combine information from both text and images offer major…

Information Retrieval · Computer Science 2025-10-09 Arkadeep Acharya , Akash Ghosh , Pradeepika Verma , Kitsuchart Pasupa , Sriparna Saha , Priti Singh

The advent of Deep Research agents has substantially reduced the time required for conducting extensive research tasks. However, these tasks inherently demand rigorous standards of factual accuracy and comprehensiveness, necessitating…

Computation and Language · Computer Science 2025-08-25 Minghao Li , Ying Zeng , Zhihao Cheng , Cong Ma , Kai Jia

The rapid advancement of large language models (LLMs) has opened new boundaries in the extraction and synthesis of medical knowledge, particularly within evidence synthesis. This paper reviews the state-of-the-art applications of LLMs in…

Clinical guidelines, typically structured as decision trees, are central to evidence-based medical practice and critical for ensuring safe and accurate diagnostic decision-making. However, it remains unclear whether Large Language Models…

Computation and Language · Computer Science 2025-05-20 Xiaomin Li , Mingye Gao , Yuexing Hao , Taoran Li , Guangya Wan , Zihan Wang , Yijun Wang

Scientific papers use schematic diagrams to communicate methods, workflows, and system structure, yet existing scientific-figure corpora often mix them with plots, screenshots, and photographs and rarely preserve document context. We…

Information Retrieval · Computer Science 2026-05-28 Ling Yue , Tingwen Zhang , Jiaying Wang , Zhen Xu , Shaowu Pan

Recently, there has been a significant upsurge of interest in leveraging large language models (LLMs) to assist scientific discovery. However, most LLMs only focus on general science, while they lack domain-specific knowledge, such as…

Computation and Language · Computer Science 2024-11-13 Liangtai Sun , Danyu Luo , Da Ma , Zihan Zhao , Baocai Chen , Zhennan Shen , Su Zhu , Lu Chen , Xin Chen , Kai Yu

We present MaterialFigBench, a benchmark dataset designed to evaluate the ability of multimodal large language models (LLMs) to solve university-level materials science problems that require accurate interpretation of figures. Unlike…

Computation and Language · Computer Science 2026-03-13 Michiko Yoshitake , Yuta Suzuki , Ryo Igarashi , Yoshitaka Ushiku , Keisuke Nagato

The development of synthesis procedures remains a fundamental challenge in materials discovery, with procedural knowledge scattered across decades of scientific literature in unstructured formats that are challenging for systematic…

The number of Language Models (LMs) dedicated to processing scientific text is on the rise. Keeping pace with the rapid growth of scientific LMs (SciLMs) has become a daunting task for researchers. To date, no comprehensive surveys on…

Computation and Language · Computer Science 2024-02-01 Xanh Ho , Anh Khoa Duong Nguyen , An Tuan Dao , Junfeng Jiang , Yuki Chida , Kaito Sugimoto , Huy Quoc To , Florian Boudin , Akiko Aizawa

Ontologies of research topics are crucial for structuring scientific knowledge, enabling scientists to navigate vast amounts of research, and forming the backbone of intelligent systems such as search engines and recommendation systems.…

Digital Libraries · Computer Science 2025-06-12 Tanay Aggarwal , Angelo Salatino , Francesco Osborne , Enrico Motta

Scientific writing is an iterative process that generates rich revision traces, yet publicly available resources typically expose only final or near-final versions of papers. This limits empirical study of revision behaviour and evaluation…

Computation and Language · Computer Science 2026-03-31 Léane Jourdan , Julien Aubert-Béduchaud , Yannis Chupin , Marah Baccari , Florian Boudin