English
Related papers

Related papers: SciGPT: A Large Language Model for Scientific Lite…

200 papers

Prior benchmarks for evaluating the domain-specific knowledge of large language models (LLMs) lack the scalability to handle complex academic tasks. To address this, we introduce \texttt{ScholarBench}, a benchmark centered on deep expert…

Computation and Language · Computer Science 2025-10-17 Dongwon Noh , Donghyeok Koh , Junghun Yuk , Gyuwan Kim , Jaeyong Lee , Kyungtae Lim , Cheoneum Park

Single-cell foundation models such as scGPT represent a significant advancement in single-cell omics, with an ability to achieve state-of-the-art performance on various downstream biological tasks. However, these models are inherently…

Machine Learning · Computer Science 2025-07-15 Steven Palayew , Bo Wang , Gary Bader

In recent years, large language models(LLMs) have attracted significant attention due to their exceptional performance across a multitude of natural language process tasks, and have been widely applied in various fields. However, the…

Scientific research is inherently global. However, the vast majority of academic journals are published exclusively in English, creating barriers for non-native-English-speaking researchers. In this study, we leverage large language models…

Artificial Intelligence · Computer Science 2025-09-05 Hannah Calzi Kleidermacher , James Zou

Despite advances in scientific AI, a coherent framework for Scientific General Intelligence (SGI)-the ability to autonomously conceive, investigate, and reason across scientific domains-remains lacking. We present an operational SGI…

This paper presents a hybrid framework for literature reviews that augments traditional bibliometric methods with large language models (LLMs). By fine-tuning open-source LLMs, our approach enables scalable extraction of qualitative…

Computation and Language · Computer Science 2025-04-21 Stefano M. Iacus , Haodong Qi , Jiyoung Han

Scientific reasoning, the process through which humans apply logic, evidence, and critical thinking to explore and interpret scientific phenomena, is essential in advancing knowledge reasoning across diverse fields. However, despite…

Computation and Language · Computer Science 2026-04-21 Yibo Yan , Shen Wang , Jiahao Huo , Jingheng Ye , Zhendong Chu , Xuming Hu , Philip S. Yu , Carla Gomes , Bart Selman , Qingsong Wen

Scientific paper retrieval is essential for supporting literature discovery and research. While dense retrieval methods demonstrate effectiveness in general-purpose tasks, they often fail to capture fine-grained scientific concepts that are…

Information Retrieval · Computer Science 2025-10-07 Yunyi Zhang , Ruozhen Yang , Siqi Jiao , SeongKu Kang , Jiawei Han

There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that…

Computation and Language · Computer Science 2024-06-07 Anand Subramanian , Viktor Schlegel , Abhinav Ramesh Kashyap , Thanh-Tung Nguyen , Vijay Prakash Dwivedi , Stefan Winkler

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Information extraction and textual comprehension from materials literature are vital for developing an exhaustive knowledge base that enables accelerated materials discovery. Language models have demonstrated their capability to answer…

Computation and Language · Computer Science 2023-08-21 Mohd Zaki , Jayadeva , Mausam , N. M. Anoop Krishnan

Analogical reasoning, the transfer of relational structures across contexts (e.g., planet is to sun as electron is to nucleus), is fundamental to scientific discovery. Yet human insight is often constrained by domain expertise and…

Machine Learning · Computer Science 2025-10-28 Hongyu Guo

Digital health analytics face critical challenges nowadays. The sophisticated analysis of patient-generated health content, which contains complex emotional and medical contexts, requires scarce domain expertise, while traditional ML…

Large language models (LLMs), such as ChatGPT/GPT-4, have proven to be powerful tools in promoting the user experience as an AI assistant. The continuous works are proposing multi-modal large language models (MLLM), empowering LLMs with the…

Computation and Language · Computer Science 2023-10-23 Ziqiang Zheng , Jipeng Zhang , Tuan-Anh Vu , Shizhe Diao , Yue Him Wong Tim , Sai-Kit Yeung

Large language models (LLMs) have demonstrated astonishing capabilities in natural language processing (NLP) tasks, sparking interest in their application to professional domains with higher specialized requirements. However, restricted…

Computation and Language · Computer Science 2024-05-09 Zheyan Qu , Lu Yin , Zitong Yu , Wenbo Wang , Xing zhang

Scientific progress depends on researchers' ability to synthesize the growing body of literature. Can large language models (LMs) assist scientists in this task? We introduce OpenScholar, a specialized retrieval-augmented LM that answers…

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

While large language models (LLMs) excel at many domain-specific tasks, their ability to deeply comprehend and reason about full-length academic papers remains underexplored. Existing benchmarks often fall short of capturing such depth,…

Artificial Intelligence · Computer Science 2026-01-08 Xinbang Dai , Huikang Hu , Yongrui Chen , Jiaqi Li , Rihui Jin , Yuyang Zhang , Xiaoguang Li , Lifeng Shang , Guilin Qi

Materials discovery and development are critical for addressing global challenges. Yet, the exponential growth in materials science literature comprising vast amounts of textual data has created significant bottlenecks in knowledge…

Large Language Models (LLMs) have shown outstanding performance across wide range of downstream tasks. This competency is attributed to their substantial parameter size and pre-training on extensive corpus. Moreover, LLMs have exhibited…

Computation and Language · Computer Science 2023-08-10 Yuhan Ma , Haiqi Jiang , Chenyou Fan