English
Related papers

Related papers: Galactica: A Large Language Model for Science

200 papers

Recently developed large language models (LLMs) have been shown to perform remarkably well on a wide range of language understanding tasks. But, can they really "reason" over the natural language? This question has been receiving…

Computation and Language · Computer Science 2024-06-07 Mihir Parmar , Nisarg Patel , Neeraj Varshney , Mutsumi Nakamura , Man Luo , Santosh Mashetty , Arindam Mitra , Chitta Baral

The sheer volume of scientific experimental results and complex technical statements, often presented in tabular formats, presents a formidable barrier to individuals acquiring preferred information. The realms of scientific reasoning and…

Computation and Language · Computer Science 2024-03-28 Zhixin Guo , Jianping Zhou , Jiexing Qi , Mingxuan Yan , Ziwei He , Guanjie Zheng , Zhouhan Lin , Xinbing Wang , Chenghu Zhou

Recent advances in Large Language Models (LLMs) have presented new opportunities for integrating Artificial General Intelligence (AGI) into biological research and education. This study evaluated the capabilities of leading LLMs, including…

Computation and Language · Computer Science 2023-11-15 Xinyu Gong , Jason Holmes , Yiwei Li , Zhengliang Liu , Qi Gan , Zihao Wu , Jianli Zhang , Yusong Zou , Yuxi Teng , Tian Jiang , Hongtu Zhu , Wei Liu , Tianming Liu , Yajun Yan

With recent Nobel Prizes recognising AI contributions to science, Large Language Models (LLMs) are transforming scientific research by enhancing productivity and reshaping the scientific method. LLMs are now involved in experimental design,…

Scientific literature understanding is crucial for extracting targeted information and garnering insights, thereby significantly advancing scientific discovery. Despite the remarkable success of Large Language Models (LLMs), they face…

Machine Learning · Computer Science 2025-04-21 Sihang Li , Jin Huang , Jiaxi Zhuang , Yaorui Shi , Xiaochen Cai , Mingjun Xu , Xiang Wang , Linfeng Zhang , Guolin Ke , Hengxing Cai

Large language models (LLMs) have shown remarkable achievements across various language tasks.To enhance the performance of LLMs in scientific literature services, we developed the scientific literature LLM (SciLit-LLM) through pre-training…

Computation and Language · Computer Science 2024-08-14 Dayong Wu , Jiaqi Li , Baoxin Wang , Honghong Zhao , Siyuan Xue , Yanjie Yang , Zhijun Chang , Rui Zhang , Li Qian , Bo Wang , Shijin Wang , Zhixiong Zhang , Guoping Hu

The value of text classification's future research has encountered challenges and uncertainties, due to the extraordinary efficacy demonstrated by large language models (LLMs) across numerous downstream NLP tasks. In this era of open-ended…

Computation and Language · Computer Science 2024-02-19 Yazhou Zhang , Mengyao Wang , Chenyu Ren , Qiuchi Li , Prayag Tiwari , Benyou Wang , Jing Qin

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Previous work has showcased the intriguing capability of large language models (LLMs) in retrieving facts and processing context knowledge. However, only limited research exists on the layer-wise capability of LLMs to encode knowledge,…

Computation and Language · Computer Science 2024-03-05 Tianjie Ju , Weiwei Sun , Wei Du , Xinwei Yuan , Zhaochun Ren , Gongshen Liu

Large Language Models (LLMs) have drawn a lot of attention due to their strong performance on a wide range of natural language tasks, since the release of ChatGPT in November 2022. LLMs' ability of general-purpose language understanding and…

Computation and Language · Computer Science 2025-03-25 Shervin Minaee , Tomas Mikolov , Narjes Nikzad , Meysam Chenaghlu , Richard Socher , Xavier Amatriain , Jianfeng Gao

Analogical reasoning, the transfer of relational structures across contexts (e.g., planet is to sun as electron is to nucleus), is fundamental to scientific discovery. Yet human insight is often constrained by domain expertise and…

Machine Learning · Computer Science 2025-10-28 Hongyu Guo

Scientific problem-solving involves synthesizing information while applying expert knowledge. We introduce CURIE, a scientific long-Context Understanding,Reasoning and Information Extraction benchmark to measure the potential of Large…

Large language models (LLMs) demonstrate promising translation performance among various natural languages. However, many LLMs especially the open-sourced ones, such as BLOOM and LLaMA, are English-dominant and support only dozens of…

Computation and Language · Computer Science 2023-11-22 Wen Yang , Chong Li , Jiajun Zhang , Chengqing Zong

Large Language Models (LLMs) and AI assistants driven by these models are experiencing exponential growth in usage among both expert and amateur users. In this work, we focus on evaluating the reliability of current LLMs as science…

Computation and Language · Computer Science 2024-09-24 Prasoon Bajpai , Niladri Chatterjee , Subhabrata Dutta , Tanmoy Chakraborty

Large Language Models (LLMs) have the potential of facilitating the development of Artificial Intelligence technology to assist medical experts for interactive decision support, which has been demonstrated by their competitive performances…

Computation and Language · Computer Science 2024-11-12 Iñigo Alonso , Maite Oronoz , Rodrigo Agerri

Researchers often rely on humans to code (label, annotate, etc.) large sets of texts. This kind of human coding forms an important part of social science research, yet the coding process is both resource intensive and highly variable from…

Artificial Intelligence · Computer Science 2023-06-06 Christopher Michael Rytting , Taylor Sorensen , Lisa Argyle , Ethan Busby , Nancy Fulda , Joshua Gubler , David Wingate

To retrieve and compare scientific data of simulations and experiments in materials science, data needs to be easily accessible and machine readable to qualify and quantify various materials science phenomena. The recent progress in open…

Materials Science · Physics 2025-03-25 Balduin Katzer , Steffen Klinder , Katrin Schulz

We present Innovator-VL, a scientific multimodal large language model designed to advance understanding and reasoning across diverse scientific domains while maintaining excellent performance on general vision tasks. Contrary to the trend…

The rapid evolution of large language models (LLMs) holds promise for reforming the methodology of spatio-temporal data mining. However, current works for evaluating the spatio-temporal understanding capability of LLMs are somewhat limited…

Computation and Language · Computer Science 2024-06-28 Wenbin Li , Di Yao , Ruibo Zhao , Wenjie Chen , Zijie Xu , Chengxue Luo , Chang Gong , Quanliang Jing , Haining Tan , Jingping Bi

Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding capability, LLMs are capable of processing text layouts that…

Computation and Language · Computer Science 2024-08-29 Weiming Li , Manni Duan , Dong An , Yan Shao