English
Related papers

Related papers: DARWIN Series: Domain Specific Large Language Mode…

200 papers

Much of the recent success of Artificial Intelligence (AI) has been spurred on by impressive achievements within a broader family of machine learning methods, commonly referred to as Deep Learning (DL). This paper provides insights on the…

Computers and Society · Computer Science 2020-09-07 Stefano Bianchini , Moritz Müller , Pierre Pelletier

With the rapid development of large language models in recent years, there has been an increasing demand for domain-specific Agents that can cater to the unique needs of enterprises and organizations. Unlike general models, which strive for…

Computation and Language · Computer Science 2024-08-13 Chih-Wei Song , Yu-Kai Lee , Yin-Te Tsai

To retrieve and compare scientific data of simulations and experiments in materials science, data needs to be easily accessible and machine readable to qualify and quantify various materials science phenomena. The recent progress in open…

Materials Science · Physics 2025-03-25 Balduin Katzer , Steffen Klinder , Katrin Schulz

We present SciRIFF (Scientific Resource for Instruction-Following and Finetuning), a dataset of 137K instruction-following instances for training and evaluation, covering 54 tasks. These tasks span five core scientific literature…

The cognitive sciences aim to understand intelligence by formalizing underlying operations as computational models. Traditionally, this follows a cycle of discovery where researchers develop paradigms, collect data, and test predefined…

Artificial Intelligence · Computer Science 2026-03-24 Akshay K. Jagadish , Milena Rmus , Kristin Witte , Marvin Mathony , Marcel Binz , Eric Schulz

Clinical natural language processing requires methods that can address domain-specific challenges, such as complex medical terminology and clinical contexts. Recently, large language models (LLMs) have shown promise in this domain. Yet,…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hejie Cui , Yue Yu , Xuan Kan , Wenqi Shi , Yuchen Zhuang , Wei Jin , Joyce Ho , Carl Yang

As scientific research becomes increasingly complex, innovative tools are needed to manage vast data, facilitate interdisciplinary collaboration, and accelerate discovery. Large language models (LLMs) are now evolving into LLM-based…

Artificial Intelligence · Computer Science 2026-02-03 Shuo Ren , Can Xie , Pu Jian , Zhenjiang Ren , Chunlin Leng , Jiajun Zhang

Foundation models have revolutionized natural language processing and artificial intelligence, significantly enhancing how machines comprehend and generate human languages. Inspired by the success of these foundation models, researchers…

Large language models (LLMs) have been touted to enable increased productivity in many areas of today's work life. Scientific research as an area of work is no exception: the potential of LLM-based tools to assist in the daily work of…

Software Engineering · Computer Science 2024-04-24 Mohamed Nejjar , Luca Zacharias , Fabian Stiehle , Ingo Weber

Large Language Models (LLMs) have demonstrated remarkable success in various tasks such as natural language understanding, text summarization, and machine translation. However, their general-purpose nature often limits their effectiveness…

Computation and Language · Computer Science 2025-09-03 Zirui Song , Bin Yan , Yuhan Liu , Miao Fang , Mingzhe Li , Rui Yan , Xiuying Chen

In many scientific fields, large language models (LLMs) have revolutionized the way text and other modalities of data (e.g., molecules and proteins) are handled, achieving superior performance in various applications and augmenting the…

Computation and Language · Computer Science 2024-10-01 Yu Zhang , Xiusi Chen , Bowen Jin , Sheng Wang , Shuiwang Ji , Wei Wang , Jiawei Han

With recent Nobel Prizes recognising AI contributions to science, Large Language Models (LLMs) are transforming scientific research by enhancing productivity and reshaping the scientific method. LLMs are now involved in experimental design,…

Recent progress in large language model (LLM) reasoning has focused on domains like mathematics and coding, where abundant high-quality data and objective evaluation metrics are readily available. In contrast, progress in LLM reasoning…

Artificial Intelligence · Computer Science 2026-01-12 Tengxiao Liu , Deepak Nathani , Zekun Li , Kevin Yang , William Yang Wang

The relentless expansion of scientific literature presents significant challenges for navigation and knowledge discovery. Within Research Information Retrieval, established tasks such as text summarization and classification remain crucial…

Information Retrieval · Computer Science 2026-04-28 Gautam Kishore Shahi , Oliver Hummel

In this paper, we describe the capabilities and constraints of Large Language Models (LLMs) within disparate academic disciplines, aiming to delineate their strengths and limitations with precision. We examine how LLMs augment scientific…

Scientific literature is growing exponentially, creating a critical bottleneck for researchers to efficiently synthesize knowledge. While general-purpose Large Language Models (LLMs) show potential in text processing, they often fail to…

Computation and Language · Computer Science 2025-09-11 Fengyu She , Nan Wang , Hongfei Wu , Ziyi Wan , Jingmian Wang , Chang Wang

The world is facing a multitude of challenges that hinder the development of human civilization and the well-being of humanity on the planet. The Sustainable Development Goals (SDGs) were formulated by the United Nations in 2015 to address…

Computation and Language · Computer Science 2025-06-09 Francesco Invernici , Francesca Curati , Jelena Jakimov , Amirhossein Samavi , Anna Bernasconi

We address the task of hierarchical multi-label classification (HMC) of scientific documents at an industrial scale, where hundreds of thousands of documents must be classified across thousands of dynamic labels. The rapid growth of…

Artificial Intelligence · Computer Science 2024-12-09 Seyed Amin Tabatabaei , Sarah Fancher , Michael Parsons , Arian Askari

Large language models (LLMs) are becoming increasingly better at a wide range of Natural Language Processing tasks (NLP), such as text generation and understanding. Recently, these models have extended their capabilities to coding tasks,…

Machine Learning · Computer Science 2024-10-23 Nishat Raihan , Mohammed Latif Siddiq , Joanna C. S. Santos , Marcos Zampieri

Conducting literature reviews for scientific papers is essential for understanding research, its limitations, and building on existing work. It is a tedious task which makes an automatic literature review generator appealing. Unfortunately,…