English
Related papers

Related papers: Text-Augmented Multimodal LLMs for Chemical Reacti…

200 papers

Large Language Models (LLMs) with strong abilities in natural language processing tasks have emerged and have been applied in various kinds of areas such as science, finance and software engineering. However, the capability of LLMs to…

Computation and Language · Computer Science 2023-12-29 Taicheng Guo , Kehan Guo , Bozhao Nan , Zhenwen Liang , Zhichun Guo , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

This paper proposes one of the first clinical applications of multimodal large language models (LLMs) as an assistant for radiologists to check errors in their reports. We created an evaluation dataset from real-world radiology datasets…

Computation and Language · Computer Science 2024-03-05 Jinge Wu , Yunsoo Kim , Eva C. Keller , Jamie Chow , Adam P. Levine , Nikolas Pontikos , Zina Ibrahim , Paul Taylor , Michelle C. Williams , Honghan Wu

Large language models (LLMs) famously exhibit emergent in-context learning (ICL) -- the ability to rapidly adapt to new tasks using few-shot examples provided as a prompt, without updating the model's weights. Built on top of LLMs, vision…

Machine Learning · Computer Science 2025-04-02 Yongshuo Zong , Ondrej Bohdal , Timothy Hospedales

Large language models (LLMs) enhanced with retrieval augmentation has shown great performance in many applications. However, the computational demands for these models pose a challenge when applying them to real-time tasks, such as…

Computation and Language · Computer Science 2024-10-15 Menglin Xia , Xuchao Zhang , Camille Couturier , Guoqing Zheng , Saravan Rajmohan , Victor Ruhle

The advancement and extensive application of large language models (LLMs) have been remarkable, including their use in scientific research assistance. However, these models often generate scientifically incorrect or unsafe responses, and in…

Computation and Language · Computer Science 2024-11-28 Haochen Zhao , Xiangru Tang , Ziran Yang , Xiao Han , Xuanzhi Feng , Yueqing Fan , Senhao Cheng , Di Jin , Yilun Zhao , Arman Cohan , Mark Gerstein

As healthcare increasingly turns to AI for scalable and trustworthy clinical decision support, ensuring reliability in model reasoning remains a critical challenge. Individual large language models (LLMs) are susceptible to hallucinations…

Machine Learning · Computer Science 2025-12-05 Huascar Sanchez , Briland Hitaj , Jules Bergmann , Linda Briesemeister

In recent years, Large Language Models (LLMs) have achieved significant success in natural language processing (NLP) and various interdisciplinary areas. However, applying LLMs to chemistry is a complex task that requires specialized domain…

Machine Learning · Computer Science 2024-02-05 Chang Liao , Yemin Yu , Yu Mei , Ying Wei

Chemistry plays a crucial role in many domains, such as drug discovery and material science. While large language models (LLMs) such as GPT-4 exhibit remarkable capabilities on natural language processing tasks, existing research indicates…

Artificial Intelligence · Computer Science 2024-08-13 Botao Yu , Frazier N. Baker , Ziqi Chen , Xia Ning , Huan Sun

Goal-oriented de novo molecule design, namely generating molecules with specific property or substructure constraints, is a crucial yet challenging task in drug discovery. Existing methods, such as Bayesian optimization and reinforcement…

Computational Engineering, Finance, and Science · Computer Science 2025-02-28 Chuanliu Fan , Ziqiang Cao , Zicheng Ma , Nan Yu , Yimin Peng , Jun Zhang , Yiqin Gao , Guohong Fu

Large Language Models demonstrate substantial promise for advancing scientific discovery, yet their deployment in disciplines demanding factual precision and specialized domain constraints presents significant challenges. Within molecular…

Machine Learning · Computer Science 2026-02-23 Malikussaid , Hilal Hudan Nuha , Isman Kurniawan

Multimodal Large Language Models (MLLMs), built on powerful language backbones, have enabled Multimodal In-Context Learning (MICL)-adapting to new tasks from a few multimodal demonstrations consisting of images, questions, and answers.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Shuo Chen , Jianzhe Liu , Zhen Han , Yan Xia , Daniel Cremers , Philip Torr , Volker Tresp , Jindong Gu

Multimodal Large Language Models (MLLMs) have achieved notable performance in computer vision tasks that require reasoning across visual and textual modalities, yet their capabilities are limited to their pre-trained data, requiring…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Mirco Bonomo , Simone Bianco

The integration of Retrieval-Augmented Generation (RAG) with Multimodal Large Language Models (MLLMs) has revolutionized information retrieval and expanded the practical applications of AI. However, current systems struggle in accurately…

Computation and Language · Computer Science 2025-03-24 Dongyoung Go , Taesun Whang , Chanhee Lee , Hwa-Yeon Kim , Sunghoon Park , Seunghwan Ji , Jinho Kim , Dongchan Kim , Young-Bum Kim

Artificial intelligence (AI) has played an increasingly important role in chemical research. However, most models currently used in chemistry are specialist models that require training and tuning for specific tasks. A more generic and…

Computation and Language · Computer Science 2025-07-03 Zihan Zhao , Da Ma , Lu Chen , Liangtai Sun , Zihao Li , Yi Xia , Bo Chen , Hongshen Xu , Zichen Zhu , Su Zhu , Shuai Fan , Guodong Shen , Kai Yu , Xin Chen

The synthesis of inorganic crystalline materials is essential for modern technology, especially in quantum materials development. However, designing efficient synthesis workflows remains a significant challenge due to the precise…

Recently, large language models (LLMs) have notably positioned them as capable tools for addressing complex optimization challenges. Despite this recognition, a predominant limitation of existing LLM-based optimization methods is their…

Artificial Intelligence · Computer Science 2024-03-05 Yuxiao Huang , Wenjie Zhang , Liang Feng , Xingyu Wu , Kay Chen Tan

Current benchmarks for evaluating the chemical reasoning capabilities of Large Language Models (LLMs) are limited by oversimplified tasks, lack of process-level evaluation, and misalignment with expert-level chemistry skills. To address…

The emergence of in-context learning (ICL) enables large pre-trained language models (PLMs) to make predictions for unseen inputs without updating parameters. Despite its potential, ICL's effectiveness heavily relies on the quality,…

Machine Learning · Computer Science 2024-07-02 Xiaoling Zhou , Wei Ye , Yidong Wang , Chaoya Jiang , Zhemg Lee , Rui Xie , Shikun Zhang

Large Language Models (LLMs) are increasingly used for clinical decision support, where hallucinations and unsafe suggestions may pose direct risks to patient safety. These risks are hard to assess: subtle clinical errors are often missed…

Computation and Language · Computer Science 2026-05-14 Yinzhu Chen , Abdine Maiga , Hossein A. Rahmani , Emine Yilmaz