English
Related papers

Related papers: Breaking the Modality Barrier: Generative Modeling…

200 papers

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Current state-of-the-art approaches to cross-modal retrieval process text and visual input jointly, relying on Transformer-based architectures with cross-attention mechanisms that attend over all words and objects in an image. While…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Gregor Geigle , Jonas Pfeiffer , Nils Reimers , Ivan Vulić , Iryna Gurevych

Discovery of novel and promising materials is a critical challenge in the field of chemistry and material science, traditionally approached through methodologies ranging from trial-and-error to machine learning-driven inverse design. Recent…

Machine Learning · Computer Science 2024-12-13 Dong Hyeon Mok , Seoin Back

The development of large language models and multi-modal models has enabled the appealing idea of generating novel molecules from text descriptions. Generative modeling would shift the paradigm from relying on large-scale chemical screening…

Machine Learning · Computer Science 2025-08-25 Yifan Deng , Spencer S. Ericksen , Anthony Gitter

Retrieving information from EHR systems is essential for answering specific questions about patient journeys and improving the delivery of clinical care. Despite this fact, most EHR systems still rely on keyword-based searches. With the…

Computation and Language · Computer Science 2024-04-11 Shashi Kant Gupta , Aditya Basu , Bradley Taylor , Anai Kothari , Hrituraj Singh

Generative models have made it possible to synthesize highly realistic images, potentially providing an abundant data source for training machine learning models. Despite the advantages of these synthesizable data sources, the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Shentong Mo , Sukmin Yun

CO2 reduction requires efficient catalysts, yet materials discovery remains bottlenecked by 10-20 year development cycles requiring deep domain expertise. This paper demonstrates how large language models can assist the catalyst discovery…

Materials Science · Physics 2026-03-18 AI Scientists , Xinyi Lin , Danqing Yin , Ying Guo

Large Language Models (LLMs) achieve strong performance across diverse tasks, but their effectiveness often depends on the quality of the provided context. Retrieval-Augmented Generation (RAG) enriches prompts with external information, but…

Computation and Language · Computer Science 2025-10-02 Oussama Gabouj , Kamel Charaf , Ivan Zakazov , Nicolas Baldwin , Robert West

Molecular machine learning has gained popularity with the advancements of geometric deep learning. In parallel, retrieval-augmented generation has become a principled approach commonly used with language models. However, the optimal…

Machine Learning · Computer Science 2025-07-04 Runzhong Wang , Rui-Xi Wang , Mrunali Manjrekar , Connor W. Coley

Large language models (LLMs) have gained significant attention in various fields but prone to hallucination, especially in knowledge-intensive (KI) tasks. To address this, retrieval-augmented generation (RAG) has emerged as a popular…

Computation and Language · Computer Science 2024-04-23 Xiaoxi Li , Zhicheng Dou , Yujia Zhou , Fangchao Liu

Multimodal Retrieval-Augmented Generation (MRAG) has emerged as a promising method to generate factual and up-to-date responses of Multimodal Large Language Models (MLLMs) by incorporating non-parametric knowledge from external knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Shu Zhao , Tianyi Shen , Nilesh Ahuja , Omesh Tickoo , Vijaykrishnan Narayanan

Generative retrieval seeks to replace traditional search index data structures with a single large-scale neural network, offering the potential for improved efficiency and seamless integration with generative large language models. As an…

Information Retrieval · Computer Science 2025-04-15 Shiguang Wu , Zhaochun Ren , Xin Xin , Jiyuan Yang , Mengqi Zhang , Zhumin Chen , Maarten de Rijke , Pengjie Ren

Recent advances in molecular generative models have demonstrated great promise for accelerating scientific discovery, particularly in drug design. However, these models often struggle to generate high-quality molecules, especially in…

Machine Learning · Computer Science 2025-07-29 Zian Li , Cai Zhou , Xiyuan Wang , Xingang Peng , Muhan Zhang

Generalized Category Discovery (GCD) aims to identify both known and unknown categories, with only partial labels given for the known categories, posing a challenging open-set recognition problem. State-of-the-art approaches for GCD task…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wei He , Xianghan Meng , Zhiyuan Huang , Xianbiao Qi , Rong Xiao , Chun-Guang Li

Accurately identifying metabolites i.e. small molecules from mass spectrometry data remains a core challenge in metabolomics, with broad applications in drug discovery, environmental analysis, and clinical research. We address the Molecule…

Multi-modal Retrieval-Augmented Generation (MMRAG) has emerged as a powerful paradigm for enhancing Multimodal Large Language Models in knowledge-intensive question answering by integrating external visual, textual, and structural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiang Fang , Wanlong Fang , Changshuo Wang

The aim of the inverse chemical design is to develop new molecules with given optimized molecular properties or objectives. Recently, generative deep learning (DL) networks are considered as the state-of-the-art in inverse chemical design…

Machine Learning · Computer Science 2019-10-10 Haoran Wei , Mariefel Olarte , Garrett B. Goh

Retrieval plays a fundamental role in recommendation systems, search, and natural language processing (NLP) by efficiently finding relevant items from a large corpus given a query. Dot products have been widely used as the similarity…

Information Retrieval · Computer Science 2025-01-28 Bailu Ding , Jiaqi Zhai

Retrieval-Augmented Generation (RAG) systems leverage Large Language Models (LLMs) to generate accurate and reliable responses that are grounded in retrieved context. However, LLMs often generate inconsistent outputs for semantically…

Computation and Language · Computer Science 2025-10-17 Xujun Peng , Anoop Kumar , Jingyu Wu , Parker Glenn , Daben Liu
‹ Prev 1 3 4 5 6 7 10 Next ›