English
Related papers

Related papers: Leveraging Large Language Models for Multimodal Se…

200 papers

Evolutionary algorithms excel in solving complex optimization problems, especially those with multiple objectives. However, their stochastic nature can sometimes hinder rapid convergence to the global optima, particularly in scenarios…

Neural and Evolutionary Computing · Computer Science 2024-05-10 Zeyi Wang , Songbai Liu , Jianyong Chen , Kay Chen Tan

The rapid evolution of Multimodal Large Language Models (MLLMs) has brought substantial advancements in artificial intelligence, significantly enhancing the capability to understand and generate multimodal content. While prior studies have…

Artificial Intelligence · Computer Science 2024-09-30 Lin Li , Guikun Chen , Hanrong Shi , Jun Xiao , Long Chen

Logo embedding models convert the product logos in images into vectors, enabling their utilization for logo recognition and detection within e-commerce platforms. This facilitates the enforcement of intellectual property rights and enhances…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhen Wang , Da Li , Yulin Su , Min Yang , Minghui Qiu , Walton Wang

Image search stands as a pivotal task in multimedia and computer vision, finding applications across diverse domains, ranging from internet search to medical diagnostics. Conventional image search systems operate by accepting textual or…

Multimedia · Computer Science 2024-04-30 Hongyi Zhu , Jia-Hong Huang , Stevan Rudinac , Evangelos Kanoulas

This paper explores the development of the Six Stages of Information Search Model and its enhancement through the application of the Large Language Model (LLM) powered Information Search Processes (ISP) in healthcare. The Six Stages Model,…

Information Retrieval · Computer Science 2024-07-03 Forhan Bin Emdad , Mohammad Ishtiaque Rahman

The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Zhipeng Huang , Zhizheng Zhang , Zheng-Jun Zha , Yan Lu , Baining Guo

This study embarked on a comprehensive exploration of user preferences between Search Engines and Large Language Models (LLMs) in the context of various information retrieval scenarios. Conducted with a sample size of 100 internet users…

Information Retrieval · Computer Science 2024-01-12 Kevin Matthe Caramancion

This paper provides a comprehensive review of the integration of Large Language Models (LLMs) with visual analytics, addressing their foundational concepts, capabilities, and wide-ranging applications. It begins by outlining the theoretical…

Human-Computer Interaction · Computer Science 2025-03-20 Navya Sonal Agarwal , Sanjay Kumar Sonbhadra

Information retrieval (IR) plays a crucial role in locating relevant resources from vast amounts of data, and its applications have evolved from traditional knowledge bases to modern retrieval models (RMs). The emergence of large language…

Computation and Language · Computer Science 2023-12-13 Jiazhan Feng , Chongyang Tao , Xiubo Geng , Tao Shen , Can Xu , Guodong Long , Dongyan Zhao , Daxin Jiang

Traditional information extraction systems face challenges with text only language models as it does not consider infographics (visual elements of information) such as tables, charts, images etc. often used to convey complex information to…

Information Retrieval · Computer Science 2025-07-17 Rachna Saxena , Abhijeet Kumar , Suresh Shanmugam

Query understanding in Conversational Information Seeking (CIS) involves accurately interpreting user intent through context-aware interactions. This includes resolving ambiguities, refining queries, and adapting to evolving information…

Computation and Language · Computer Science 2025-04-10 Yifei Yuan , Zahra Abbasiantaeb , Yang Deng , Mohammad Aliannejadi

Simulating user search behavior is a critical task in information retrieval, which can be employed for user behavior modeling, data augmentation, and system evaluation. Recent advancements in large language models (LLMs) have opened up new…

Information Retrieval · Computer Science 2025-04-11 Erhan Zhang , Xingzhu Wang , Peiyuan Gong , Zixuan Yang , Jiaxin Mao

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive…

Information Retrieval · Computer Science 2024-06-19 Likang Wu , Zhi Zheng , Zhaopeng Qiu , Hao Wang , Hongchao Gu , Tingjia Shen , Chuan Qin , Chen Zhu , Hengshu Zhu , Qi Liu , Hui Xiong , Enhong Chen

Recent advances in the development of large language models are rapidly changing how online applications function. LLM-based search tools, for instance, offer a natural language interface that can accommodate complex queries and provide…

Human-Computer Interaction · Computer Science 2023-11-10 Sofia Eleni Spatharioti , David M. Rothschild , Daniel G. Goldstein , Jake M. Hofman

In this survey, we systematically analyze techniques used to adapt large multimodal models (LMMs) for low-resource (LR) languages, examining approaches ranging from visual enhancement and data creation to cross-modal transfer and fusion…

Computation and Language · Computer Science 2026-02-03 Marian Lupascu , Ana-Cristina Rogoz , Mihai Sorin Stupariu , Radu Tudor Ionescu

Web accessibility aims to ensure that web content and services are usable by people with diverse abilities. In recent years, Large Language Models (LLMs) have been increasingly explored to support accessibility-related tasks on the web,…

Digital Libraries · Computer Science 2026-05-15 Wajdi Aljedaani , Rubel Hassan Mollik

The paper underscores the significance of Large Language Models (LLMs) in reshaping recommender systems, attributing their value to unique reasoning abilities absent in traditional recommenders. Unlike conventional systems lacking direct…

Information Retrieval · Computer Science 2024-03-20 Arpita Vats , Vinija Jain , Rahul Raja , Aman Chadha

This paper introduces a system that integrates large language models (LLMs) into the clinical trial retrieval process, enhancing the effectiveness of matching patients with eligible trials while maintaining information privacy and allowing…

Information Retrieval · Computer Science 2024-11-01 Georgios Peikos , Pranav Kasela , Gabriella Pasi

Large language models (LLMs) are transforming how students learn by providing readily available tools that can quickly augment or complete various learning activities with non-trivial performance. Similar paradigm shifts have occurred in…

Human-Computer Interaction · Computer Science 2025-07-29 Rahul R. Divekar , Sophia Guerra , Lisette Gonzalez , Natasha Boos , Helen Zhou

Low-resource languages serve as invaluable repositories of human history, embodying cultural evolution and intellectual diversity. Despite their significance, these languages face critical challenges, including data scarcity and…