English
Related papers

Related papers: Prior Knowledge Integration via LLM Encoding and P…

200 papers

Vision Language Models (VLMs), which extend Large Language Models (LLM) by incorporating visual understanding capability, have demonstrated significant advancements in addressing open-ended visual question-answering (VQA) tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Wenbo Hu , Yifan Xu , Yi Li , Weiyue Li , Zeyuan Chen , Zhuowen Tu

Video Large Language Models (VideoLLMs) excel at video understanding tasks where outputs are textual, such as Video Question Answering and Video Captioning. However, they underperform specialized embedding-based models in Retrieval tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Rohit Gupta , Jayakrishnan Unnikrishnan , Fan Fei , Sheng Liu , Son Tran , Mubarak Shah

In the current literature, most embedding models are based on the encoder-only transformer architecture to extract a dense and meaningful representation of the given input, which can be a text, an image, and more. With the recent advances…

Computation and Language · Computer Science 2025-03-18 Elio Musacchio , Lucia Siciliani , Pierpaolo Basile , Giovanni Semeraro

Brain-related research topics in artificial intelligence have recently gained popularity, particularly due to the expansion of what multimodal architectures can do from computer vision to natural language processing. Our main goal in this…

Neurons and Cognition · Quantitative Biology 2024-10-01 Youssef Hmamouche , Ismail Chihab , Lahoucine Kdouri , Amal El Fallah Seghrouchni

In the realm of Sign Language Translation (SLT), reliance on costly gloss-annotated datasets has posed a significant barrier. Recent advancements in gloss-free SLT methods have shown promise, yet they often largely lag behind gloss-based…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Han Liang , Chengyu Huang , Yuecheng Xu , Cheng Tang , Weicai Ye , Juze Zhang , Xin Chen , Jingyi Yu , Lan Xu

Multimodal large language models (MLLMs) demonstrate remarkable capabilities in handling complex multimodal tasks and are increasingly adopted in video understanding applications. However, their rapid advancement raises serious data privacy…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Qi Li , Runpeng Yu , Xinchao Wang

Human action recognition in long-term videos, characterized by complex backgrounds and subtle action differences, poses significant challenges for traditional deep learning models due to computational overhead, difficulty in capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Kaining Li , Shuwei He , Zihan Xu

In video analysis, understanding the temporal context is crucial for recognizing object interactions, event patterns, and contextual changes over time. The proposed model leverages adjacency and semantic similarities between objects from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ahnaf Farhan , M. Shahriar Hossain

Recently, Large Multi-modal Models (LMMs) have demonstrated their ability to understand the visual contents of images given the instructions regarding the images. Built upon the Large Language Models (LLMs), LMMs also inherit their…

Artificial Intelligence · Computer Science 2024-05-14 Joonhyun Jeong

Legal case retrieval is a critical process for modern legal information systems. While recent studies have utilized pre-trained language models (PLMs) based on the general domain self-supervised pre-training paradigm to build models for…

Information Retrieval · Computer Science 2023-05-10 Yixiao Ma , Yueyue Wu , Weihang Su , Qingyao Ai , Yiqun Liu

Vision-Language models (VLMs) have excelled in the image-domain -- especially in zero-shot settings -- thanks to the availability of vast pretraining data (i.e., paired image-text samples). However for videos, such paired data is not as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Kumara Kahatapitiya , Anurag Arnab , Arsha Nagrani , Michael S. Ryoo

With the booming of Large Language Models (LLMs), prompt-learning has become a promising method mainly researched in various research areas. Recently, many attempts based on prompt-learning have been made to improve the performance of text…

Computation and Language · Computer Science 2024-06-07 Chun Liu , Hongguang Zhang , Kainan Zhao , Xinghai Ju , Lin Yang

Embedding models are crucial for various natural language processing tasks but can be limited by factors such as limited vocabulary, lack of context, and grammatical errors. This paper proposes a novel approach to improve embedding…

Computation and Language · Computer Science 2024-04-19 Nicholas Harris , Anand Butani , Syed Hashmy

Video Temporal Grounding (VTG) strives to accurately pinpoint event timestamps in a specific video using linguistic queries, significantly impacting downstream tasks like video browsing and editing. Unlike traditional task-specific models,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yongxin Guo , Jingyu Liu , Mingda Li , Dingxin Cheng , Xiaoying Tang , Dianbo Sui , Qingbin Liu , Xi Chen , Kevin Zhao

Multimodal large language models (MLLMs) require a nuanced interpretation of complex image information, typically leveraging a vision encoder to perceive various visual scenarios. However, relying solely on a single vision encoder to handle…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Xin He , Xumeng Han , Longhui Wei , Lingxi Xie , Qi Tian

The advent of Large Multimodal Models (LMMs) has significantly enhanced Large Language Models (LLMs) to process and interpret diverse data modalities (e.g., image and video). However, as input complexity increases, particularly with long…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Shilin Yan , Jiaming Han , Joey Tsai , Hongwei Xue , Rongyao Fang , Lingyi Hong , Ziyu Guo , Ray Zhang

Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multimodal tasks, but their performance is often constrained by the lack of external knowledge integration, limiting their ability to handle…

Computation and Language · Computer Science 2025-01-16 Julian Perry , Surasakdi Siripong , Thanakorn Phonchai

Video large language models (Video-LLMs) can temporally ground language queries and retrieve video moments. Yet, such temporal comprehension capabilities are neither well-studied nor understood. So we conduct a study on prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Minjoon Jung , Junbin Xiao , Byoung-Tak Zhang , Angela Yao

While advancements in Vision Language Models (VLMs) have significantly improved the alignment of visual and textual data, these models primarily focus on aligning images with short descriptive captions. This focus limits their ability to…

Computation and Language · Computer Science 2024-07-16 Young Kyun Jang , Junmo Kang , Yong Jae Lee , Donghyun Kim

Vector embeddings derived from large language models (LLMs) show promise in capturing latent information from the literature. Interestingly, these can be integrated into material embeddings, potentially useful for data-driven predictions of…

Computation and Language · Computer Science 2024-09-19 Luke P. J. Gilligan , Matteo Cobelli , Hasan M. Sayeed , Taylor D. Sparks , Stefano Sanvito