English
Related papers

Related papers: Multimodal Generative Engine Optimization: Rank Ma…

200 papers

Vision Large Language Models (VLLMs) represent a significant advancement in artificial intelligence by integrating image-processing capabilities with textual understanding, thereby enhancing user interactions and expanding application…

Computation and Language · Computer Science 2025-05-09 Madhur Jindal , Saurabh Deshpande

Vision-Language-Action models (VLAs) have recently demonstrated remarkable progress in embodied environments, enabling robots to perceive, reason, and act through unified multimodal understanding. Despite their impressive capabilities, the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yuping Yan , Yuhan Xie , Yixin Zhang , Lingjuan Lyu , Handing Wang , Yaochu Jin

Engineering design optimization requires an efficient combination of a 3D shape representation, an optimization algorithm, and a design performance evaluation method, which is often computationally expensive. We present a prompt evolution…

Artificial Intelligence · Computer Science 2024-08-13 Melvin Wong , Thiago Rios , Stefan Menzel , Yew Soon Ong

Generative search engines represent a transition from traditional ranking-based retrieval to Large Language Model (LLM)-based synthesis, transforming optimization goals from ranking prominence towards content inclusion. Generative Engine…

Artificial Intelligence · Computer Science 2026-03-24 Jiaqi Yuan , Jialu Wang , Zihan Wang , Qingyun Sun , Ruijie Wang , Jianxin Li

The rapid advancement of Large Vision-Language Models (LVLMs) is increasingly accompanied by unauthorized scraping and training on multimodal web data, posing severe copyright and privacy risks to data owners. Existing countermeasures, such…

Cryptography and Security · Computer Science 2026-05-15 Chengshuai Zhao , Zhen Tan , Dawei Li , Zhiyuan Yu , Huan Liu

Effective content moderation is essential for video platforms to safeguard user experience and uphold community standards. While traditional video classification models effectively handle well-defined moderation tasks, they struggle with…

Machine Learning · Computer Science 2025-07-24 Zixuan Wang , Jinghao Shi , Hanzhong Liang , Xiang Shen , Vera Wen , Zhiqian Chen , Yifan Wu , Zhixin Zhang , Hongyu Xiong

Vision Language Models (VLMs) achieved rapid progress in the recent years. However, despite their growth, VLMs development is heavily grounded on English, leading to two main limitations: (i) the lack of multilingual and multimodal datasets…

Computation and Language · Computer Science 2026-04-21 Daniela Baiamonte , Elena Fano , Matteo Gabburo , Stefano Simonazzi , Leonardo Rigutini , Andrea Zugarini

Evolutionary model merging provides a powerful framework for the automated, training-free composition of LLMs through parameter-space search. However, existing methods predominantly rely on stochastic, hand-crafted operators that overlook…

Neural and Evolutionary Computing · Computer Science 2026-05-29 Tao Jiang , Xinmeng Yu , Chenhao Yi , Yiling Wu , Yan Li , Ran Cheng , Dongmei Jiang , Jianguo Zhang

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

Vision-Language Encoders (VLEs) are widely adopted as the backbone of zero-shot referring image segmentation (RIS), enabling text-guided localization without task-specific training. However, prior works underexplored the underlying biases…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Na Min An , Inha Kang , Minhyun Lee , Hyunjung Shim

Recent advances in Vision-Language Models (VLMs) have enabled unified understanding across text and images, yet equipping these models with robust image generation capabilities remains challenging. Existing approaches often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiangyi Chen , Théophane Vallaeys , Maha Elbayad , John Nguyen , Jakob Verbeek

In this work, we focus on unsupervised vision-language-action mapping in the area of robotic manipulation. Recently, multiple approaches employing pre-trained large language and vision models have been proposed for this task. However, they…

Robotics · Computer Science 2025-05-29 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

LLM-based optimization has shown remarkable potential in enhancing agentic systems. However, the conventional approach of prompting LLM optimizer with the whole training trajectories on training dataset in a single pass becomes untenable as…

Computation and Language · Computer Science 2025-05-08 Jiale Liu , Yifan Zeng , Shaokun Zhang , Chi Zhang , Malte Højmark-Bertelsen , Marie Normann Gadeberg , Huazheng Wang , Qingyun Wu

Vision-Language Models (VLMs) have shown strong performance in tasks like visual question answering and multimodal text generation, but their effectiveness in scientific domains such as materials science remains limited. While some machine…

Machine Learning · Computer Science 2025-11-11 An Vuong , Minh-Hao Van , Prateek Verma , Chen Zhao , Xintao Wu

Sequential Recommendation (SR) in multimodal settings typically relies on small frozen pretrained encoders, which limits semantic capacity and prevents Collaborative Filtering (CF) signals from being fully integrated into item…

Information Retrieval · Computer Science 2026-03-19 Junyoung Kim , Woojoo Kim , Jaehyung Lim , Dongha Kim , Hwanjo Yu

The recent advancement in video temporal grounding (VTG) has significantly enhanced fine-grained video understanding, primarily driven by multimodal large language models (MLLMs). With superior multimodal comprehension and reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Jianlong Wu , Wei Liu , Ye Liu , Meng Liu , Liqiang Nie , Zhouchen Lin , Chang Wen Chen

Video-Language Models (VLMs) have demonstrated impressive multi-modal reasoning capabilities across diverse computer vision applications. However, these VLMs are task-specific and assume that both video and language inputs are complete.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xiang Fang , Wanlong Fang , Changshuo Wang , Keke Tang , Daizong Liu , Siyi Wang , Wei Ji

While adversarial neural networks have been shown successful for static image attacks, very few approaches have been developed for attacking online image streams while taking into account the underlying physical dynamics of autonomous…

Robotics · Computer Science 2021-05-19 Hyung-Jin Yoon , Hamidreza Jafarnejadsani , Petros Voulgaris

Surgical triplet recognition, which involves identifying instrument, verb, target, and their combinations, is a complex surgical scene understanding challenge plagued by long-tailed data distribution. The mainstream multi-task learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yiyi Zhang , Yuchen Yuan , Ying Zheng , Jialun Pei , Jinpeng Li , Zheng Li , Pheng-Ann Heng

With the powerful reasoning capabilities of large language models (LLMs) and vision-language models (VLMs), many recent works have explored using them for decision-making. However, most of these approaches rely solely on language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yihao Sun , Zhilong Zhang , Yang Yu , Pierre-Luc Bacon