English
Related papers

Related papers: InternSVG: Towards Unified SVG Tasks with Multimod…

200 papers

Leveraging the universal representations of pre-trained LLMs and MLLMs offers a promising path toward brain foundation models. However, visually-evoked EEG datasets remain scarce, leading existing methods to align neural signals mainly with…

Artificial Intelligence · Computer Science 2026-05-26 Jun-Yu Pan , Yansen Wang , Enze Zhang , Bao-Liang Lu , Wei-Long Zheng , Dongsheng Li

Multi-task benchmarks such as GLUE and SuperGLUE have driven great progress of pretraining and transfer learning in Natural Language Processing (NLP). These benchmarks mostly focus on a range of Natural Language Understanding (NLU) tasks,…

Surgical triplet recognition, which involves identifying instrument, verb, target, and their combinations, is a complex surgical scene understanding challenge plagued by long-tailed data distribution. The mainstream multi-task learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yiyi Zhang , Yuchen Yuan , Ying Zheng , Jialun Pei , Jinpeng Li , Zheng Li , Pheng-Ann Heng

Vision-Language Models (VLMs) have emerged as powerful tools for image understanding tasks, yet their practical deployment remains hindered by significant architectural heterogeneity across model families. This paper introduces UVLM…

Machine Learning · Computer Science 2026-03-17 Joan Perez , Giovanni Fusco

For certain image generation tasks, vector graphics such as Scalable Vector Graphics (SVGs) offer clear benefits such as increased flexibility, size efficiency, and editing ease, but remain less explored than raster-based approaches. A core…

Machine Learning · Computer Science 2026-02-04 Michael Ogezi , Martin Bell , Freda Shi , Ethan Smith

Recent advances in unified multimodal models (UMMs) have enabled impressive progress in visual comprehension and generation. However, existing datasets and benchmarks focus primarily on single-turn interactions, failing to capture the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Wei Chow , Jiachun Pan , Yongyuan Liang , Mingze Zhou , Xue Song , Liyu Jia , Saining Zhang , Siliang Tang , Juncheng Li , Fengda Zhang , Weijia Wu , Hanwang Zhang , Tat-Seng Chua

Text-guided scalable vector graphics (SVG) synthesis has broad applications in icon and sketch generation. However, existing text-to-SVG methods often suffer from limited editability, suboptimal visual quality, and low sample diversity. To…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Ximing Xing , Haitao Zhou , Chuang Wang , Jing Zhang , Dong Xu , Qian Yu

Scene Graph Generation (SGG) has achieved significant progress recently. However, most previous works rely heavily on fixed-size entity representations based on bounding box proposals, anchors, or learnable queries. As each representation's…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Hengyue Liu , Bir Bhanu

Foundation language models obtain the instruction-following ability through supervised fine-tuning (SFT). Diversity and complexity are considered critical factors of a successful SFT dataset, while their definitions remain obscure and lack…

Computation and Language · Computer Science 2023-08-16 Keming Lu , Hongyi Yuan , Zheng Yuan , Runji Lin , Junyang Lin , Chuanqi Tan , Chang Zhou , Jingren Zhou

Multimodal Large Language Models (MLLMs) have revolutionized numerous research fields, including computer vision and affective computing. As a pivotal challenge in this interdisciplinary domain, facial expression recognition (FER) has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Fan Zhang , Haoxuan Li , Shengju Qian , Xin Wang , Zheng Lian , Hao Wu , Zhihong Zhu , Yuan Gao , Qiankun Li , Yefeng Zheng , Zhouchen Lin , Pheng-Ann Heng

Reliable evaluation benchmarks designed for replicability and comprehensiveness have driven progress in machine learning. Due to the lack of a multilingual benchmark, however, vision-and-language research has mostly focused on English…

Computation and Language · Computer Science 2022-07-19 Emanuele Bugliarello , Fangyu Liu , Jonas Pfeiffer , Siva Reddy , Desmond Elliott , Edoardo Maria Ponti , Ivan Vulić

The manufacturing sector is increasingly adopting Multimodal Large Language Models (MLLMs) to transition from simple perception to autonomous execution, yet current evaluations fail to reflect the rigorous demands of real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiangru Jian , Hao Xu , Wei Pang , Xinjian Zhao , Chengyu Tao , Qixin Zhang , Xikun Zhang , Chao Zhang , Guanzhi Deng , Alex Xue , Juan Du , Tianshu Yu , Garth Tarr , Linqi Song , Qiuzhuang Sun , Dacheng Tao

As large language models (LLMs) achieve strong performance on traditional benchmarks, there is an urgent need for more challenging evaluation frameworks that probe deeper aspects of semantic understanding. We introduce SAGE (Semantic…

Artificial Intelligence · Computer Science 2025-09-26 Samarth Goel , Reagan J. Lee , Kannan Ramchandran

Recent advances in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities. However, evaluating their capacity for human-like understanding in One-Image Guides remains insufficiently explored. One-Image Guides are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiancong Xie , Wenjin Wang , Zhuomeng Zhang , Zihan Liu , Qi Liu , Ke Feng , Zixun Sun , Yuedong Yang

Despite significant progress in Text-to-Image (T2I) generative models, even lengthy and complex text descriptions still struggle to convey detailed controls. In contrast, Layout-to-Image (L2I) generation, aiming to generate realistic and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Chengyou Jia , Minnan Luo , Zhuohang Dang , Guang Dai , Xiaojun Chang , Mengmeng Wang , Jingdong Wang

In this paper, we introduce a Multimodal Large Language Model-based Generation Assistant (LLMGA), leveraging the vast reservoir of knowledge and proficiency in reasoning, comprehension, and response inherent in Large Language Models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Bin Xia , Shiyin Wang , Yingfan Tao , Yitong Wang , Jiaya Jia

Representation learning on text-attributed graphs (TAGs), where nodes are represented by textual descriptions, is crucial for textual and relational knowledge systems and recommendation systems. Currently, state-of-the-art embedding methods…

Computation and Language · Computer Science 2024-12-24 Yi Fang , Dongzhe Fan , Sirui Ding , Ninghao Liu , Qiaoyu Tan

The scaling of large language models to encode all the world's knowledge in model parameters is unsustainable and has exacerbated resource barriers. Retrieval-Augmented Generation (RAG) presents a potential solution, yet its application to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Varun Nagaraj Rao , Siddharth Choudhary , Aditya Deshpande , Ravi Kumar Satzoda , Srikar Appalaraju

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

Video Temporal Grounding (VTG), the task of localizing video segments from text queries, struggles in open-world settings due to limited dataset scale and semantic diversity, causing performance gaps between common and rare concepts. To…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Minghang Zheng , Zihao Yin , Yi Yang , Yuxin Peng , Yang Liu
‹ Prev 1 8 9 10 Next ›