中文
相关论文

相关论文: InternSVG: Towards Unified SVG Tasks with Multimod…

200 篇论文

The evolution of Large Language Model (LLM) agents for software engineering (SWE) is constrained by the scarcity of verifiable datasets, a bottleneck stemming from the complexity of constructing executable environments across diverse…

Speech forensic tasks (SFTs), such as automatic speaker recognition (ASR), speech emotion recognition (SER), gender recognition (GR), and age estimation (AE), find use in different security and biometric applications. Previous works have…

音频与语音处理 · 电气工程与系统科学 2024-10-18 Orchid Chetia Phukan , Devyani Koshal , Swarup Ranjan Behera , Arun Balaji Buduru , Rajesh Sharma

Sounding Video Generation (SVG) is an audio-video joint generation task challenged by high-dimensional signal spaces, distinct data formats, and different patterns of content information. To address these issues, we introduce a novel…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Mingzhen Sun , Weining Wang , Yanyuan Qiao , Jiahui Sun , Zihan Qin , Longteng Guo , Xinxin Zhu , Jing Liu

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

With the widespread adoption of Large Language Models (LLMs), serving LLM inference requests has become an increasingly important task, attracting active research advancements. Practical workloads play an essential role in this process:…

分布式、并行与集群计算 · 计算机科学 2026-05-12 Yuxing Xiang , Xue Li , Kun Qian , Wenyuan Yu , Ennan Zhai , Xin Jin

Vector graphics are widely used in graphical designs and have received more and more attention. However, unlike raster images which can be easily obtained, acquiring high-quality vector graphics, typically through automatically converting…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Haokun Zhu , Juang Ian Chong , Teng Hu , Ran Yi , Yu-Kun Lai , Paul L. Rosin

Text-rich images, where text serves as the central visual element guiding the overall understanding, are prevalent in real-world applications, such as presentation slides, scanned documents, and webpage snapshots. Tasks involving multiple…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Mengzhao Jia , Wenhao Yu , Kaixin Ma , Tianqing Fang , Zhihan Zhang , Siru Ouyang , Hongming Zhang , Dong Yu , Meng Jiang

Scalable Vector Graphics (SVG) are central to modern web design, and the demand to animate them continues to grow as web environments become increasingly dynamic. Yet automating the animation of vector graphics remains challenging for…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Jooyeol Yun , Jaegul Choo

Recent multimodal large language models (MLLMs) still struggle with long document understanding due to two fundamental challenges: information interference from abundant irrelevant content, and the quadratic computational cost of…

计算与语言 · 计算机科学 2025-11-14 Yongxin Shi , Jiapeng Wang , Zeyu Shan , Dezhi Peng , Zening Lin , Lianwen Jin

In this report, we introduce InternVL 1.5, an open-source multimodal large language model (MLLM) to bridge the capability gap between open-source and proprietary commercial models in multimodal understanding. We introduce three simple…

Multimodal Large Language Models (MLLMs) have shown promising capabilities in generating Scalable Vector Graphics (SVG) via direct code synthesis. However, existing paradigms typically adopt an open-loop "blind drawing" approach, where…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Guotao Liang , Zhangcheng Wang , Juncheng Hu , Haitao Zhou , Ziteng Xue , Jing Zhang , Dong Xu , Qian Yu

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

机器学习 · 计算机科学 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

Recent benchmarks and datasets have been proposed to improve spatial reasoning in vision-language models (VLMs), yet existing open resources remain limited in scale, visual diversity, and instruction expressiveness. In this work, we…

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains text-centric due to…

人工智能 · 计算机科学 2026-03-11 Xueyao Wan , Hang Yu

Large language models (LLMs) have recently been extended to the vision-language realm, obtaining impressive general multi-modal capabilities. However, the exploration of multi-modal large language models (MLLMs) for remote sensing (RS) data…

计算机视觉与模式识别 · 计算机科学 2024-01-19 Yang Zhan , Zhitong Xiong , Yuan Yuan

Recent advancements in multimodal large language models have driven breakthroughs in visual question answering. Yet, a critical gap persists, `conceptualization'-the ability to recognize and reason about the same concept despite variations…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Zahra Babaiee , Peyman M. Kiasari , Daniela Rus , Radu Grosu

The rise of Multi-modal Pre-training highlights the necessity for a unified Multi-Modal Knowledge Graph (MMKG) representation learning framework. Such a framework is essential for embedding structured knowledge into multi-modal Large…

计算与语言 · 计算机科学 2025-01-16 Zhuo Chen , Yin Fang , Yichi Zhang , Lingbing Guo , Jiaoyan Chen , Jeff Z. Pan , Huajun Chen , Wen Zhang

Multimodal large language models (MLLMs) have demonstrated impressive performance in vision-language tasks across a broad spectrum of domains. However, the large model scale and associated high computational costs pose significant…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Zhangwei Gao , Zhe Chen , Erfei Cui , Yiming Ren , Weiyun Wang , Jinguo Zhu , Hao Tian , Shenglong Ye , Junjun He , Xizhou Zhu , Lewei Lu , Tong Lu , Yu Qiao , Jifeng Dai , Wenhai Wang

Despite the existing evolution of Multimodal Large Language Models (MLLMs), a non-neglectable limitation remains in their struggle with visual text grounding, especially in text-rich images of documents. Document images, such as scanned…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Ming Li , Ruiyi Zhang , Jian Chen , Chenguang Wang , Jiuxiang Gu , Yufan Zhou , Franck Dernoncourt , Wanrong Zhu , Tianyi Zhou , Tong Sun

Multimodal Large Language Models (MLLMs) have made significant strides in visual understanding and generation tasks. However, generating interleaved image-text content remains a challenge, which requires integrated multimodal understanding…