English
Related papers

Related papers: PosterLLaVa: Constructing a Unified Multi-modal La…

200 papers

Graphic design is crucial for conveying ideas and messages. Designers usually organize their work into objects, backgrounds, and vectorized text layers to simplify editing. However, this workflow demands considerable expertise. With the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Jingye Chen , Zhaowen Wang , Nanxuan Zhao , Li Zhang , Difan Liu , Jimei Yang , Qifeng Chen

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

We propose LLM-Interleaved (LLM-I), a flexible and dynamic framework that reframes interleaved image-text generation as a tool-use problem. LLM-I is designed to overcome the "one-tool" bottleneck of current unified models, which are limited…

Machine Learning · Computer Science 2025-09-18 Zirun Guo , Feng Zhang , Kai Jia , Tao Jin

Automated front-end engineering drastically reduces development cycles and minimizes manual coding overhead. While Generative AI has shown promise in translating designs to code, current solutions often produce monolithic scripts, failing…

Information Retrieval · Computer Science 2025-12-23 Chong Liu , Ming Zhang , Fei Li , Hao Zhou , Xiaoshuang Chen , Ye Yuan

This paper introduces an innovative approach to road network generation through the utilization of a multi-modal Large Language Model (LLM). Our model is specifically designed to process aerial images of road layouts and produce detailed,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Sumedh Rasal , Sanjay Kumar Boddhu

In the realm of Sign Language Translation (SLT), reliance on costly gloss-annotated datasets has posed a significant barrier. Recent advancements in gloss-free SLT methods have shown promise, yet they often largely lag behind gloss-based…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Han Liang , Chengyu Huang , Yuecheng Xu , Cheng Tang , Weicai Ye , Juze Zhang , Xin Chen , Jingyi Yu , Lan Xu

This paper introduces Hierarchical Self-Supervised LVLM (Hi-SSLVLM), a novel generative model designed to significantly advance text-to-image synthesis, particularly for complex and compositionally challenging prompts. Traditional methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Fernando Gabriela Garcia , Spencer Burns , Ryan Shaw , Hunter Young

Adapting generative Multimodal Large Language Models (MLLMs) into universal embedding models typically demands resource-intensive contrastive pre-training, while traditional hard negative mining methods suffer from severe false negative…

Machine Learning · Computer Science 2026-03-02 Yeong-Joon Ju , Seong-Whan Lee

Modern chip physical design relies heavily on Electronic Design Automation (EDA) tools, which often struggle to provide interpretable feedback or actionable guidance for improving routing congestion. In this work, we introduce a Multimodal…

Hardware Architecture · Computer Science 2025-10-21 Yun-Da Tsai , Chang-Yu Chao , Liang-Yeh Shen , Tsung-Han Lin , Haoyu Yang , Mark Ho , Yi-Chen Lu , Wen-Hao Liu , Shou-De Lin , Haoxing Ren

Scalable Vector Graphics (SVG) is an important image format widely adopted in graphic design because of their resolution independence and editability. The study of generating high-quality SVG has continuously drawn attention from both…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yiying Yang , Wei Cheng , Sijin Chen , Xianfang Zeng , Fukun Yin , Jiaxu Zhang , Liao Wang , Gang Yu , Xingjun Ma , Yu-Gang Jiang

Automated academic poster generation aims to distill lengthy research papers into concise, visually coherent presentations. Existing Multimodal Large Language Models (MLLMs) based approaches, however, suffer from three critical limitations:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Wenxin Tang , Jingyu Xiao , Yanpei Gong , Fengyuan Ran , Tongchuan Xia , Junliang Liu , Man Ho Lam , Wenxuan Wang , Michael R. Lyu

Large language model (LLM)-based systems are becoming increasingly popular for solving tasks by constructing executable workflows that interleave LLM calls, information retrieval, tool use, code execution, memory updates, and verification.…

Artificial Intelligence · Computer Science 2026-03-25 Ling Yue , Kushal Raj Bhandari , Ching-Yun Ko , Dhaval Patel , Shuxin Lin , Nianjun Zhou , Jianxi Gao , Pin-Yu Chen , Shaowu Pan

Spreadsheets are critical to data-centric tasks, with rich, structured layouts that enable efficient information transmission. Given the time and expertise required for manual spreadsheet layout design, there is an urgent need for automated…

Artificial Intelligence · Computer Science 2025-09-10 Qin Chen , Yuanyi Ren , Xiaojun Ma , Mugeng Liu , Han Shi , Dongmei Zhang

We present Liquid, an auto-regressive generation paradigm that seamlessly integrates visual comprehension and generation by tokenizing images into discrete codes and learning these code embeddings alongside text tokens within a shared…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junfeng Wu , Yi Jiang , Chuofan Ma , Yuliang Liu , Hengshuang Zhao , Zehuan Yuan , Song Bai , Xiang Bai

Scalable Vector Graphics (SVG) are central to digital design due to their inherent scalability and editability. Despite significant advancements in content generation enabled by Visual Language Models (VLMs), existing text-to-SVG generation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Feiyu Wang , Jiayuan Yang , Zhiyuan Zhao , Da Zhang , Bingyu Li , Peng Liu , Junyu Gao

Multi-modal Large Language Models (MLLMs) have gained significant attention in both academia and industry for their capabilities in handling multi-modal tasks. However, these models face challenges in mathematical geometric reasoning due to…

Artificial Intelligence · Computer Science 2025-11-03 Yuhao Zhang , Dingxin Hu , Tinghao Yu , Hao Liu , Yiting Liu

Large Language Models (LLMs) are gaining popularity for hardware design automation, particularly through Register Transfer Level (RTL) code generation. In this work, we examine the current literature on RTL generation using LLMs and…

Hardware Architecture · Computer Science 2025-07-21 Paul E. Calzada , Zahin Ibnat , Tanvir Rahman , Kamal Kandula , Danyu Lu , Sujan Kumar Saha , Farimah Farahmandi , Mark Tehranipoor

Machine learning-based lithography hotspot detection has been deeply studied recently, from varies feature extraction techniques to efficient learning models. It has been observed that such machine learning-based frameworks are providing…

Machine Learning · Computer Science 2019-12-13 Haoyu Yang , Wen Chen , Piyush Pathak , Frank Gennari , Ya-Chieh Lai , Bei Yu

Current methods for generating 3D scene layouts from text predominantly follow a declarative paradigm, where a Large Language Model (LLM) specifies high-level constraints that are then resolved by a separate solver. This paper challenges…