English
Related papers

Related papers: Multi-modal Generative AI: Multi-modal LLMs, Diffu…

200 papers

Deep learning methods have revolutionized speech recognition, image recognition, and natural language processing since 2010. Each of these tasks involves a single modality in their input signals. However, many applications in the artificial…

Artificial Intelligence · Computer Science 2020-07-15 Chao Zhang , Zichao Yang , Xiaodong He , Li Deng

This article targets at unlocking the potentials of a class of prominent generative artificial intelligence (GAI) method, namely diffusion model (DM), for mobile communications. First, a DM-driven communication architecture is proposed,…

Signal Processing · Electrical Eng. & Systems 2024-10-22 Xiaoxia Xu , Xidong Mu , Yuanwei Liu , Hong Xing , Yue Liu , Arumugam Nallanathan

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Unified multimodal models have recently shown remarkable gains in both capability and versatility, yet most leading systems are still trained from scratch and require substantial computational resources. In this paper, we show that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeyu Wang , Zilong Chen , Chenhui Gou , Feng Li , Chaorui Deng , Deyao Zhu , Kunchang Li , Weihao Yu , Haoqin Tu , Haoqi Fan , Cihang Xie

Fashion content generation is an emerging area at the intersection of artificial intelligence and creative design, with applications ranging from virtual try-on to culturally diverse design prototyping. Existing methods often struggle with…

Computation and Language · Computer Science 2025-01-28 Spencer Ramsey , Amina Grant , Jeffrey Lee

Semantic communications mark a paradigm shift from bit-accurate transmission toward meaning-centric communication, essential as wireless systems approach theoretical capacity limits. The emergence of generative AI has catalyzed generative…

Signal Processing · Electrical Eng. & Systems 2026-05-08 Hai-Long Qin , Jincheng Dai , Guo Lu , Shuo Shao , Sixian Wang , Tongda Xu , Wenjun Zhang , Ping Zhang , Khaled B. Letaief

Multimodal Large Language Models (MLLMs) combine the natural language understanding and generation capabilities of LLMs with perception skills in modalities such as image and audio, representing a key advancement in contemporary AI. This…

We introduce MMaDA, a novel class of multimodal diffusion foundation models designed to achieve superior performance across diverse domains such as textual reasoning, multimodal understanding, and text-to-image generation. The approach is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ling Yang , Ye Tian , Bowen Li , Xinchen Zhang , Ke Shen , Yunhai Tong , Mengdi Wang

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

Computers and Society · Computer Science 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

Unified multimodal models aim to integrate understanding and generation within a single framework, yet bridging the gap between discrete semantic reasoning and high-fidelity visual synthesis remains challenging. We present MammothModa2…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Tao Shen , Xin Wan , Taicai Chen , Rui Zhang , Junwen Pan , Dawei Lu , Fanding Lei , Zhilin Lu , Yunfei Yang , Chen Cheng , Qi She , Chang Liu , Zhenbang Sun

Unmanned Aerial Vehicles (UAVs) are increasingly adopted in modern communication networks. However, challenges in decision-making and digital modeling continue to impede their rapid advancement. Reinforcement Learning (RL) algorithms face…

Machine Learning · Computer Science 2025-01-13 Yousef Emami , Hao Zhou , Luis Almeida , Kai Li

Urban design is a multifaceted process that demands careful consideration of site-specific constraints and collaboration among diverse professionals and stakeholders. The advent of generative artificial intelligence (GenAI) offers…

Artificial Intelligence · Computer Science 2025-06-02 Mingyi He , Yuebing Liang , Shenhao Wang , Yunhan Zheng , Qingyi Wang , Dingyi Zhuang , Li Tian , Jinhua Zhao

Recent advancements in multimodal foundation models have yielded significant progress in vision-language understanding. Initial attempts have also explored the potential of multimodal large language models (MLLMs) for visual content…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Rongyao Fang , Chengqi Duan , Kun Wang , Hao Li , Hao Tian , Xingyu Zeng , Rui Zhao , Jifeng Dai , Hongsheng Li , Xihui Liu

The rapid advancement of intelligent agents and Large Language Models (LLMs) is reshaping the pervasive computing field. Their ability to perceive, reason, and act through natural language understanding enables autonomous problem-solving in…

Artificial Intelligence · Computer Science 2025-12-19 Gianni Molinari , Fabio Ciravegna

The rise of generative large language models (LLMs) has opened new opportunities for automating knowledge representation through concept maps, a long-standing pedagogical tool valued for fostering meaningful learning and higher-order…

Computers and Society · Computer Science 2025-09-19 Xiaoming Zhai

Large Language Models (LLMs) have demonstrated remarkable language understanding and generation capabilities. However, training, deploying, and accessing these models pose notable challenges, including resource-intensive demands, extended…

Computation and Language · Computer Science 2024-01-31 Souvika Sarkar , Mohammad Fakhruddin Babar , Monowar Hasan , Shubhra Kanti Karmaker

As information exists in various modalities in real world, effective interaction and fusion among multimodal information plays a key role for the creation and perception of multimodal data in computer vision and deep learning research. With…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Fangneng Zhan , Yingchen Yu , Rongliang Wu , Jiahui Zhang , Shijian Lu , Lingjie Liu , Adam Kortylewski , Christian Theobalt , Eric Xing

In recent years, machine learning (ML) techniques have created numerous opportunities for intelligent mobile networks and have accelerated the automation of network operations. However, complex network tasks may involve variables and…

Machine Learning · Computer Science 2024-06-07 Han Zhang , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

Recent years have seen remarkable progress in autonomous driving, yet generalization to long-tail and open-world scenarios remains a major bottleneck for large-scale deployment. To address this challenge, some works use LLMs and VLMs for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Hao Shao , Letian Wang , Yang Zhou , Yuxuan Hu , Zhuofan Zong , Steven L. Waslander , Wei Zhan , Hongsheng Li

Large Language Models (LLMs) are being integrated into professional domains, yet their limitations in such high-stakes fields as law remain poorly understood. In response, this paper introduces examples of critical challenges to the…

Artificial Intelligence · Computer Science 2026-01-27 Eljas Linna , Tuula Linna