English
Related papers

Related papers: Ming-Flash-Omni: A Sparse, Unified Architecture fo…

200 papers

We present a robust ensemble-based system for multilingual multimodal reasoning, designed for the ImageCLEF 2025 EXAMS V challenge. Our approach integrates Gemini 2.5 Flash for visual description, Gemini 1.5 Pro for caption refinement and…

Computation and Language · Computer Science 2025-07-16 Seif Ahmed , Mohamed T. Younes , Abdelrahman Moustafa , Abdelrahman Allam , Hamza Moustafa

In this technical report, we present the Ring-linear model series, specifically including Ring-mini-linear-2.0 and Ring-flash-linear-2.0. Ring-mini-linear-2.0 comprises 16B parameters and 957M activations, while Ring-flash-linear-2.0…

Recent progress in multimodal models has spurred rapid advances in audio understanding, generation, and editing. However, these capabilities are typically addressed by specialized models, leaving the development of a truly unified framework…

Despite rapid advances in multimodal large language models, agricultural applications remain constrained by the lack of multilingual speech data, unified multimodal architectures, and comprehensive evaluation benchmarks. To address these…

Computation and Language · Computer Science 2025-12-12 Bo Yang , Lanfei Feng , Yunkui Chen , Yu Zhang , Jianyu Zhang , Xiao Xu , Nueraili Aierken , Shijian Li

We introduce Yuan3.0 Flash, an open-source Mixture-of-Experts (MoE) MultiModal Large Language Model featuring 3.7B activated parameters and 40B total parameters, specifically designed to enhance performance on enterprise-oriented tasks…

We present AudioGen-Omni - a unified approach based on multimodal diffusion transformers (MMDit), capable of generating high-fidelity audio, speech, and song coherently synchronized with the input video. AudioGen-Omni introduces a novel…

Sound · Computer Science 2025-08-08 Le Wang , Jun Wang , Chunyu Qiang , Feng Deng , Chen Zhang , Di Zhang , Kun Gai

The rapid advancement of multi-modal language models (MLLMs) like GPT-4o has propelled the development of Omni language models, designed to process and proactively respond to continuous streams of multi-modal data. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuxuan Wang , Yueqian Wang , Bo Chen , Tong Wu , Dongyan Zhao , Zilong Zheng

Multimodal large language models (MLLMs) are expected to jointly interpret vision, audio, and language, yet existing video benchmarks rarely assess fine-grained reasoning about human speech. Many tasks remain visually solvable or only…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Le Thien Phuc Nguyen , Zhuoran Yu , Samuel Low Yu Hang , Subin An , Jeongik Lee , Yohan Ban , SeungEun Chung , Thanh-Huy Nguyen , JuWan Maeng , Soochahn Lee , Yong Jae Lee

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Recent advances in diffusion-based video generation have substantially improved visual fidelity and temporal coherence. However, most existing approaches remain task-specific and rely primarily on textual instructions, limiting their…

We present MiMo-V2-Flash, a Mixture-of-Experts (MoE) model with 309B total parameters and 15B active parameters, designed for fast, strong reasoning and agentic capabilities. MiMo-V2-Flash adopts a hybrid attention architecture that…

Computation and Language · Computer Science 2026-01-09 Core Team , Bangjun Xiao , Bingquan Xia , Bo Yang , Bofei Gao , Bowen Shen , Chen Zhang , Chenhong He , Chiheng Lou , Fuli Luo , Gang Wang , Gang Xie , Hailin Zhang , Hanglong Lv , Hanyu Li , Heyu Chen , Hongshen Xu , Houbin Zhang , Huaqiu Liu , Jiangshan Duo , Jianyu Wei , Jiebao Xiao , Jinhao Dong , Jun Shi , Junhao Hu , Kainan Bao , Kang Zhou , Lei Li , Liang Zhao , Linghao Zhang , Peidian Li , Qianli Chen , Shaohui Liu , Shihua Yu , Shijie Cao , Shimao Chen , Shouqiu Yu , Shuo Liu , Tianling Zhou , Weijiang Su , Weikun Wang , Wenhan Ma , Xiangwei Deng , Bohan Mao , Bowen Ye , Can Cai , Chenghua Wang , Chengxuan Zhu , Chong Ma , Chun Chen , Chunan Li , Dawei Zhu , Deshan Xiao , Dong Zhang , Duo Zhang , Fangyue Liu , Feiyu Yang , Fengyuan Shi , Guoan Wang , Hao Tian , Hao Wu , Heng Qu , Hongfei Yi , Hongxu An , Hongyi Guan , Xing Zhang , Yifan Song , Yihan Yan , Yihao Zhao , Yingchun Lai , Yizhao Gao , Yu Cheng , Yuanyuan Tian , Yudong Wang , Zhen Tang , Zhengju Tang , Zhengtao Wen , Zhichao Song , Zhixian Zheng , Zihan Jiang , Jian Wen , Jiarui Sun , Jiawei Li , Jinlong Xue , Jun Xia , Kai Fang , Menghang Zhu , Nuo Chen , Qian Tu , Qihao Zhang , Qiying Wang , Rang Li , Rui Ma , Shaolei Zhang , Shengfan Wang , Shicheng Li , Shuhao Gu , Shuhuai Ren , Sirui Deng , Tao Guo , Tianyang Lu , Weiji Zhuang , Weikang Zhang , Weimin Xiong , Wenshan Huang , Wenyu Yang , Xin Zhang , Xing Yong , Xu Wang , Xueyang Xie , Yilin Jiang , Yixin Yang , Yongzhe He , Yu Tu , Yuanliang Dong , Yuchen Liu , Yue Ma , Yue Yu , Yuxing Xiang , Zhaojun Huang , Zhenru Lin , Zhipeng Xu , Zhiyang Chen , Zhonghua Deng , Zihan Zhang , Zihao Yue

As the foundational component of versatile AI applications, training an multimodal large language model (MLLM) relies on multimodal datasets with dynamic modality mixture proportions and sample length distributions. However, existing MLLM…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Chunyu Xue , Yangrui Chen , Jianyu Jiang , Ningxin Zheng , Junda Feng , Jingji Chen , Shixiong Zhao , Shen Yan , Yi Lin , Lei Shi , Zanbo Wang , Lishu Luo , Faming Wu , Haibin Lin , Xin Liu , Yanghua Peng , Quan Chen

In this work, we introduce Mini-Gemini, a simple and effective framework enhancing multi-modality Vision Language Models (VLMs). Despite the advancements in VLMs facilitating basic visual dialog and reasoning, a performance gap persists…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yanwei Li , Yuechen Zhang , Chengyao Wang , Zhisheng Zhong , Yixin Chen , Ruihang Chu , Shaoteng Liu , Jiaya Jia

Rapidly developing large language models (LLMs) have brought tremendous intelligent applications. Especially, the GPT-4o's excellent duplex speech interaction ability has brought impressive experience to users. Researchers have recently…

Sound · Computer Science 2024-12-10 Xiong Wang , Yangze Li , Chaoyou Fu , Yunhang Shen , Lei Xie , Ke Li , Xing Sun , Long Ma

Advancing machine intelligence requires developing the ability to perceive across multiple modalities, much as humans sense the world. We introduce OmniVinci, an initiative to build a strong, open-source, omni-modal LLM. We carefully study…

The emergence of GPT-4o-like large multimodal models (LMMs) has raised the exploration of integrating text, vision, and speech modalities to support more flexible multimodal interaction. Existing LMMs typically concatenate representation of…

Artificial Intelligence · Computer Science 2025-06-24 Shaolei Zhang , Shoutao Guo , Qingkai Fang , Yan Zhou , Yang Feng

Joint audio-visual reasoning is essential for omnimodal understanding, yet current multimodal large language models (MLLMs) still struggle when reasoning requires fine-grained evidence from both modalities. A central limitation is that…

Multimodal conversational agents are highly desirable because they offer natural and human-like interaction. However, there is a lack of comprehensive end-to-end solutions to support collaborative development and benchmarking. While…

Human-Computer Interaction · Computer Science 2024-11-19 Qiang Sun , Yuanyi Luo , Sirui Li , Wenxiao Zhang , Wei Liu

We introduce MiniMax-01 series, including MiniMax-Text-01 and MiniMax-VL-01, which are comparable to top-tier models while offering superior capabilities in processing longer contexts. The core lies in lightning attention and its efficient…

Although Multimodal Large Language Models (MLLMs) demonstrate strong omni-modal perception, their ability to forecast future events from audio-visual cues remains largely unexplored, as existing benchmarks focus mainly on retrospective…

Computation and Language · Computer Science 2026-01-21 Qian Chen , Jinlan Fu , Changsong Li , See-Kiong Ng , Xipeng Qiu