English
Related papers

Related papers: ROMA: Real-time Omni-Multimodal Assistant with Int…

200 papers

Large Reasoning Models (LRMs) often reach a correct solution before their long Chain-of-Thought trace ends, yet continue with redundant verification, repeated attempts, or unnecessary exploration that wastes computation and can even…

Machine Learning · Computer Science 2026-05-12 Xinyan Wang , Xiaogeng Liu , Chaowei Xiao

Audio-video joint generation has progressed rapidly, yet substantial challenges still remain. Non-commercial approaches still suffer audio-visual asynchrony, poor lip-speech alignment, and unimodal degradation, which can be stemmed from…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Jun Wang , Chunyu Qiang , Yuxin Guo , Yiran Wang , Xijuan Zeng , Feng Deng

Large Language Models (LLMs) are increasingly deployed in multi-turn dialogue settings where preserving conversational context across turns is essential. A standard serving practice concatenates the full dialogue history at every turn,…

Computation and Language · Computer Science 2026-05-13 Xueqi Cheng , Qiong Wu , Zhengyi Zhou , Xugui Zhou , Tyler Derr , Yushun Dong

Joint audio-visual reasoning is essential for omnimodal understanding, yet current multimodal large language models (MLLMs) still struggle when reasoning requires fine-grained evidence from both modalities. A central limitation is that…

Real-time speech interaction, serving as a fundamental interface for human-machine collaboration, holds immense potential. However, current open-source models face limitations such as high costs in voice data collection, weakness in dynamic…

Computation and Language · Computer Science 2025-02-19 Ailin Huang , Boyong Wu , Bruce Wang , Chao Yan , Chen Hu , Chengli Feng , Fei Tian , Feiyu Shen , Jingbei Li , Mingrui Chen , Peng Liu , Ruihang Miao , Wang You , Xi Chen , Xuerui Yang , Yechang Huang , Yuxiang Zhang , Zheng Gong , Zixin Zhang , Hongyu Zhou , Jianjian Sun , Brian Li , Chengting Feng , Changyi Wan , Hanpeng Hu , Jianchang Wu , Jiangjie Zhen , Ranchen Ming , Song Yuan , Xuelin Zhang , Yu Zhou , Bingxin Li , Buyun Ma , Hongyuan Wang , Kang An , Wei Ji , Wen Li , Xuan Wen , Xiangwen Kong , Yuankai Ma , Yuanwei Liang , Yun Mou , Bahtiyar Ahmidi , Bin Wang , Bo Li , Changxin Miao , Chen Xu , Chenrun Wang , Dapeng Shi , Deshan Sun , Dingyuan Hu , Dula Sai , Enle Liu , Guanzhe Huang , Gulin Yan , Heng Wang , Haonan Jia , Haoyang Zhang , Jiahao Gong , Junjing Guo , Jiashuai Liu , Jiahong Liu , Jie Feng , Jie Wu , Jiaoren Wu , Jie Yang , Jinguo Wang , Jingyang Zhang , Junzhe Lin , Kaixiang Li , Lei Xia , Li Zhou , Liang Zhao , Longlong Gu , Mei Chen , Menglin Wu , Ming Li , Mingxiao Li , Mingliang Li , Mingyao Liang , Na Wang , Nie Hao , Qiling Wu , Qinyuan Tan , Ran Sun , Shuai Shuai , Shaoliang Pang , Shiliang Yang , Shuli Gao , Shanshan Yuan , Siqi Liu , Shihong Deng , Shilei Jiang , Sitong Liu , Tiancheng Cao , Tianyu Wang , Wenjin Deng , Wuxun Xie , Weipeng Ming , Wenqing He , Wen Sun , Xin Han , Xin Huang , Xiaomin Deng , Xiaojia Liu , Xin Wu , Xu Zhao , Yanan Wei , Yanbo Yu , Yang Cao , Yangguang Li , Yangzhen Ma , Yanming Xu , Yaoyu Wang , Yaqiang Shi , Yilei Wang , Yizhuang Zhou , Yinmin Zhong , Yang Zhang , Yaoben Wei , Yu Luo , Yuanwei Lu , Yuhe Yin , Yuchu Luo , Yuanhao Ding , Yuting Yan , Yaqi Dai , Yuxiang Yang , Zhe Xie , Zheng Ge , Zheng Sun , Zhewei Huang , Zhichao Chang , Zhisheng Guan , Zidong Yang , Zili Zhang , Binxing Jiao , Daxin Jiang , Heung-Yeung Shum , Jiansheng Chen , Jing Li , Shuchang Zhou , Xiangyu Zhang , Xinhao Zhang , Yibo Zhu

Large Language Models (LLMs) have made significant strides in text generation and comprehension, with recent advancements extending into multimodal LLMs that integrate visual and audio inputs. However, these models continue to struggle with…

Computation and Language · Computer Science 2024-10-17 Arushi Goel , Karan Sapra , Matthieu Le , Rafael Valle , Andrew Tao , Bryan Catanzaro

Multimodal systems have great potential to assist humans in procedural activities, where people follow instructions to achieve their goals. Despite diverse application scenarios, systems are typically evaluated on traditional classification…

Computation and Language · Computer Science 2025-11-05 Kimihiro Hasegawa , Wiradee Imrattanatrai , Zhi-Qi Cheng , Masaki Asada , Susan Holm , Yuran Wang , Ken Fukuda , Teruko Mitamura

Creating AI systems that can interact with environments over long periods, similar to human cognition, has been a longstanding research goal. Recent advancements in multimodal large language models (MLLMs) have made significant strides in…

Visual and auditory perception are two crucial ways humans experience the world. Text-to-video generation has made remarkable progress over the past year, but the absence of harmonious audio in generated video limits its broader…

Sound · Computer Science 2025-03-25 Yong Ren , Chenxing Li , Manjie Xu , Wei Liang , Yu Gu , Rilin Chen , Dong Yu

While multi-modal learning has advanced significantly, current approaches often treat modalities separately, creating inconsistencies in representation and reasoning. We introduce MANTA (Multi-modal Abstraction and Normalization via Textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Ziqi Zhong , Daniel Tang

This paper presents StreamChat, a novel approach that enhances the interaction capabilities of Large Multimodal Models (LMMs) with streaming video content. In streaming interaction scenarios, existing methods rely solely on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Jihao Liu , Zhiding Yu , Shiyi Lan , Shihao Wang , Rongyao Fang , Jan Kautz , Hongsheng Li , Jose M. Alvare

Recent advances in video multimodal large language models (Video MLLMs) have significantly enhanced video understanding and multi-modal interaction capabilities. While most existing systems operate in a turn-based manner where the model can…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yueqian Wang , Songxiang Liu , Disong Wang , Nuo Xu , Guanglu Wan , Huishuai Zhang , Dongyan Zhao

In online education, innovative tools are crucial for enhancing learning outcomes. SAM (Study with AI Mentor) is an advanced platform that integrates educational videos with a context-aware chat interface powered by large language models.…

Artificial Intelligence · Computer Science 2025-02-25 Anna Bodonhelyi , Enkeleda Thaqi , Süleyman Özdel , Efe Bozkir , Enkelejda Kasneci

Most dialogue-based electronic medical record (EMR) systems still behave as passive pipelines: transcribe speech, extract information, and generate the final note after the consultation. That design improves documentation efficiency, but it…

Computation and Language · Computer Science 2026-04-16 Zhenhai Pan , Yan Liu , Jia You

Recent advances in Omni models have enabled unified multimodal perception and generation. However, most existing systems still exhibit rigid reasoning behaviors, either overthinking simple problems or failing to reason when necessary. To…

Artificial Intelligence · Computer Science 2025-12-05 Dongchao Yang , Songxiang Liu , Disong Wang , Yuanyuan Wang , Guanglu Wan , Helen Meng

Videos offer rich audiovisual information that can support people in performing activities of daily living (ADLs), but they remain largely inaccessible to blind or low-vision (BLV) individuals. In cooking, BLV people often rely on…

Human-Computer Interaction · Computer Science 2025-07-16 Zheng Ning , Leyang Li , Daniel Killough , JooYoung Seo , Patrick Carrington , Yapeng Tian , Yuhang Zhao , Franklin Mingzhe Li , Toby Jia-Jun Li

In this work, we present and evaluate SELMA, a Speech-Enabled Language Model for virtual Assistant interactions that integrates audio and text as inputs to a Large Language Model (LLM). SELMA is designed to handle three primary and two…

Sound · Computer Science 2025-02-04 Dominik Wagner , Alexander Churchill , Siddharth Sigtia , Erik Marchi

Recent progress in multimodal models has spurred rapid advances in audio understanding, generation, and editing. However, these capabilities are typically addressed by specialized models, leaving the development of a truly unified framework…

While humans perceive the world through diverse modalities that operate synergistically to support a holistic understanding of their surroundings, existing omnivideo models still face substantial challenges on audio-visual understanding…

Artificial Intelligence · Computer Science 2026-02-17 Zhangquan Chen , Jiale Tao , Ruihuang Li , Yihao Hu , Ruitao Chen , Zhantao Yang , Xinlei Yu , Haodong Jing , Manyuan Zhang , Shuai Shao , Biao Wang , Qinglin Lu , Ruqi Huang

Multimodal Deep Learning enhances decision-making by integrating diverse information sources, such as texts, images, audio, and videos. To develop trustworthy multimodal approaches, it is essential to understand how uncertainty impacts…

Machine Learning · Computer Science 2025-08-14 Grigor Bezirganyan , Sana Sellami , Laure Berti-Équille , Sébastien Fournier