English
Related papers

Related papers: OmniEncoder: See, Hear, and Feel Continuous Motion…

200 papers

Large Language Models (LLMs) have advanced audio generation through discrete representation learning. However, most existing neural codecs focus on speech and emphasize reconstruction fidelity, overlooking unified low frame rate modeling…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-24 Jingbin Hu , Haoyu Zhang , Dake Guo , Qirui Zhan , Wenhao Li , Huakang Chen , Guobin Ma , Hanke Xie , Chengyou Wang , Pengyuan Xie , Chuan Xie , Qiang Zhang , Lei Xie

Despite the remarkable success of the LLaVA architecture for vision-language tasks, its design inherently struggles to effectively integrate visual features due to the inherent mismatch between text and vision modalities. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Dongwan Kim , Viresh Ranjan , Takashi Nagata , Arnab Dhua , Amit Kumar K C

Majority of research in learning based methods has been towards designing and training networks for specific tasks. However, many of the learning based tasks, across modalities, share commonalities and could be potentially tackled in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Siddharth Srivastava , Gaurav Sharma

Multimodal emotion recognition (MER) aims to identify human emotions by combining data from various modalities such as language, audio, and vision. Despite the recent advances of MER approaches, the limitations in obtaining extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yehun Song , Sunyoung Cho

Conventional video compression approaches use the predictive coding architecture and encode the corresponding motion information and residual information. In this paper, taking advantage of both classical architecture in the conventional…

Image and Video Processing · Electrical Eng. & Systems 2019-04-09 Guo Lu , Wanli Ouyang , Dong Xu , Xiaoyun Zhang , Chunlei Cai , Zhiyong Gao

We present Omni-Embed-Nemotron, a unified multimodal retrieval embedding model developed to handle the increasing complexity of real-world information needs. While Retrieval-Augmented Generation (RAG) has significantly advanced language…

Computation and Language · Computer Science 2025-10-07 Mengyao Xu , Wenfei Zhou , Yauhen Babakhin , Gabriel Moreira , Ronay Ak , Radek Osmulski , Bo Liu , Even Oldridge , Benedikt Schifferer

Building a universal Video-Language model for solving various video understanding tasks (\emph{e.g.}, text-video retrieval, video question answering) is an open challenge to the machine learning field. Towards this goal, most recent works…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Jingjia Huang , Yinan Li , Jiashi Feng , Xinglong Wu , Xiaoshuai Sun , Rongrong Ji

When virtual agents interact with humans, gestures are crucial to delivering their intentions with speech. Previous multimodal co-speech gesture generation models required encoded features of all modalities to generate gestures. If some…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Gwantae Kim , Seonghyeok Noh , Insung Ham , Hanseok Ko

Running AI models on smart edge devices can unlock versatile user experiences, but presents challenges due to limited compute and the need to handle multiple tasks simultaneously. This requires a vision encoder with small size but powerful…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Chenchen Zhu , Saksham Suri , Cijo Jose , Maxime Oquab , Marc Szafraniec , Wei Wen , Yunyang Xiong , Patrick Labatut , Piotr Bojanowski , Raghuraman Krishnamoorthi , Vikas Chandra

We propose OmniCaptioner, a versatile visual captioning framework for generating fine-grained textual descriptions across a wide variety of visual domains. Unlike prior methods limited to specific image types (e.g., natural images or…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiting Lu , Jiakang Yuan , Zhen Li , Shitian Zhao , Qi Qin , Xinyue Li , Le Zhuo , Licheng Wen , Dongyang Liu , Yuewen Cao , Xiangchao Yan , Xin Li , Tianshuo Peng , Shufei Zhang , Botian Shi , Tao Chen , Zhibo Chen , Lei Bai , Peng Gao , Bo Zhang

Modern multimodal large language models (MLLMs) generate fluent responses from interleaved text, image, audio, and video inputs. However, identifying which input sources support each generated statement remains an open challenge. Existing…

Computation and Language · Computer Science 2026-04-16 Qianqi Yan , Yichen Guo , Ching-Chen Kuo , Shan Jiang , Hang Yin , Yang Zhao , Xin Eric Wang

Balancing temporal resolution and spatial detail under limited compute budget remains a key challenge for video-based multi-modal large language models (MLLMs). Existing methods typically compress video representations using predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Min Shi , Shihao Wang , Chieh-Yun Chen , Jitesh Jain , Kai Wang , Junjun Xiong , Guilin Liu , Zhiding Yu , Humphrey Shi

How to learn discriminative video representation from unlabeled videos is challenging but crucial for video analysis. The latest attempts seek to learn a representation model by predicting the appearance contents in the masked regions.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Xinyu Sun , Peihao Chen , Liangwei Chen , Changhao Li , Thomas H. Li , Mingkui Tan , Chuang Gan

Variational Autoencoders for multimodal data hold promise for many tasks in data analysis, such as representation learning, conditional generation, and imputation. Current architectures either share the encoder output, decoder input, or…

Recent advancements in foundation models have revolutionized joint audio-video generation. However, existing approaches typically treat human-centric tasks including reference-based audio-video generation (R2AV), video editing (RV2AV) and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Xu Guo , Fulong Ye , Qichao Sun , Liyang Chen , Bingchuan Li , Pengze Zhang , Jiawei Liu , Songtao Zhao , Qian He , Xiangwang Hou

Reference-guided video editing takes a source video, a text instruction, and a reference image as inputs, requiring the model to faithfully apply the instructed edits while preserving original motion and unedited content. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Tong Wang , Meng Zou , Chengjing Wu , Xiaochao Qu , Luoqi Liu , Xiaolin Hu , Ting Liu

We present Dynin-Omni, the first masked-diffusion-based omnimodal foundation model that unifies text, image, and speech understanding and generation, together with video understanding, within a single architecture. Unlike autoregressive…

Computation and Language · Computer Science 2026-04-02 Jaeik Kim , Woojin Kim , Jihwan Hong , Yejoon Lee , Sieun Hyeon , Mintaek Lim , Yunseok Han , Dogeun Kim , Hoeun Lee , Hyunggeun Kim , Jaeyoung Do

Multimodal large language models have fueled progress in image captioning. These models, fine-tuned on vast image datasets, exhibit a deep understanding of semantic concepts. In this work, we show that this ability can be re-purposed for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-10 Hugo Malard , Michel Olvera , Stéphane Lathuiliere , Slim Essid

Multimodal embedding models aim to map heterogeneous inputs, such as text, images, videos, and audio, into a shared semantic space. However, existing methods and benchmarks remain largely limited to partial modality coverage, making it…

Information Retrieval · Computer Science 2026-04-28 Haohang Huang , Xuan Lu , Mingyi Su , Xuan Zhang , Ziyan Jiang , Ping Nie , Kai Zou , Tomas Pfister , Wenhu Chen , Wei Zhang , Xiaoyu Shen , Rui Meng

Learning from multiple modalities, such as audio and video, offers opportunities for leveraging complementary information, enhancing robustness, and improving contextual understanding and performance. However, combining such modalities…

Multimedia · Computer Science 2024-10-15 Konstantinos Kontras , Christos Chatzichristos , Matthew Blaschko , Maarten De Vos