English
Related papers

Related papers: Training Video Foundation Models with NVIDIA NeMo

200 papers

Foundation models (FMs) are large neural networks trained on broad datasets, excelling in downstream tasks with minimal fine-tuning. Human activity recognition in video has advanced with FMs, driven by competition among different…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Thinesh Thiyakesan Ponbagavathi , Kunyu Peng , Alina Roitberg

In recent years, the upstream of Large Language Models (LLM) has also encouraged the computer vision community to work on substantial multimodal datasets and train models on a scale in a self-/semi-supervised manner, resulting in Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Keno Moenck , Duc Trung Thieu , Julian Koch , Thorsten Schüppstuhl

Owing to their ability to extract relevant spatio-temporal video embeddings, Vision Transformers (ViTs) are currently the best performing models in video action understanding. However, their generalization over domains or datasets is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Hui Lu , Hu Jian , Ronald Poppe , Albert Ali Salah

Foundation models, while highly effective, are often resource-intensive, requiring substantial inference time and memory. This paper addresses the challenge of making these models more accessible with limited computational resources by…

Machine Learning · Computer Science 2024-09-20 Vasilii Feofanov , Romain Ilbert , Malik Tiomoko , Themis Palpanas , Ievgen Redko

World models serve as core simulators for fields such as agentic AI, embodied AI, and gaming, capable of generating long, physically realistic, and interactive high-quality videos. Moreover, scaling these models could unlock emergent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Inferix Team , Tianyu Feng , Yizeng Han , Jiahao He , Yuanyu He , Xi Lin , Teng Liu , Hanfeng Lu , Jiasheng Tang , Wei Wang , Zhiyuan Wang , Jichao Wu , Mingyang Yang , Yinghao Yu , Zeyu Zhang , Bohan Zhuang

Neural networks are rapidly gaining popularity in scientific research, but training the models is often very time-consuming. Particularly when the training data samples are large high-dimensional arrays, efficient training methodologies…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-30 Kewei Wang , Claire Songhyun Lee , Sunwoo Lee , Vishu Gupta , Jan Balewski , Alex Sim , Peter Nugent , Ankit Agrawal , Alok Choudhary , Kesheng Wu , Wei-keng Liao

Foundation models (FMs) are rapidly reshaping medical imaging, shifting the field from narrowly trained, task-specific networks toward large, general-purpose models that can be adapted across modalities, anatomies, and clinical tasks. In…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Chuang Niu , Pengwei Wu , Bruno De Man , Ge Wang

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Material classification has emerged as a critical task in computer vision and graphics, supporting the assignment of accurate material properties to a wide range of digital and real-world applications. While traditionally framed as an image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Qingran Lin , Fengwei Yang , Chaolun Zhu

Vision-language models (VLMs) could power real-time assistants and autonomous agents, but they face a critical challenge: understanding near-infinite video streams without escalating latency and memory usage. Processing entire videos with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Ruyi Xu , Guangxuan Xiao , Yukang Chen , Liuning He , Kelly Peng , Yao Lu , Song Han

Understanding and predicting emotion from videos has gathered significant attention in recent studies, driven by advancements in video large language models (VideoLLMs). While advanced methods have made progress in video emotion analysis,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zhicheng Zhang , Weicheng Wang , Yongjie Zhu , Wenyu Qin , Pengfei Wan , Di Zhang , Jufeng Yang

Vision-language models (VLMs) integrate visual and textual information, enabling a wide range of applications such as image captioning and visual question answering, making them crucial for modern AI systems. However, their high…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Gaurav Shinde , Anuradha Ravi , Emon Dey , Shadman Sakib , Milind Rampure , Nirmalya Roy

Video Face Enhancement (VFE) aims to restore high-quality facial regions from degraded video sequences, enabling a wide range of practical applications. Despite substantial progress in the field, current methods that primarily rely on video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Shulian Zhang , Yong Guo , Long Peng , Ziyang Wang , Ye Chen , Wenbo Li , Xiao Zhang , Yulun Zhang , Jian Chen

Recent vision foundation models (VFMs) have demonstrated proficiency in various tasks but require supervised fine-tuning to perform the task of semantic segmentation effectively. Benchmarking their performance is essential for selecting…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Tommie Kerssies , Daan de Geus , Gijs Dubbelman

Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment. However, the…

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

Inevitable domain and task discrepancies in real-world scenarios can impair the generalization performance of the pre-trained deep models for medical data. Therefore, we audaciously propose that we should build a general-purpose medical AI…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huahui Yi , Ziyuan Qin , Qicheng Lao , Wei Xu , Zekun Jiang , Dequan Wang , Shaoting Zhang , Kang Li

The ability of neural radiance fields or NeRFs to conduct accurate 3D modelling has motivated application of the technique to scene representation. Previous approaches have mainly followed a centralised learning paradigm, which assumes that…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Lachlan Holden , Feras Dayoub , David Harvey , Tat-Jun Chin

Diffusion and flow-based models have become the state of the art for generative AI across a wide range of data modalities, including images, videos, shapes, molecules, music, and more. This tutorial provides a self-contained introduction to…

Machine Learning · Computer Science 2026-03-19 Peter Holderrieth , Ezra Erives

Vision-language models (VLMs) have demonstrated impressive multimodal comprehension capabilities and are being deployed in an increasing number of online video understanding applications. While recent efforts extensively explore advancing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-08 Shengyuan Ye , Bei Ouyang , Tianyi Qian , Liekang Zeng , Mu Yuan , Xiaowen Chu , Weijie Hong , Xu Chen