English
Related papers

Related papers: Towards Modality Transferable Visual Information R…

200 papers

Visual representation is crucial for a visual tracking method's performances. Conventionally, visual representations adopted in visual tracking rely on hand-crafted computer vision descriptors. These descriptors were developed generically…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Jason Kuen , Kian Ming Lim , Chin Poo Lee

Multimodality Representation Learning, as a technique of learning to embed information from different modalities and their correlations, has achieved remarkable success on a variety of applications, such as Visual Question Answering (VQA),…

Artificial Intelligence · Computer Science 2024-03-04 Muhammad Arslan Manzoor , Sarah Albarri , Ziting Xian , Zaiqiao Meng , Preslav Nakov , Shangsong Liang

This research addresses the challenge of limited data in tabular data classification, particularly prevalent in domains with constraints like healthcare. We propose Tab2Visual, a novel approach that transforms heterogeneous tabular data…

Machine Learning · Computer Science 2025-02-12 Ahmed Mamdouh , Moumen El-Melegy , Samia Ali , Ron Kikinis

In the field of computer vision, visible light images often exhibit low contrast in low-light conditions, presenting a significant challenge. While infrared imagery provides a potential solution, its utilization entails high costs and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yijia Chen , Pinghua Chen , Xiangxin Zhou , Yingtie Lei , Ziyang Zhou , Mingxian Li

Video inpainting tasks have seen significant improvements in recent years with the rise of deep neural networks and, in particular, vision transformers. Although these models show promising reconstruction quality and temporal consistency,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Guillaume Thiry , Hao Tang , Radu Timofte , Luc Van Gool

Dense video captioning aims to localize and describe important events in untrimmed videos. Existing methods mainly tackle this task by exploiting only visual features, while completely neglecting the audio track. Only a few prior works have…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Vladimir Iashin , Esa Rahtu

Implicit Neural Representations (INRs) have garnered significant attention for their ability to model complex signals in various domains. Recently, INR-based frameworks have shown promise in neural video compression by embedding video…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Taiga Hayami , Kakeru Koizumi , Hiroshi Watanabe

Video representation is a key challenge in many computer vision applications such as video classification, video captioning, and video surveillance. In this paper, we propose a novel approach for video representation that captures…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Mohammadreza Babaee , David Full , Gerhard Rigoll

Learned progressive image compression is gaining momentum as it allows improved image reconstruction as more bits are decoded at the receiver. We propose a progressive image compression method in which an image is first represented as a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Alberto Presta , Enzo Tartaglione , Attilio Fiandrotti , Marco Grangetto , Pamela Cosman

Semantic communication has emerged as a promising approach for improving efficient transmission in the next generation of wireless networks. Inspired by the success of semantic communication in different areas, we aim to provide a new…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Zhenguo Zhang , Qianqian Yang , Shibo He , Jiming Chen

We introduce a modality-agnostic neural compression algorithm based on a functional view of data and parameterised as an Implicit Neural Representation (INR). Bridging the gap between latent coding and sparsity, we obtain compact latent…

Machine Learning · Statistics 2023-04-10 Jonathan Richard Schwarz , Jihoon Tack , Yee Whye Teh , Jaeho Lee , Jinwoo Shin

Conceptual coding has been an emerging research topic recently, which encodes natural images into disentangled conceptual representations for compression. However, the compression performance of the existing methods is still sub-optimal due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Jianhui Chang , Zhenghui Zhao , Lingbo Yang , Chuanmin Jia , Jian Zhang , Siwei Ma

Recently, the deep learning technology has been successfully applied in the field of image compression, leading to superior rate-distortion performance. However, a challenge of many learning-based approaches is that they often achieve…

Image and Video Processing · Electrical Eng. & Systems 2023-08-24 Yongqiang Wang , Feng Liang , Haisheng Fu , Jie Liang , Haipeng Qin , Junzhe Liang

The demand for compact cameras capable of recording high-speed scenes with high resolution is steadily increasing. However, achieving such capabilities often entails high bandwidth requirements, resulting in bulky, heavy systems unsuitable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhihong Zhang , Runzhao Yang , Jinli Suo , Yuxiao Cheng , Qionghai Dai

Nowadays, distributed smart cameras are deployed for a wide set of tasks in several application scenarios, ranging from object recognition, image retrieval, and forensic applications. Due to limited bandwidth in distributed systems,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-02 Ali Taalimi , Alireza Rahimpour , Liu Liu , Hairong Qi

Recent works have shown that learned models can achieve significant performance gains, especially in terms of perceptual quality measures, over traditional methods. Hence, the state of the art in image restoration and compression is getting…

Image and Video Processing · Electrical Eng. & Systems 2021-05-03 A. Murat Tekalp , Michele Covell , Radu Timofte , Chao Dong

A common strategy to video understanding is to incorporate spatial and motion information by fusing features derived from RGB frames and optical flow. In this work, we introduce a new way to leverage semantic segmentation as an intermediate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Juhana Kangaspunta , AJ Piergiovanni , Rico Jonschkowski , Michael Ryoo , Anelia Angelova

Recently, many neural network-based image compression methods have shown promising results superior to the existing tool-based conventional codecs. However, most of them are often trained as separate models for different target bit rates,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-09 Jooyoung Lee , Seyoon Jeong , Munchurl Kim

Multi-modal learning has become increasingly popular due to its ability to leverage information from different data sources (e.g., text and images) to improve the model performance. Recently, CLIP has emerged as an effective approach that…

Machine Learning · Computer Science 2024-07-12 Zixiang Chen , Yihe Deng , Yuanzhi Li , Quanquan Gu

Representing visual signals with implicit coordinate-based neural networks, as an effective replacement of the traditional discrete signal representation, has gained considerable popularity in computer vision and graphics. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Hongdong Li , Qing Wang