English
Related papers

Related papers: INR-MDSQC: Implicit Neural Representation Multiple…

200 papers

Traditional image/video compression aims to reduce the transmission/storage cost with signal fidelity as high as possible. However, with the increasing demand for machine analysis and semantic monitoring in recent years, semantic fidelity…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Jiguo Li , Chuanmin Jia , Xinfeng Zhang , Siwei Ma , Wen Gao

Deep Model Predictive Control (Deep MPC) is an evolving field that integrates model predictive control and deep learning. This manuscript is focused on a particular approach, which employs deep neural network in the loop with MPC. This…

Systems and Control · Electrical Eng. & Systems 2025-11-24 Prabhat K. Mishra , Mateus V. Gasparino , Girish Chowdhary

Implicit neural representations map a shape-specific latent code and a 3D coordinate to its corresponding signed distance (SDF) value. However, this approach only offers a single level of detail. Emulating low levels of detail can be…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Benoit Guillard , Marc Habermann , Christian Theobalt , Pascal Fua

Semantic-oriented communication has been considered as a promising to boost the bandwidth efficiency by only transmitting the semantics of the data. In this paper, we propose a multi-level semantic aware communication system for wireless…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Zhenguo Zhang , Qianqian Yang , Shibo He , Mingyang Sun , Jiming Chen

Complex-valued processing brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the noise reduction process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram. Complex…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-24 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante-B. , Andreas Maier

Training Large Multimodality Models (LMMs) relies on descriptive image caption that connects image and language. Existing methods for generating such captions often rely on distilling the captions from pretrained LMMs, constructing them…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yanpeng Sun , Jing Hao , Ke Zhu , Jiang-Jiang Liu , Yuxiang Zhao , Xiaofan Li , Na Zhao , Zechao Li , Jingdong Wang

Hyperdimensional Computing (HDC) is a brain-inspired and light-weight machine learning method. It has received significant attention in the literature as a candidate to be applied in the wearable internet of things, near-sensor artificial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Laura Smets , Werner Van Leekwijck , Ing Jyh Tsang , Steven Latré

Neural implicit representations have shown substantial improvements in efficiently storing 3D data, when compared to conventional formats. However, the focus of existing work has mainly been on storage and subsequent reconstruction. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Theo W. Costain , Victor Adrian Prisacariu

Current brain-computer interfaces primarily decode single motor variables, limiting their ability to support natural, high-bandwidth neural control that requires simultaneous extraction of multiple correlated motor dimensions. We introduce…

Neurons and Cognition · Quantitative Biology 2025-08-13 Kaixi Tian , Shengjia Zhao , Yuhan Zhang , Shan Yu

Metric learning seeks to embed images of objects suchthat class-defined relations are captured by the embeddingspace. However, variability in images is not just due to different depicted object classes, but also depends on other latent…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Karsten Roth , Biagio Brattoli , Björn Ommer

Implicit Neural Representations (INRs) have emerged in the last few years as a powerful tool to encode continuously a variety of different signals like images, videos, audio and 3D shapes. When applied to 3D shapes, INRs allow to overcome…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Luca De Luigi , Adriano Cardace , Riccardo Spezialetti , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Multimodal representation learning is a challenging task in which previous work mostly focus on either uni-modality pre-training or cross-modality fusion. In fact, we regard modeling multimodal representation as building a skyscraper, where…

Computation and Language · Computer Science 2024-08-15 Ronghao Lin , Haifeng Hu

Implicit neural representations (INR) have gained increasing attention in representing 3D scenes and images, and have been recently applied to encode videos (e.g., NeRV, E-NeRV). While achieving promising results, existing INR-based methods…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Bo He , Xitong Yang , Hanyu Wang , Zuxuan Wu , Hao Chen , Shuaiyi Huang , Yixuan Ren , Ser-Nam Lim , Abhinav Shrivastava

Implicit Neural Representations (INRs) provide a powerful continuous framework for modeling complex visual and geometric signals, but spectral bias remains a fundamental challenge, limiting their ability to capture high-frequency details.…

Machine Learning · Computer Science 2025-12-01 Yesom Park , Kelvin Kan , Thomas Flynn , Yi Huang , Shinjae Yoo , Stanley Osher , Xihaier Luo

Conditional coding has lately emerged as the mainstream approach to learned video compression. However, a recent study shows that it may perform worse than residual coding when the information bottleneck arises. Conditional residual coding…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Yi-Hsin Chen , Hong-Sheng Xie , Cheng-Wei Chen , Zong-Lin Gao , Martin Benjak , Wen-Hsiao Peng , Jörn Ostermann

A mainstream type of current self-supervised learning methods pursues a general-purpose representation that can be well transferred to downstream tasks, typically by optimizing on a given pretext task such as instance discrimination. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Xin Liu , Zhongdao Wang , Yali Li , Shengjin Wang

The representation, or encoding, utilized in evolutionary algorithms has a substantial effect on their performance. Examination of the suitability of widely used representations for quality diversity optimization (QD) in robotic domains has…

Neural and Evolutionary Computing · Computer Science 2023-04-10 Ludovico Scarton , Alexander Hagg

One of the primary areas of interest in High Performance Computing is the improvement of performance of parallel workloads. Nowadays, compilable source code-based optimization tasks that employ deep learning often exploit LLVM Intermediate…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-03 Akash Dutta , Ali Jannesari

Convolutional neural network (CNN) and its variants have led to many state-of-art results in various fields. However, a clear theoretical understanding about them is still lacking. Recently, multi-layer convolutional sparse coding (ML-CSC)…

Machine Learning · Computer Science 2020-07-22 Zhiyang Zhang , Shihua Zhang

Compression for machines is an emerging field, where inputs are encoded while optimizing the performance of downstream automated analysis. In scalable coding for humans and machines, the compressed representation used for machines is…

Image and Video Processing · Electrical Eng. & Systems 2023-05-19 Alon Harell , Yalda Foroutan , Ivan V. Bajic