English
Related papers

Related papers: SDSC:A Structure-Aware Metric for Semantic Signal …

200 papers

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

Supervised learning methods have shown effectiveness in estimating spatial acoustic parameters such as time difference of arrival, direct-to-reverberant ratio and reverberation time. However, they still suffer from the simulation-to-reality…

Sound · Computer Science 2024-09-10 Bing Yang , Xiaofei Li

Deep-feature-based perceptual similarity models have demonstrated strong alignment with human visual perception in Image Quality Assessment (IQA). However, most existing approaches operate at a single spatial scale, implicitly assuming that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Danling Kang , Xue-Hua Chen , Bin Liu , Keke Zhang , Weiling Chen , Tiesong Zhao

In this paper, we propose a new paradigm to learn audio features for Music Structure Analysis (MSA). We train a deep encoder to learn features such that the Self-Similarity-Matrix (SSM) resulting from those approximates a ground-truth SSM.…

Sound · Computer Science 2022-11-16 Geoffroy Peeters , Florian Angulo

Recently, SimCSE has shown the feasibility of contrastive learning in training sentence embeddings and illustrates its expressiveness in spanning an aligned and uniform embedding space. However, prior studies have shown that dense models…

Computation and Language · Computer Science 2023-11-08 Ruize An , Chen Zhang , Dawei Song

Self-supervised learning (SSL) has emerged as a powerful paradigm for medical image representation learning, particularly in settings with limited labeled data. However, existing SSL methods often rely on complex architectures,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Azad Singh , Deepak Mishra

Self-supervised semantic segmentation methods often suffer from structural errors, including merging distinct objects or fragmenting coherent regions, because they rely primarily on low-level appearance cues such as color and texture. These…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Haotang Li , Zhenyu Qi , Hao Qin , Huanrui Yang , Kebin Peng , Qing Guo , Sen He

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Self-supervised representation learning for visual pre-training has achieved remarkable success with sample (instance or pixel) discrimination and semantics discovery of instance, whereas there still exists a non-negligible gap between…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Xiaoni Li , Yu Zhou , Yifei Zhang , Aoting Zhang , Wei Wang , Ning Jiang , Haiying Wu , Weiping Wang

We consider a semantic communication system for speech signals, named DeepSC-S. Motivated by the breakthroughs in deep learning (DL), we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

This paper describes Difference-aware Deep continuous prompt for Contrastive Sentence Embeddings (D2CSE) that learns sentence embeddings. Compared to state-of-the-art approaches, D2CSE computes sentence vectors that are exceptional to…

Computation and Language · Computer Science 2023-04-19 Hyunjae Lee

We propose DiffCSE, an unsupervised contrastive learning framework for learning sentence embeddings. DiffCSE learns sentence embeddings that are sensitive to the difference between the original sentence and an edited sentence, where the…

Computation and Language · Computer Science 2022-04-22 Yung-Sung Chuang , Rumen Dangovski , Hongyin Luo , Yang Zhang , Shiyu Chang , Marin Soljačić , Shang-Wen Li , Wen-tau Yih , Yoon Kim , James Glass

Cross-modal metric learning is a prominent research topic that bridges the semantic heterogeneity between vision and language. Existing methods frequently utilize simple cosine or complex distance metrics to transform the pairwise features…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Haiwen Diao , Ying Zhang , Shang Gao , Jiawen Zhu , Long Chen , Huchuan Lu

Multi-contrast Magnetic Resonance Imaging super-resolution (MC-MRI SR) aims to enhance low-resolution (LR) contrasts leveraging high-resolution (HR) references, shortening acquisition time and improving imaging efficiency while preserving…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Xiaoman Wu , Lubin Gan , Siying Wu , Jing Zhang , Yunwei Ou , Xiaoyan Sun

Semantic communications (SCs) aim to transmit only the essential information required to perform given tasks, thereby improving communication efficiency. Deep learning-based joint source-channel coding (deep JSCC) has emerged as a promising…

Signal Processing · Electrical Eng. & Systems 2026-04-07 Eunhye Hong , Taewoo Park , Yongjune Kim

Deep Joint Source-Channel Coding (Deep-JSCC) has emerged as a promising semantic communication approach for wireless image transmission by jointly optimizing source and channel coding using deep learning techniques. However, traditional…

Networking and Internet Architecture · Computer Science 2025-07-29 Avi Deb Raha , Apurba Adhikary , Mrityunjoy Gain , Yumin Park , Walid Saad , Choong Seon Hong

Semantic communications are expected to accomplish various semantic tasks with relatively less spectrum resource by exploiting the semantic feature of source data. To simultaneously serve both the data transmission and semantic tasks, joint…

Information Theory · Computer Science 2023-08-15 Jianhao Huang , Dongxu Li , Chuan Huang , Xiaoqi Qin , Wei Zhang

Semantic communication, as a revolutionary communication architecture, is considered a promising novel communication paradigm. Unlike traditional symbol-based error-free communication systems, semantic-based visual communication systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang

Semi-supervised learning has proven highly effective in tackling the challenge of limited labeled training data in medical image segmentation. In general, current approaches, which rely on intra-image pixel-wise consistency training via…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Han Wu , Chong Wang , Zhiming Cui

Hyperspectral images with high spectral resolution provide new insights into recognizing subtle differences in similar substances. However, object detection in hyperspectral images faces significant challenges in intra- and inter-class…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Xiao He , Chang Tang , Xinwang Liu , Wei Zhang , Zhimin Gao , Chuankun Li , Shaohua Qiu , Jiangfeng Xu