English
Related papers

Related papers: Undecimated Wavelet Transform for Word Embedded Se…

200 papers

A non-decimated wavelet transform (NDWT) is a popular version of wavelet transforms because of its many advantages in applications. The inherent redundancy of this transform proved beneficial in tasks of signal denoising and scaling…

Applications · Statistics 2016-04-26 Minkyoung Kang , Brani Vidakovic

Semantic communications could improve the transmission efficiency significantly by exploring the semantic information. In this paper, we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Signal Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin

Self-attentive neural syntactic parsers using contextualized word embeddings (e.g. ELMo or BERT) currently produce state-of-the-art results in joint parsing and disfluency detection in speech transcripts. Since the contextualized word…

Computation and Language · Computer Science 2020-04-30 Paria Jamshid Lou , Mark Johnson

In this paper, we propose a new class of high-efficiency semantic coded transmission methods for end-to-end speech transmission over wireless channels. We name the whole system as deep speech semantic transmission (DSST). Specifically, we…

Sound · Computer Science 2022-11-07 Zixuan Xiao , Shengshi Yao , Jincheng Dai , Sixian Wang , Kai Niu , Ping Zhang

Semantic communications seeks to transfer information from a source while conveying a desired meaning to its destination. We model the transmitter-receiver functionalities as an autoencoder followed by a task classifier that evaluates the…

Cryptography and Security · Computer Science 2022-12-21 Yalin E. Sagduyu , Tugba Erpek , Sennur Ulukus , Aylin Yener

Recent advancements in information technology and the widespread use of the Internet have led to easier access to data worldwide. As a result, transmitting data through noisy channels is inevitable. Reducing the size of data and protecting…

Multi-channel speech enhancement with ad-hoc sensors has been a challenging task. Speech model guided beamforming algorithms are able to recover natural sounding speech, but the speech models tend to be oversimplified or the inference would…

Computation and Language · Computer Science 2018-02-16 Kaizhi Qian , Yang Zhang , Shiyu Chang , Xuesong Yang , Dinei Florencio , Mark Hasegawa-Johnson

Missing data is a recurrent and challenging problem, especially when using machine learning algorithms for real-world applications. For this reason, missing data imputation has become an active research area, in which recent deep learning…

Machine Learning · Computer Science 2021-07-01 Simon Tihon , Muhammad Usama Javaid , Damien Fourure , Nicolas Posocco , Thomas Peel

Masked Language Modeling (MLM) is widely used to pretrain language models. The standard random masking strategy in MLM causes the pre-trained language models (PLMs) to be biased toward high-frequency tokens. Representation learning of rare…

Computation and Language · Computer Science 2023-05-25 Linhan Zhang , Qian Chen , Wen Wang , Chong Deng , Xin Cao , Kongzhang Hao , Yuxin Jiang , Wei Wang

Conventional word sense induction (WSI) methods usually represent each instance with discrete linguistic features or cooccurrence features, and train a model for each polysemous word individually. In this work, we propose to learn sense…

Computation and Language · Computer Science 2016-06-23 Linfeng Song , Zhiguo Wang , Haitao Mi , Daniel Gildea

This paper proposes the continuous semantic topic embedding model (CSTEM) which finds latent topic variables in documents using continuous semantic distance function between the topics and the words by means of the variational…

Machine Learning · Statistics 2017-11-27 Namkyu Jung , Hyeong In Choi

Word embeddings are representations of individual words of a text document in a vector space and they are often use- ful for performing natural language pro- cessing tasks. Current state of the art al- gorithms for learning word embeddings…

Computation and Language · Computer Science 2018-05-15 Prathusha Kameswara Sarma , Bill Sethares

Watermarking serves as a widely adopted approach to safeguard media copyright. In parallel, the research focus has extended to watermark removal techniques, offering an adversarial means to enhance watermark robustness and foster…

Multimedia · Computer Science 2023-08-23 Dongjian Huo , Zehong Zhang , Hanjing Su , Guanbin Li , Chaowei Fang , Qingyao Wu

Many applications of speech communication and speaker identification suffer from the problem of co-channel speech. This paper deals with a multi-resolution dyadic wavelet transform method for usable segments of co-channel speech detection…

Sound · Computer Science 2013-01-03 Wajdi Ghezaiel , Amel Ben Slimane Rahmouni , Ezzedine Ben Braiek

User and Entity Behaviour Analytics (UEBA) is a broad branch of data analytics that attempts to build a normal behavioural profile in order to detect anomalous events. Among the techniques used to detect anomalies, Deep Autoencoders…

Cryptography and Security · Computer Science 2025-10-31 Jose Fuentes , Ines Ortega-Fernandez , Nora M. Villanueva , Marta Sestelo

Semantic sentence embedding models encode natural language sentences into vectors, such that closeness in embedding space indicates closeness in the semantics between the sentences. Bilingual data offers a useful signal for learning such…

Computation and Language · Computer Science 2020-11-20 John Wieting , Graham Neubig , Taylor Berg-Kirkpatrick

Traditional security protection methods struggle to address sophisticated attack vectors in large-scale distributed systems, particularly when balancing detection accuracy with data privacy concerns. This paper presents a novel distributed…

Cryptography and Security · Computer Science 2025-02-26 Yuqing Wang , Xiao Yang

This paper proposes an oblivious watermarking algorithm with blind detection approach for high volume data hiding in image signals. We present a detection reliable signal adaptive embedding scheme for multiple messages in selective…

Cryptography and Security · Computer Science 2012-07-12 T. S. Das , V. H. Mankar , S. K. Sarkar

Self-supervised learning (SSL) speech representation models, trained on large speech corpora, have demonstrated effectiveness in extracting hierarchical speech embeddings through multiple transformer layers. However, the behavior of these…

Computation and Language · Computer Science 2024-06-18 Zihan Pan , Tianchi Liu , Hardik B. Sailor , Qiongqiong Wang

This project intends to study the image representation based on attention mechanism and multimodal data. By adding multiple pattern layers to the attribute model, the semantic and hidden layers of image content are integrated. The word…

Computation and Language · Computer Science 2024-06-14 Dan Sun , Yaxin Liang , Yining Yang , Yuhan Ma , Qishi Zhan , Erdi Gao