English
Related papers

Related papers: A novel asymmetrical autoencoder with a sparsifyin…

200 papers

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

In the area of bearing fault diagnosis, deep learning (DL) methods have been widely used recently. However, due to the high cost or privacy concerns, high-quality labeled data are scarce in real world scenarios. While few-shot learning has…

Machine Learning · Computer Science 2025-09-16 Shengke Sun , Shuzhen Han , Ziqian Luan , Xinghao Qin , Jiao Yin , Zhanshan Zhao , Jinli Cao , Hua Wang

A model, called the linear transform network (LTN), is proposed to analyze the compression and estimation of correlated signals transmitted over directed acyclic graphs (DAGs). An LTN is a DAG network with multiple source and receiver…

Information Theory · Computer Science 2015-04-15 Naveen Goela , Michael Gastpar

Linear encoding of sparse vectors is widely popular, but is commonly data-independent -- missing any possible extra (but a priori unknown) structure beyond sparsity. In this paper we present a new method to learn linear encoders that adapt…

Sparse autoencoders (SAEs) have become a central tool for interpreting language models. However, two key SAE analyses that remain difficult to scale are (1) matching semantically similar features across multi-layers and (2) compressing…

Machine Learning · Computer Science 2026-05-28 Tue M. Cao , Nguyen Do , My T. Thai

Distributed model training suffers from communication bottlenecks due to frequent model updates transmitted across compute nodes. To alleviate these bottlenecks, practitioners use gradient compression techniques like sparsification,…

Machine Learning · Computer Science 2020-11-02 Saurabh Agarwal , Hongyi Wang , Kangwook Lee , Shivaram Venkataraman , Dimitris Papailiopoulos

Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Muhammad Ahmad , Francesco Mauro , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan , Silvia Liberata Ullo

Three-dimensional seismic full-waveform inversion (FWI) provides high-fidelity subsurface velocity models but is restricted by high computational cost, strong nonlinearity, cycle-skipping, and heavy dependence on initial models. Although…

Geophysics · Physics 2026-03-19 Guoxin Chen , Wenjie Wang , Haiyang Lu , Jinxin Chen

Training large-scale distributed machine learning models imposes considerable demands on network infrastructure, often resulting in sudden traffic spikes that lead to congestion, increased latency, and reduced throughput, which would…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-23 Yisu Wang , Xinjiao Li , Ruilong Wu , Huangxun Chen , Dirk Kutscher

Reliable control of myoelectric prostheses is often hindered by high inter-subject variability and the clinical impracticality of high-density sensor arrays. This study proposes a deep learning framework for accurate gesture recognition…

Transformer-based models have achieved strong performance in remote sensing image captioning by capturing long-range dependencies and contextual information. However, their practical deployment is hindered by high computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Swadhin Das , Divyansh Mundra , Priyanshu Dayal , Raksha Sharma

Modern sensors produce increasingly rich streams of high-resolution data. Due to resource constraints, machine learning systems discard the vast majority of this information via resolution reduction. Compressed-domain learning allows models…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Dan Jacobellis , Neeraja J. Yadwadkar

Data-parallel SGD is the de facto algorithm for distributed optimization, especially for large scale machine learning. Despite its merits, communication bottleneck is one of its persistent issues. Most compression schemes to alleviate this…

Neural and Evolutionary Computing · Computer Science 2024-02-07 Ashok Vardhan Makkuva , Marco Bondaschi , Thijs Vogels , Martin Jaggi , Hyeji Kim , Michael C. Gastpar

This paper explores learned image compression based on traditional and learned discrete wavelet transform (DWT) architectures and learned entropy models for coding DWT subband coefficients. A learned DWT is obtained through the lifting…

Image and Video Processing · Electrical Eng. & Systems 2022-12-08 Ugur Berk Sahin , Fatih Kamisli

Compressed sensing enables sparse sampling but relies on generic bases and random measurements, limiting efficiency and reconstruction quality. Optimal sensor placement uses historcal data to design tailored sampling patterns, yet its…

Machine Learning · Computer Science 2025-12-04 Adil Rasheed , Mikael Aleksander Jansen Shahly , Muhammad Faisal Aftab

The large volume of electroencephalograph (EEG) data produced by brain-computer interface (BCI) systems presents challenges for rapid transmission over bandwidth-limited channels in Internet of Things (IoT) networks. To address the issue,…

Signal Processing · Electrical Eng. & Systems 2025-03-14 Xin Zhu , Hongyi Pan , Ahmet Enis Cetin

Parameterized mathematical models play a central role in understanding and design of complex information systems. However, they often cannot take into account the intricate interactions innate to such systems. On the contrary, purely…

Machine Learning · Computer Science 2019-12-13 Shahin Khobahi , Arindam Bose , Mojtaba Soltanalian

To strike a balance between energy efficiency and data quality control, this paper proposes a sensor censoring scheme for distributed sparse signal recovery via compressive-sensing based wireless sensor networks. In the proposed approach,…

Information Theory · Computer Science 2018-01-16 Jwo-Yuh Wu , Ming-Hsun Yang , Tsang-Yi Wang

Sparse support recovery arises in many applications in communications and signal processing. Existing methods tackle sparse support recovery problems for a given measurement matrix, and cannot flexibly exploit the properties of sparsity…

Information Theory · Computer Science 2019-10-11 Shuaichao Li , Wanqing Zhang , Ying Cui , Hei Victor Cheng , Wei Yu

Detecting anomalous regions in images is a frequently encountered problem in industrial monitoring. A relevant example is the analysis of tissues and other products that in normal conditions conform to a specific texture, while defects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Andrea Bionda , Luca Frittoli , Giacomo Boracchi