English
Related papers

Related papers: SpectrumFM: Redefining Spectrum Cognition via Foun…

200 papers

The development of noninvasive brain imaging such as resting-state functional magnetic resonance imaging (rs-fMRI) and its combination with AI algorithm provides a promising solution for the early diagnosis of Autism spectrum disorder…

Image and Video Processing · Electrical Eng. & Systems 2022-04-11 Fangyu Zhang , Yanjie Wei , Jin Liu , Yanlin Wang , Wenhui Xi , Yi Pan

Recent developments in Parameter-Efficient Fine-Tuning (PEFT) methods for pretrained deep neural networks have captured widespread interest. In this work, we study the enhancement of current PEFT methods by incorporating the spectral…

Machine Learning · Computer Science 2024-11-05 Fangzhao Zhang , Mert Pilanci

Speculative decoding (SD) has emerged as a powerful method for accelerating autoregressive generation in large language models (LLMs), yet its integration into vision-language models (VLMs) remains underexplored. We introduce DREAM, a novel…

Computation and Language · Computer Science 2025-10-24 Yunhai Hu , Tianhua Xia , Zining Liu , Rahul Raman , Xingyu Liu , Bo Bao , Eric Sather , Vithursan Thangarasa , Sai Qian Zhang

Hyperspectral images are crucial for many research works. Spectral super-resolution (SSR) is a method used to obtain high spatial resolution (HR) hyperspectral images from HR multispectral images. Traditional SSR methods include…

Image and Video Processing · Electrical Eng. & Systems 2020-12-09 Jiang He , Jie Li , Qiangqiang Yuan , Huanfeng Shen , Liangpei Zhang

This paper proposes a new loss using short-time Fourier transform (STFT) spectra for the aim of training a high-performance neural speech waveform model that predicts raw continuous speech waveform samples directly. Not only amplitude…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Shinji Takaki , Toru Nakashika , Xin Wang , Junichi Yamagishi

The foundation model has recently garnered significant attention due to its potential to revolutionize the field of visual representation learning in a self-supervised manner. While most foundation models are tailored to effectively process…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Danfeng Hong , Bing Zhang , Xuyang Li , Yuxuan Li , Chenyu Li , Jing Yao , Naoto Yokoya , Hao Li , Pedram Ghamisi , Xiuping Jia , Antonio Plaza , Paolo Gamba , Jon Atli Benediktsson , Jocelyn Chanussot

The versatility of self-attention mechanism earned transformers great success in almost all data modalities, with limitations on the quadratic complexity and difficulty of training. To apply transformers across different data modalities,…

Machine Learning · Computer Science 2024-08-20 Viet Anh Nguyen , Minh Lenhat , Khoa Nguyen , Duong Duc Hieu , Dao Huu Hung , Truong Son Hy

Neural models have yielded state-of-the-art results in deciphering spoken language understanding (SLU) problems; however, these models require a significant amount of domain-specific labeled examples for training, which is prohibitively…

Computation and Language · Computer Science 2020-10-12 Jin Cao , Jun Wang , Wael Hamza , Kelly Vanee , Shang-Wen Li

The use of unlicensed spectrum for cellular systems to mitigate spectrum scarcity has led to the development of intelligent adaptive approaches to spectrum access that improve upon traditional carrier sensing and listen-before-talk methods.…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Akash Doshi , Jeffrey G. Andrews

In this paper, we optimize a faster region-based convolutional neural network (FRCNN) for 1-dimensional (1D) signal processing and electromagnetic spectrum sensing. We target a cluttered radio frequency (RF) environment, where multiple RF…

Signal Processing · Electrical Eng. & Systems 2023-02-21 Todd Morehouse , Charles Montes , Ruolin Zhou

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective…

Machine Learning · Computer Science 2025-10-24 Jacob L. Block , Sundararajan Srinivasan , Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Spectrum scarcity is a prevalent problem in wireless networks due to the strict allotment of the spectrum (frequency bands) to licensed users by network regulatory bodies. Such an operation implies that the unlicensed users (secondary…

Networking and Internet Architecture · Computer Science 2023-10-03 Nyashadzashe Tamuka , Khulumani Sibanda

We present Masked Frequency Modeling (MFM), a unified frequency-domain-based approach for self-supervised pre-training of visual models. Instead of randomly inserting mask tokens to the input embeddings in the spatial domain, in this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Jiahao Xie , Wei Li , Xiaohang Zhan , Ziwei Liu , Yew Soon Ong , Chen Change Loy

Development of smart spectrum sensing techniques is the most important task in the design of a cognitive radio system which uses the available spectrum efficiently. The adaptive SNR estimation based energy detection technique has the dual…

Networking and Internet Architecture · Computer Science 2017-11-09 Jonti Talukdar , Bhavana Mehta , Kinjal Aggrawal , Mansi Kamani

Identification of the type of communication technology and/or modulation scheme based on detected radio signal are challenging problems encountered in a variety of applications including spectrum allocation and radio interference…

Signal Processing · Electrical Eng. & Systems 2020-11-18 Ziqi Ke , Haris Vikalo

This paper looks into the technology classification problem for a distributed wireless spectrum sensing network. First, a new data-driven model for Automatic Modulation Classification (AMC) based on long short term memory (LSTM) is…

Networking and Internet Architecture · Computer Science 2018-07-12 Sreeraj Rajendran , Wannes Meert , Domenico Giustiniano , Vincent Lenders , Sofie Pollin

Hyperspectral object tracking using snapshot mosaic cameras is emerging as it provides enhanced spectral information alongside spatial data, contributing to a more comprehensive understanding of material properties. Using transformers,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Shaheer Mohamed , Tharindu Fernando , Sridha Sridharan , Peyman Moghadam , Clinton Fookes

Automatic Modulation Recognition (AMR) plays a crucial role in wireless communication systems. Deep learning AMR strategies have achieved tremendous success in recent years. Modulated signals exhibit long temporal dependencies, and…

Signal Processing · Electrical Eng. & Systems 2024-01-03 Yunpeng Qu , Zhilin Lu , Rui Zeng , Jintao Wang , Jian Wang

Structural Health Monitoring (SHM) is a critical task for ensuring the safety and reliability of civil infrastructures, typically realized on bridges and viaducts by means of vibration monitoring. In this paper, we propose for the first…

Spectrum sensing is an essential component of modern wireless networks as it offers a tool to characterize spectrum usage and better utilize it. Deep Learning (DL) has become one of the most used techniques to perform spectrum sensing as…

Networking and Internet Architecture · Computer Science 2024-01-11 Clifton Paul Robinson , Daniel Uvaydov , Salvatore D'Oro , Tommaso Melodia