English
Related papers

Related papers: Spectral-Enhanced Transformers: Leveraging Large-S…

200 papers

A common practice in deep learning involves training large neural networks on massive datasets to achieve high accuracy across various domains and tasks. While this approach works well in many application areas, it often fails drastically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Heitor Rapela Medeiros , Masih Aminbeidokhti , Fidel Guerrero Pena , David Latortue , Eric Granger , Marco Pedersoli

Transformers have become the dominant model in natural language processing, owing to their ability to pretrain on massive amounts of data, then transfer to smaller, more specific tasks via fine-tuning. The Vision Transformer was the first…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Josh Beal , Eric Kim , Eric Tzeng , Dong Huk Park , Andrew Zhai , Dmitry Kislyuk

To develop a preliminary understanding towards Graph Foundation Models, we study the extent to which pretrained Graph Neural Networks can be applied across datasets, an effort requiring to be agnostic to dataset-specific features and their…

In hyperspectral remote sensing data mining, it is important to take into account of both spectral and spatial information, such as the spectral signature, texture feature and morphological property, to improve the performances, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Lefei Zhang , Qian Zhang , Bo Du , Xin Huang , Yuan Yan Tang , Dacheng Tao

A Hyperspectral image contains much more number of channels as compared to a RGB image, hence containing more information about entities within the image. The convolutional neural network (CNN) and the Multi-Layer Perceptron (MLP) have been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Uphar Singh , Kumar Saurabh , Neelaksh Trehan , Ranjana Vyas , O. P. Vyas

Efficient and accurate object detection in video and image analysis is one of the major beneficiaries of the advancement in computer vision systems with the help of deep learning. With the aid of deep learning, more powerful tools evolved,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Karthik E

Feature learning for 3D object detection from point clouds is very challenging due to the irregularity of 3D point cloud data. In this paper, we propose Pointformer, a Transformer backbone designed for 3D point clouds to learn features…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Xuran Pan , Zhuofan Xia , Shiji Song , Li Erran Li , Gao Huang

Mass spectrometry is the dominant technology in the field of proteomics, enabling high-throughput analysis of the protein content of complex biological samples. Due to the complexity of the instrumentation and resulting data, sophisticated…

In this paper, we present a new tracking architecture with an encoder-decoder transformer as the key component. The encoder models the global spatio-temporal feature dependencies between target objects and search regions, while the decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Bin Yan , Houwen Peng , Jianlong Fu , Dong Wang , Huchuan Lu

Hyperspectral target detection is a pixel-level recognition problem. Given a few target samples, it aims to identify the specific target pixels such as airplane, vehicle, ship, from the entire hyperspectral image. In general, the background…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Can Yao , Yuan Yuan , Zhiyu Jiang

Hyperspectral images provide abundant spatial and spectral information that is very valuable for material detection in diverse areas of practical science. The high-dimensions of data lead to many processing challenges that can be addressed…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Saeideh Ghanbari Azar , Saeed Meshgini , Tohid Yousefi Rezaii , Soosan Beheshti

Pan-sharpening aims at producing a high-resolution (HR) multi-spectral (MS) image from a low-resolution (LR) multi-spectral (MS) image and its corresponding panchromatic (PAN) image acquired by a same satellite. Inspired by a new fashion in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Huanyu Zhou , Qingjie Liu , Yunhong Wang

Hyperspectral imaging sensors are becoming increasingly popular in robotics applications such as agriculture and mining, and allow per-pixel thematic classification of materials in a scene based on their unique spectral signatures.…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Lloyd Windrim , Rishi Ramakrishnan , Arman Melkumyan , Richard Murphy

Reliable detection and tracking of surrounding objects are indispensable for comprehensive motion prediction and planning of autonomous vehicles. Due to the limitations of individual sensors, the fusion of multiple sensor modalities is…

Robotics · Computer Science 2023-10-13 Phillip Karle , Felix Fent , Sebastian Huch , Florian Sauerbeck , Markus Lienkamp

Fine-grained image recognition is challenging because discriminative clues are usually fragmented, whether from a single image or multiple images. Despite their significant improvements, most existing methods still focus on the most…

Multimedia · Computer Science 2022-06-07 Xinda Liu , Lili Wang , Xiaoguang Han

Transformers have proven superior performance for a wide variety of tasks since they were introduced. In recent years, they have drawn attention from the vision community in tasks such as image classification and object detection. Despite…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Yihong Xu , Yutong Ban , Guillaume Delorme , Chuang Gan , Daniela Rus , Xavier Alameda-Pineda

Object detection has achieved promising success, but requires large-scale fully-annotated data, which is time-consuming and labor-extensive. Therefore, we consider object detection with mixed supervision, which learns novel object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Yan Liu , Zhijie Zhang , Li Niu , Junjie Chen , Liqing Zhang

Optimization based tracking methods have been widely successful by integrating a target model prediction module, providing effective global reasoning by minimizing an objective function. While this inductive bias integrates valuable domain…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Christoph Mayer , Martin Danelljan , Goutam Bhat , Matthieu Paul , Danda Pani Paudel , Fisher Yu , Luc Van Gool

Recently there has been substantial interest in spectral methods for learning dynamical systems. These methods are popular since they often offer a good tradeoff between computational and statistical efficiency. Unfortunately, they can be…

Machine Learning · Statistics 2015-11-05 Ahmed Hefny , Carlton Downey , Geoffrey Gordon

Multitemporal hyperspectral image unmixing (MTHU) holds significant importance in monitoring and analyzing the dynamic changes of surface. However, compared to single-temporal unmixing, the multitemporal approach demands comprehensive…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Hang Li , Qiankun Dong , Xueshuo Xie , Xia Xu , Tao Li , Zhenwei Shi