You are in:Home/Publications/Feature extraction from hyperspectral images using RCNN and Vision Transformer

Assist. Eman Nasser Abdel Hafez :: Publications:

Title:
Feature extraction from hyperspectral images using RCNN and Vision Transformer
Authors: Eman N. Abdelhafez ;Ahmed Hagag ;Tamer A. Abassy
Year: 2024
Keywords: Not Available
Journal: Not Available
Volume: Not Available
Issue: Not Available
Pages: Not Available
Publisher: Not Available
Local/International: International
Paper Link:
Full paper Eman Nasser Abdel Hafez_Feature_extraction_from_hyperspectral_images_using_RCNN_and_Vision_Transformer.pdf
Supplementary materials Not Available
Abstract:

Hyperspectral images (HSI) are intricate and provide more spectral information than conventional images, making them ideal for deep learning approaches that handle 3D data. In this paper, we present a classification method for hyperspectral images (HSI) that begins with data augmentation using flipping techniques during the preprocessing phase. We then introduce a hybrid framework that combines a Vision Transformer (ViT) with a 3D Region Proposal Convolutional Neural Network (3D-RCNN). To mitigate overfitting, especially when training data is scarce, we incorporate a sequence aggregation layer. This methodology captures more comprehensive spatial-spectral complementary information while maintaining spectral integrity during feature extraction. Ultimately, the k-Nearest Neighbors (KNN) algorithm is utilized to classify the various classes within the HSI images. Experimental results indicate that our method significantly enhances classification accuracy across selected datasets.

Google ScholarAcdemia.eduResearch GateLinkedinFacebookTwitterGoogle PlusYoutubeWordpressInstagramMendeleyZoteroEvernoteORCIDScopus