Presentation + Paper
26 October 2022 Deep self-supervised band-level learning for hyperspectral classification
Author Affiliations +
Abstract
Hyperspectral image classification is one of the most researched topics within hyperspectral analysis. Its importance is determined by its immediate outcome, a classified image used for planning and decision-making processes within a variety of engineering and scientific disciplines. Within the last few years, researchers have solved this task employing self-supervised learning to learn robust feature representations to alleviate the dependency on large amounts of labels required by supervised deep learning. Aiming to learn representations for hyperspectral classification purposes, several of these works use dimensionality reduction that could exclude relevant information during feature learning. Moreover, they are based on contrastive instance learning that requires a large memory bank to store the result of pairwise feature discriminations, which represents a computational hurdle. To overcome these challenges, the current approach performs self-supervised cluster assignments between sets of contiguous bands to learn semantically meaningful representations that accurately contribute to solving the hyperspectral classification task with fewer labels. The approach starts with the pre-processing of the data for self-supervised learning purposes. Subsequently, the self-supervised band-level learning phase takes the preprocessed image patches to learn relevant feature representations. Afterwards, the classification step uses the previously learned encoder model and turns it into a pixel classifier to execute the classification with fewer labels than awaited. Lastly, the validation makes use of the kappa coefficient, and the overall and average accuracy as well-established metrics for assessing classification results. The method employs two benchmark datasets for evaluation. Experimental results show that the classification quality of the proposed method surpasses supervised learning and contrastive instance learning-based methods for the majority of the studied data partition levels. The construction of the most adequate set of augmentations for hyperspectral imagery also indicated the potential of the results to further improve.
Conference Presentation
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Jonathan González Santiago, Fabian Schenkel, and Wolfgang Middelmann "Deep self-supervised band-level learning for hyperspectral classification", Proc. SPIE 12267, Image and Signal Processing for Remote Sensing XXVIII, 122670I (26 October 2022); https://doi.org/10.1117/12.2636245
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Classification systems

Hyperspectral imaging

Image classification

Image processing

Machine learning

Back to Top