Computer Science and Information Systems 2022 Volume 19, Issue 2, Pages: 783-801
https://doi.org/10.2298/CSIS210830005Z
Full text (
1242 KB)
Cited by
Hyper-graph regularized subspace clustering with skip connections for band selection of hyperspectral image
Zeng Meng (School of Computer Engineering, Hubei University of Arts and Science Xiangyang, Hubei, China), zengmeng@cug.edu.cn@hbuas.edu.cn
Ning Bin (School of Computer Engineering, Hubei University of Arts and Science Xiangyang, Hubei, China), ningbin2000@hbuas.edu.cn
Gu Qiong (School of Computer Engineering, Hubei University of Arts and Science Xiangyang, Hubei, China), qionggu@hbuas.edu.cn
Hu Chunyang (School of Computer Engineering, Hubei University of Arts and Science Xiangyang, Hubei, China), huchunyang@hbuas.edu.cn
Li Shuijia (School of Computer Science, China University of Geosciences Wuhan, Hubei, China), shuijiali@cug.edu.cn
The Hughes phenomenon of Hyperspectral images (HSIs) with the hundreds of continuous narrow bands makes the computational cost of HSIs processing high. Band selection is an effective way to solve such a problem and a lot of band selection methods have been proposed in recent years. In this paper, a novel hyper-graph regularized subspace clustering with skip connections (HRSC-SC) is proposed for band selection of hyperspectral image, which is a clustering-based band selection method. The networks combine subspace clustering into the convolutional auto-encoder by thinking of it as a self-expressive layer. To make full use of the historical feature maps obtained from the networks and tackle the problem of gradient vanishing caused by multiple nonlinear transformations, the symmetrical skip connections are added to the networks to pass image details from encoder to decoder. Furthermore, the hyper-graph regularization is presented to consider the manifold structure reflecting geometric information within data, which accurately describes the multivariate relationship between data points and makes the results of clustering more accurate so that select the most representative band subset. The proposed HRSC-SC band selection method is compared with the existing robust band selection algorithms on Indian Pines, Salinas-A, and Pavia University HSIs, showing that the results of the proposed method outperform the current state-of-the-art band selection methods. Especially, the overall accuracy of the clustering is the best on three real HSIs compared to other methods when the band selection number is 25, reaching 82.62%, 92.48%, and 96,5% respectively.
Keywords: Band selection, hyper-graph regularization, skip connections, subspace clustering, hyperspectral image
Show references
Mateus Habermann, Vincent Fremont, and Elcio Shiguemori. Unsupervised hyperspectral band selection using clustering and single-layer neural network. Revue Francaise de Photogrammetrie et de Teledetection, 2018, 09 2018.
P. Hu, X. Liu, Y. Cai, and Z. Cai. Band selection of hyperspectral images using multiobjective optimization-based sparse self-representation. IEEE Geoscience and Remote Sensing Letters, 16(3):452-456, 2019.
Chein-I Chang, Qian Du, Tzu-Lung Sun, and M. L. G. Althouse. A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 37(6):2631-2641, 1999.
K. Sun, X. Geng, and L. Ji. A new sparsity-based band selection method for target detection of hyperspectral image. IEEE Geoscience and Remote Sensing Letters, 12(2):329-333, 2015.
Xiaofei He, Deng Cai, and Partha Niyogi. Laplacian score for feature selection. In NIPS, 2005.
Ji-ming Li and Yun-tao Qian. Clustering-based hyperspectral band selection using sparse nonnegative matrix factorization. Journal of Zhejiang University - Science C, 12:542-549, 07 2011.
W. Sun, L. Zhang, B. Du, W. Li, and Y. Mark Lai. Band selection using improved sparse subspace clustering for hyperspectral imagery classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(6):2784-2797, 2015.
M. Zeng, Y. Cai, Z. Cai, X. Liu, P. Hu, and J. Ku. Unsupervised hyperspectral image band selection based on deep subspace clustering. IEEE Geoscience and Remote Sensing Letters, 16(12):1889-1893, 2019.
Pan Ji, Tong Zhang, Hongdong Li, Mathieu Salzmann, and Ian Reid. Deep subspace clustering networks. In I. Guyon, U. V. Luxburg, S. Bengio, H.Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017.
M. Zeng, Y. Cai, X. Liu, Z. Cai, and X. Li. Spectral-spatial clustering of hyperspectral image based on laplacian regularized deep subspace clustering. In IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium, 2019.
Xiao-Jiao Mao, Chunhua Shen, and Yu-Bin Yang. Image denoising using very deep fully convolutional encoder-decoder networks with symmetric skip connections. CoRR, abs/1603.09056, 2016.
Mikhail Belkin and Partha Niyogi. Laplacian eigenmaps and spectral techniques for embedding and clustering. In T. G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems 14, pages 585-591. MIT Press, 2002.
D. Cai, X. He, J. Han, and T. S. Huang. Graph regularized nonnegative matrix factorization for data representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(8):1548-1560, 2011.
X. Ma,W. Liu, S. Li, D. Tao, and Y. Zhou. Hypergraph p -laplacian regularization for remotely sensed image recognition. IEEE Transactions on Geoscience and Remote Sensing, 57(3):1585- 1595, 2019.
Y. Dai, B. Xu, S. Yan, and J. Xu. Study of cardiac arrhythmia classification based on convolutional neural network. Computer Science and Information Systems, 17(2):445-458, 2020.
Andrew Ng, Michael Jordan, and YairWeiss. On spectral clustering: Analysis and an algorithm. Adv. Neural Inf. Process. Syst, 14, 04 2002.
Jianbo Shi and J. Malik. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):888-905, 2000.
E. Elhamifar and R. Vidal. Sparse subspace clustering: Algorithm, theory, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(11):2765-2781, 2013.
J. F. C. Mota, J. M. F. Xavier, P. M. Q. Aguiar, and M. Püschel. D-admm: A communicationefficient distributed algorithm for separable optimization. IEEE Transactions on Signal Processing, 61(10):2718-2723, 2013.
Lu Canyi, Jiashi Feng, Zhouchen Lin, Tao Mei, and Shuicheng Yan. Subspace clustering by block diagonal representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, PP:1-1, 01 2018.
Qi Liu, Miltiadis Allamanis, Marc Brockschmidt, and Alexander Gaunt. Constrained graph variational autoencoders for molecule design. 05 2018.
J. A. Dabin, A. M. Haimovich, J. Mauger, and A. Dong. Blind source separation with l1 regularized sparse autoencoder. In 2020 29th Wireless and Optical Communications Conference (WOCC), pages 1-5, 2020.
G. Spigler. Denoising autoencoders for overgeneralization in neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(4):998-1004, 2020.
Pan Ji, M. Salzmann, and Hongdong Li. Efficient dense subspace clustering. In IEEE Winter Conference on Applications of Computer Vision, pages 461-468, 2014.
Xiao Jiao Mao, Chunhua Shen, and Yu Bin Yang. Image denoising using very deep fully convolutional encoder-decoder networks with symmetric skip connections. CoRR, abs/1603.09056, 2016.
F. Luo, B. Du, L. Zhang, L. Zhang, and D. Tao. Feature learning using spatial-spectral hypergraph discriminant analysis for hyperspectral image. IEEE Transactions on Cybernetics, 49(7):2406-2419, 2019.
G. Cheng and X. Tong. Fuzzy clustering multiple kernel support vector machine. In 2018 International Conference on Wavelet Analysis and Pattern Recognition (ICWAPR), pages 7- 12, 2018.
S. Rogic and L. Kascelan. Class balancing in customer segments classification using support vector machine rule extraction and ensemble learning. Computer Science and Information Systems, 18(3):893-925, 2021.80