Abstract
In this paper, we propose an image feature extraction method, multi-level Fisher vector aggregated completed local fractional order derivative feature vector (mFVFD), for face recognition. The novelties of our method are summarized as follows: (1) We propose multi-value local fractional order derivative feature vector to analyze the image local intrinsic edge information. (2) We define local multi-structure model to describe the variety and complexity of image structure feature. (3) We developed multiple kernel learning based multi-level Fisher vectors with different number of Gaussian components feature fusion method to capture different levels of the image characteristics. Extensive experiments are conducted on four standard face databases and the results have demonstrated that our proposed method outperforms the state-of-the-art.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)
Ji, L., Ren, Y., Liu, G., Pu, X.: Training-based gradient LBP feature models for multiresolution texture classification. IEEE Trans. Cybern. 48(9), 2683–2696 (2018)
Porwal, P., Pachade, S., Kokare, M., Giancardo, L., Mériaudeau, F.: Retinal image analysis for disease screening through local tetra patterns. Comput. Biol. Med. 102, 200–210 (2018)
Ji, L., Ren, Y., Pu, X., Liu, G.: Median local ternary patterns optimized with rotation-invariant uniform-three mapping for noisy texture classification. Pattern Recogn. 79, 387–401 (2018)
Alpaslan, N., Hanbay, K.: Multi-scale shape index-based local binary patterns for texture classification. IEEE Signal Process. Lett. 27, 660–664 (2020)
Yang, C., Hu, M., Zheng, Y., Wang, X., Gao, Y., Wu, H.: Facial expression recognition based on local double binary mapped pattern. In: Advances in Multimedia Information Processing – PCM 487–497(2018)
Zhang, B., Gao, Y., Zhao, S., Liu, J.: Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor. IEEE Trans. Image Process. 19(2), 533–544 (2010)
Guo, Z., Li, Q., You, J., Zhang, D., Liu, W.: Local directional derivative pattern for rotation invariant texture classification. Neural Comput. Appl. 21(8), 1893–1904 (2012)
Yuan, F.: Rotation and scale invariant local binary pattern based on high order directional derivatives for texture classification. Digit. Signal Process. 26, 142–152 (2014)
Lian, Z., Er, M.J., Cong, Y.: Local line derivative pattern for face recognition. In: IEEE International Conference on Image Processing. 1449–1452 (2012)
Yuan, F., Shi, J., Xia, X., Fang, Y., Fang, Z., Mei, T.: High-order local ternary patterns with locality preserving projection for smoke detection and image classification. Inf. Sci. 372, 225–240 (2016)
Murala, S., Maheshwari, R.P., Balasubramanian, R.: Local tetra patterns: a new feature descriptor for content-based image retrieval. IEEE Trans. Image Process. 21(5), 2874–2886 (2012)
Fan, K.C., Hung, T.Y.: A novel local pattern descriptor—local vector pattern in high-order derivative space for face recognition. IEEE Trans. Image Process. 23(7), 2877–2891 (2014)
Lv, H., Zhang, F., Wang, R.: Robust active contour model using patch-based signed pressure force and optimized fractional-order edge. IEEE Access 9, 8771–8785 (2021)
Lavín.Delgado, J.E., Solís.Pérez, J.E., Gómez.Aguilar, J.F., Escobar.Jiménez, R.F.: A new fractional-order mask for image edge detection based on caputo–fabrizio fractional-order derivative without singular kernel, Circuits, Systems, and Signal Processing, 39, (3), 1419–1448(2019)
Aboutabit, N.: A new construction of an image edge detection mask based on caputo–fabrizio fractional derivative, The Visual Computer (2020)
Shukla, A.K., Pandey, R.K., Reddy, P.K.: Generalized fractional derivative based adaptive algorithm for image denoising. Multimed. Tools Appl. 79(19–20), 14201–14224 (2020)
Hacini, M., Hachouf, F., Charef, A.: A bi-directional fractional-order derivative mask for image processing applications. IET Image Proc. 14(11), 2512–2524 (2020)
Guan, J., Ou, J., Lai, Z., Lai, Y.: Medical image enhancement method based on the fractional order derivative and the directional derivative. Int. J. Pattern Recognit. Artif. Intell. 32(03), 1857001 (2017)
Gao, C., Zhou, J., Liu, C., Pu, Q.: Image enhancement based on fractional directional derivative. Int. J. Mach. Learn. Cybern. 6(1), 35–41 (2014)
Shukla, A.K., Pandey, R.K., Pachori, R.B.: A fractional filter based efficient algorithm for retinal blood vessel segmentation. Biomed. Signal Process. Control 59, 101883 (2020)
Kumar, S., Jha, R.K.: FD-based detector for medical image watermarking. IET Image Proc. 13(10), 1773–1782 (2019)
Chen, J.L., Huang, C.H., Du, Y.C., Lin, C.H.: Combining fractional-order edge detection and chaos synchronisation classifier for fingerprint identification. IET Image Proc. 8(6), 354–362 (2014)
Yu, L., Ma, Y., Cao, Q.: Face recognition with histograms of fractional differential gradients. J. Electron. Imaging 23(3), 033012 (2014)
Yu, L., Cao, Q., Zhao, A.: Principal patterns of fractional-order differential gradients for face recognition. J. Electron. Imaging 24(1), 013021–013021 (2015)
Pu, Y.F., Zhou, J.L., Yuan, X.: Fractional differential mask: a fractional differential-based approach for multiscale texture enhancement. IEEE Trans. Image Process. 19(2), 491–511 (2010)
Perronnin, F., Dance, C.: Fisher kernels on visual vocabularies for image categorization. In: IEEE Conference on Computer Vision and Pattern Recognition. 1–8 (2007)
Sánchez, J., Perronnin, F., Mensink, T., Verbeek, J.: Image classification with the fisher vector: Theory and practice. Int. J. Comput. Vision 105(3), 222–245 (2013)
Pu, Y., Wang, W., Zhou, J., Wang, Y., Jia, H.: Fractional differential approach to detecting textural features of digital image and its fractional differential filter implementation. Sci. Chin. Ser. F: Inf. Sci. 51(9), 1319–1339 (2008)
Rakotomamonjy, A., Bach, F.R., Canu, S., Grandvalet, Y.: SimpleMKL. J. Mach. Learn. Res. 9, 2491–2521 (2008)
Martinez, A.M., Benavente, R.: The AR face database. Autonomous University of Barcelona, Computer Vision Centre (1998)
Lee, K.C., Ho, J., Kriegman, D.J.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 684–698 (2005)
Huang, G.B., Mattar, M., Lee, H., Learned.Miller, E.: Learning to align from scratch. Adv. Neural Inf. Process. Syst. 764–772 (2012)
Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The feret evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1090–1104 (2000)
Kazak, N., Koc, M.: Some variants of spiral LBP in texture recognition. IET Image Proc. 12(8), 1388–1393 (2018)
Kas, M., merabet, Y.E., Ruichek, Y., Messoussi, R.: Mixed neighborhood topology cross decoded patterns for image-based face recognition, Expert Systems with Applications, 114, 119–142 (2018)
Song, W., Zhang, Y., Liu, F., Chai, Z., Ding, F., Qian, X., et al.: Taking advantage of multi-regions-based diagonal texture structure descriptor for image retrieval. Expert Syst. Appl. 96, 347–357 (2018)
Dubey, S.R., Mukherjee, S.: LDOP: local directional order pattern for robust face retrieval. Multimed. Tools Appl. 79(9–10), 6363–6382 (2019)
Feng, Q., Hao, Q., Chen, Y., Yi, Y., Wei, Y., Dai, J.: Hybrid histogram descriptor: a fusion feature representation for image retrieval. Sensors 18(6), 2018 (1943)
Al.Garaawi, N., Wu, Q., Morris, T.: BRIEF-based face descriptor: an application to automatic facial expression recognition (AFER), Signal, Image and Video Processing, 15(2), 371–379 (2020)
Acknowledgements
This work is supported by the National Natural Science Foundation of China under Grant No. 61906153 and Natural Science Foundation of Shaanxi Province (China) under Grant No. 2020JQ-651.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by F. Wu.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, J., Chen, Y. & Zhang, E. Multi-level Fisher vector aggregated completed local fractional order derivative feature vector for face recognition. Multimedia Systems 28, 2357–2365 (2022). https://doi.org/10.1007/s00530-022-00964-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-022-00964-0