research-article

A Camera Identity-guided Distribution Consistency Method for Unsupervised Multi-target Domain Person Re-identification

Authors:

Jianping FanAuthors Info & Claims

ACM Transactions on Intelligent Systems and Technology (TIST), Volume 12, Issue 4

Article No.: 38, Pages 1 - 18

https://doi.org/10.1145/3454130

Published: 08 June 2021 Publication History

Abstract

Unsupervised domain adaptation (UDA) for person re-identification (re-ID) is a challenging task due to large variations in human classes, illuminations, camera views, and so on. Currently, existing UDA methods focus on two-domain adaptation and are generally trained on one labeled source set and adapted on the other unlabeled target set. In this article, we put forward a new issue on person re-ID, namely, unsupervised multi-target domain adaptation (UMDA). It involves one labeled source set and multiple unlabeled target sets, which is more reasonable for practical real-world applications. Enabling UMDA has to learn the consistency for multiple domains, which is significantly different from the UDA problem. To ensure distribution consistency and learn the discriminative embedding, we further propose the Camera Identity-guided Distribution Consistency method that performs an alignment operation for multiple domains. The camera identities are encoded into the image semantic information to facilitate the adaptation of features. According to our knowledge, this is the first attempt on the unsupervised multi-target domain adaptation learning. Extensive experiments are executed on Market-1501, DukeMTMC-reID, MSMT17, PersonX, and CUHK03, and our method has achieved very competitive re-ID accuracy in multi-target domains against numerous state-of-the-art methods.

References

[1]

Xiaobin Chang, Yongxin Yang, Tao Xiang, and Timothy M. Hospedales. 2018. Disjoint label space transfer learning with common factorised space.arXiv:1812.02605. Retrieved from https://arxiv.org/abs/1812.02605.

[2]

De Cheng, Yihong Gong, Sanping Zhou, Jinjun Wang, and Nanning Zheng. 2016. Person re-identification by multi-channel parts-based cnn with improved triplet loss function. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1335–1344.

[3]

Yunjey Choi, Minje Choi, Munyoung Kim, Jung-Woo Ha, Sunghun Kim, and Jaegul Choo. 2018. Stargan: Unified generative adversarial networks for multi-domain image-to-image translation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8789–8797.

[4]

Jia Deng, Wei Dong, Richard Socher, Li Jia Li, Kai Li, and Fei Fei Li. 2009. ImageNet: A large-scale hierarchical image database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

[5]

Weijian Deng, Liang Zheng, Qixiang Ye, Guoliang Kang, Yi Yang, and Jianbin Jiao. 2018. Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 994–1003.

[6]

Shengyong Ding, Liang Lin, Guangrun Wang, and Hongyang Chao. 2015. Deep feature learning with relative distance comparison for person re-identification. Pattern Recogn. 48, 10 (2015), 2993–3003.

Digital Library

[7]

Hehe Fan, Liang Zheng, Chenggang Yan, and Yi Yang. 2018. Unsupervised person re-identification: Clustering and fine-tuning. ACM Trans. Multimedia Comput. Commun. Appl. 14, 4 (2018), 83.

Digital Library

[8]

Pedro F. Felzenszwalb, David A. Mcallester, and Deva Ramanan. 2008. A discriminatively trained, multiscale, deformable part model. In CVPR. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

[9]

Mengyue Geng, Yaowei Wang, Tao Xiang, and Yonghong Tian. 2016. Deep transfer learning for person re-identification. arXiv:1611.05244. Retrieved from https://arxiv.org/abs/1611.05244.

[10]

Behnam Gholami, Pritish Sahu, Ognjen (Oggi) Rudovic, Konstantinos Bousmalis, and Vladimir Pavlovic. 2020. Unsupervised multi-target domain adaptation: An information theoretic approach. IEEE Trans. Image Process. 29 (2020), 3993–4002.

[11]

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 770–778.

[12]

Fan Hehe, Zheng Liang, and Yang Yi. 2017. Unsupervised person re-identification: Clustering and fine-tuning. arXiv:1705.10444. Retrieved from https://arxiv.org/abs/1705.10444.

Digital Library

[13]

Alexander Hermans*, Lucas Beyer*, and Bastian Leibe. 2017. In defense of the triplet loss for person re-identification. arXiv:1703.07737. Retrieved from https://arxiv.org/abs/1703.07737.

[14]

Junlin Hu, Jiwen Lu, and Yap Peng Tan. 2015. Deep transfer metric learning. In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’15).

[15]

K. Juengling, Christoph Bodensteiner, and Michael Arens. 2011. Person re-identification in multi-camera networks. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW’11). 55–61.

[16]

Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations (ICLR’15).

[17]

Martin Koestinger, Martin Hirzer, Paul Wohlhart, Peter M. Roth, and Horst Bischof. 2012. Large scale metric learning from equivalence constraints. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’12). 2288–2295.

Digital Library

[18]

Ryan Layne, Timothy M Hospedales, and Shaogang Gong. 2012. Person re-identification by attributes. In Proceedings of the British Machine Vision Conference (BMVC’12).

[19]

Shuzhao Li, Huimin Yu, and Roland Hu. 2020. Attributes-aided part detection and refinement for person re-identification. Pattern Recogn. 97 (2020), 107016.

Digital Library

[20]

Wei Li, Yang Wu, and Jianqing Li. 2017. Re-identification by neighborhood structure metric learning. Pattern Recogn. 61 (2017), 327–338.

Digital Library

[21]

Wenjing Li and Zhongcheng Wu. 2020. OVL: One-view learning for human retrieval. In Proceedings of the AAAI Conference on Artificial Intelligence, 11410–11417.

[22]

Wei Li, Xiatian Zhu, and Shaogang Gong. 2017. Person re-identification by deep joint learning of multi-loss classification. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’17). 2194–2200.

Digital Library

[23]

Shengcai Liao, Yang Hu, Xiangyu Zhu, and Stan Z Li. 2015. Person re-identification by local maximal occurrence representation and metric learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2197–2206.

[24]

Shan Lin, Haoliang Li, Chang-Tsun Li, and Alex Chichung Kot. 2018. Multi-task mid-level feature alignment network for unsupervised cross-dataset person re-identification. arXiv:1807.01440. Retrieved from https://arxiv.org/abs/1807.01440.

[25]

Yutian Lin, Lingxi Xie, Yu Wu, Chenggang Yan, and Qi Tian. 2020. Unsupervised person re-identification via softened similarity learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR’20).

[26]

Yutian Lin, Liang Zheng, Zhedong Zheng, Yu Wu, Zhilan Hu, Chenggang Yan, and Yi Yang. 2019. Improving person re-identification by attribute and identity learning. Pattern Recogn. 95 (2019), 151–161.

Digital Library

[27]

Omar Oreifej, Ramin Mehran, and Mubarak Shah. 2010. Human identity recognition in aerial images. In Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’10). 709–716.

[28]

V. M. Patel, R. Gopalan, R. Li, and R. Chellappa. 2015. Visual domain adaptation: An overview of recent advances. IEEE Signal Processing Magazine 32, 3 (2015), 53–69.

[29]

Peixi Peng, Tao Xiang, Yaowei Wang, Massimiliano Pontil, Shaogang Gong, Tiejun Huang, and Yonghong Tian. 2016. Unsupervised cross-dataset transfer learning for person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1306–1315.

[30]

Peixi Peng, Tao Xiang, Yaowei Wang, Massimiliano Pontil, and Yonghong Tian. 2016. Unsupervised cross-dataset transfer learning for person re-identification. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16). 1306–1315.

[31]

Zhao R, Ouyang W, and Wang X. 2013. Unsupervised salience learning for person re-identification. In Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’13). 3586–3593.

Digital Library

[32]

Liangliang Ren, Jiwen Lu, Jianjiang Feng, and Jie Zhou. 2017. Multi-modal uniform deep learning for RGB-D person re-identification. Pattern Recognition 72 (2017), 446–457.

Digital Library

[33]

Ergys Ristani, Francesco Solera, Roger Zou, Rita Cucchiara, and Carlo Tomasi. 2016. Performance measures and a data set for multi-target, multi-camera tracking. In Proceedings of the European Conference on Computer Vision.

[34]

Li Rui, Zhang Baopeng, Kang Dong-Joong, and Teng Zhu. 2019. Deep attention network for person re-identification with multi-loss. Comput. Electr. Eng. 79 (2019), 106455.

[35]

Liangchen Song, Cheng Wang, Lefei Zhang, Bo Du, Qian Zhang, Chang Huang, and Xinggang Wang. 2020. Unsupervised domain adaptive re-identification: Theory and practice. Pattern Recogn. (2020), 107173.

[36]

X. Sun and L. Zheng. 2019. Dissecting person re-identification from the viewpoint of viewpoint. In Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR’19). 608–617.

[37]

Andrea Vedaldi and Karel Lenc. 2015. MatConvNet - Convolutional neural networks for MATLAB. In Proceedings of the 2015 ACM Multimedia Conference (MM’15). 689–692.

Digital Library

[38]

Hanxiao Wang, Xiatian Zhu, Tao Xiang, and Shaogang Gong. 2016. Towards unsupervised open-set person re-identification. In Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP’16).

[39]

Jingya Wang, Xiatian Zhu, Shaogang Gong, and Wei Li. 2018. Transferable joint attribute-identity deep learning for unsupervised person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2275–2284.

[40]

Li Wei, Zhao Rui, Xiao Tong, and X. G. Wang. 2014. DeepReID: Deep filter pairing neural network for person re-identification. In Computer Vision and Pattern Recognition.

Digital Library

[41]

Longhui Wei, Shiliang Zhang, Wen Gao, and Qi Tian. 2018. Person transfer gan to bridge domain gap for person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 79–88.

[42]

Longhui Wei, Shiliang Zhang, Hantao Yao, Wen Gao, and Qi Tian. 2019. GLAD: Global-local-alignment descriptor for pedestrian retrieval. IEEE Trans. Multimedia 21, 4 (2019), 986–999.

[43]

Kilian Q. Weinberger and Lawrence K. Saul. 2009. Distance metric learning for large margin nearest neighbor classification. J. Mach. Learn. Res. 10, 1 (2009), 207–244.

Digital Library

[44]

Lin Wu, Chunhua Shen, and Anton Van Den Hengel. 2017. Deep linear discriminant analysis on fisher networks: A hybrid architecture for person re-identification. Pattern Recogn. 65 (2017), 238–250.

Digital Library

[45]

Lin Wu, Yang Wang, Junbin Gao, and Xue Li. 2018. Deep adaptive feature embedding with local sample distributions for person re-identification. Pattern Recogn. 73 (2018), 275–288.

[46]

Xun Yang, Meng Wang, and Dacheng Tao. [n.d.]. Person re-identification with metric learning using privileged information. (unpublished).

[47]

Hong Xing Yu, Ancong Wu, and Wei Shi Zheng. 2017. Cross-view asymmetric metric learning for unsupervised person re-identification. In Proceedings of the IEEE International Conference on Computer Vision (ICCV’17).

[48]

Hong-Xing Yu, Ancong Wu, and Wei-Shi Zheng. 2017. Cross-view asymmetric metric learning for unsupervised person re-identification. In Proceedings of the IEEE International Conference on Computer Vision. 994–1002.

[49]

Hong-Xing Yu, Wei-Shi Zheng, Ancong Wu, Xiaowei Guo, Shaogang Gong, and Jian-Huang Lai. 2019. Unsupervised person re-identification by soft multilabel learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2148–2157.

[50]

Liang Zheng, Yujia Huang, Huchuan Lu, and Yi Yang. 2017. Pose invariant embedding for deep person re-identification. IEEE Trans. Image Process. 28, 9 (2017). 4500–4509.

[51]

Liang Zheng, Liyue Shen, Lu Tian, Shengjin Wang, Jingdong Wang, and Qi Tian. 2015. Scalable person re-identification: A benchmark. In Proceedings of the IEEE International Conference on Computer Vision.

Digital Library

[52]

Liang Zheng, Liyue Shen, Lu Tian, Shengjin Wang, Jingdong Wang, and Qi Tian. 2015. Scalable person re-identification: A benchmark. In Proceedings of the IEEE International Conference on Computer Vision. 1116–1124.

Digital Library

[53]

Liang Zheng, Yi Yang, and Alexander G. Hauptmann. 2016. Person re-identification: Past, present and future. arXiv:1610.02984. Retrieved from https://arxiv.org/abs/1610.02984.

[54]

Zhedong Zheng, Liang Zheng, and Yi Yang. 2016. A discriminatively learned CNN embedding for person re-identification. ACM Trans. Multimedia Comput. Commun. Appl. 14, 1 (2016). 13:1–20.

Digital Library

[55]

Zhedong Zheng, Liang Zheng, and Yi Yang. 2017. Unlabeled samples generated by GAN improve the person re-identification baseline in vitro. In Proceedings of the IEEE International Conference on Computer Vision.

[56]

Zhun Zhong, Liang Zheng, Donglin Cao, and Shaozi Li. 2017. Re-ranking person re-identification with k-reciprocal encoding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

[57]

Zhun Zhong, Liang Zheng, Shaozi Li, and Yi Yang. 2018. Generalizing a person retrieval model hetero-and homogeneously. In Proceedings of the European Conference on Computer Vision (ECCV’18). 172–188.

[58]

Zhun Zhong, Liang Zheng, Zhiming Luo, Shaozi Li, and Yi Yang. 2019. Invariance matters: Exemplar memory for domain adaptive person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 598–607.

[59]

Zhun Zhong, Liang Zheng, Zhedong Zheng, Shaozi Li, and Yi Yang. 2017. Camera style adaptation for person re-identification. arXiv:1711.10295. Retrieved from https://arxiv.org/abs/1711.10295.

[60]

Zhun Zhong, Liang Zheng, Zhedong Zheng, Shaozi Li, and Yi Yang. 2018. Camera style adaptation for person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

[61]

Qin Zhou, Shibao Zheng, Haibin Ling, Hang Su, and Shuang Wu. 2017. Joint dictionary and metric learning for person re-identification. Pattern Recogn. 72 (2017), 196–206.

Digital Library

[62]

Sanping Zhou, Jinjun Wang, Deyu Meng, Xiaomeng Xin, Yubing Li, Yihong Gong, and Nanning Zheng. 2018. Deep self-paced learning for person re-identification. Pattern Recogn. 76 (2018), 739–751.

Digital Library

[63]

Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A Efros. 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE International Conference on Computer Vision. 2223–2232.

[64]

Xiaoke Zhu, Xiao-Yuan Jing, Fan Zhang, Xinyu Zhang, Xinge You, and Xiang Cui. 2019. Distance learning by mining hard and easy negative samples for person re-identification. Pattern Recogn. 95 (2019), 211–222.

Digital Library

Cited By

Wu KYin CChe ZJiang BTang JGuan ZDing G(2023)Human Pose Transfer with Augmented Disentangled Feature ConsistencyACM Transactions on Intelligent Systems and Technology10.1145/362624115:1(1-22)Online publication date: 19-Dec-2023
https://dl.acm.org/doi/10.1145/3626241
Si THe FZhang ZDuan Y(2023)Hybrid Contrastive Learning for Unsupervised Person Re-IdentificationIEEE Transactions on Multimedia10.1109/TMM.2022.317441425(4323-4334)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3174414
Zhang JTian X(2022)Unsupervised person re-identification based on removal of camera bias and dynamic updating of the memory bankJUSTC10.52396/JUSTC-2022-001552:12(7)Online publication date: 2022
https://doi.org/10.52396/JUSTC-2022-0015
Show More Cited By

Index Terms

A Camera Identity-guided Distribution Consistency Method for Unsupervised Multi-target Domain Person Re-identification
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Image representations
      2. Computer vision tasks
        Visual content-based indexing and retrieval

Recommendations

Momentum source-proxy guided initialization for unsupervised domain adaptive person re-identification
Abstract
Unsupervised domain adaptive person re-identification (UDA Re-ID), aiming to adapt the model trained from source domain to target domain, is especially challenging due to the non-overlapping identities between the two Re-ID domains. ...
Joint Visual and Temporal Consistency for Unsupervised Domain Adaptive Person Re-identification
Computer Vision – ECCV 2020
Abstract
Unsupervised domain adaptive person Re-IDentification (ReID) is challenging because of the large domain gap between source and target domains, as well as the lackage of labeled data on the target domain. This paper tackles this challenge through ...
Unsupervised Person Re-Identification via Multi-Label Classification
Abstract
The challenge of unsupervised person re-identification (ReID) lies in learning discriminative features without true labels. Most of previous works predict single-class pseudo labels through clustering. To improve the quality of generated pseudo ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology

ACM Transactions on Intelligent Systems and Technology Volume 12, Issue 4

August 2021

368 pages

ISSN:2157-6904

EISSN:2157-6912

DOI:10.1145/3468075

Editor:
Huan Liu
Arizona State University, USA

Issue’s Table of Contents

Copyright © 2021 Association for Computing Machinery.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 June 2021

Accepted: 01 March 2021

Revised: 01 March 2021

Received: 01 July 2020

Published in TIST Volume 12, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

Beijing Municipal Natural Science Foundation
Natural Science Foundation of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
205
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu KYin CChe ZJiang BTang JGuan ZDing G(2023)Human Pose Transfer with Augmented Disentangled Feature ConsistencyACM Transactions on Intelligent Systems and Technology10.1145/362624115:1(1-22)Online publication date: 19-Dec-2023
https://dl.acm.org/doi/10.1145/3626241
Si THe FZhang ZDuan Y(2023)Hybrid Contrastive Learning for Unsupervised Person Re-IdentificationIEEE Transactions on Multimedia10.1109/TMM.2022.317441425(4323-4334)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3174414
Zhang JTian X(2022)Unsupervised person re-identification based on removal of camera bias and dynamic updating of the memory bankJUSTC10.52396/JUSTC-2022-001552:12(7)Online publication date: 2022
https://doi.org/10.52396/JUSTC-2022-0015
Li XLiang TJin YWang TLi Y(2022)Camera-Aware Style Separation and Contrastive Learning for Unsupervised Person Re-Identification2022 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME52920.2022.9859842(1-6)Online publication date: 18-Jul-2022
https://doi.org/10.1109/ICME52920.2022.9859842
Remigereau FMekhazni DAbdoli SNguyen-Meidine LCruz RGranger E(2022)Knowledge Distillation for Multi-Target Domain Adaptation in Real-Time Person Re-Identification2022 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP46576.2022.9897730(3853-3857)Online publication date: 16-Oct-2022
https://doi.org/10.1109/ICIP46576.2022.9897730

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents