南京大学学报(自然科学版) ›› 2021, Vol. 57 ›› Issue (5): 715–723.doi: 10.13232/j.cnki.jnju.2021.05.001

• •    

基于域分离和对抗学习的跨域行人重识别

薛峰1,2, 李凡1,2(), 李爽1,2, 李华锋1,2   

  1. 1.昆明理工大学信息工程与自动化学院,昆明,650500
    2.云南省人工智能重点实验室,昆明理工大学,昆明,650500
  • 收稿日期:2021-05-26 出版日期:2021-09-29 发布日期:2021-09-29
  • 通讯作者: 李凡 E-mail:478263823@qq.com
  • 作者简介:E⁃mail:478263823@qq.com
  • 基金资助:
    云南省科技厅科技计划项目(基础研究专项)(202101AT070136);国家自然科学基金地区科学基金(61966021);云南省重大科技专项(202002AD080001)

Cross⁃domain person re⁃identification based on domain separation and adversarial learning

Feng Xue1,2, Fan Li1,2(), Shuang Li1,2, Huafeng Li1,2   

  1. 1.Faculty of Information Engineering and Automation, Kunming University of Science and Technology,Kunming,650500, China
    2.Yunnan Key Laboratory of Artificial Intelligence,Kunming University of Science and Technology,Kunming,650500,China
  • Received:2021-05-26 Online:2021-09-29 Published:2021-09-29
  • Contact: Fan Li E-mail:478263823@qq.com

摘要:

针对跨域行人重识别应用中源域与目标域差异较大、现有模型无法在剥离域信息的同时有效获取关键身份信息的问题,提出一种基于对抗学习分离图像域信息与身份信息的方法.该方法由域分离和对抗学习两个阶段构成:域分离阶段分离图像行人特征和域特征;对抗学习阶段通过特征提取器与相机分类器的对抗学习,提升模型对域信息与身份信息的区分能力.在Market?1501,DukeMTMC?reID和MSMT17数据集上开展跨域行人重识别验证实验,实验结果表明,所提方法在跨域行人重识别任务上取得了显著的性能提升.

关键词: 行人重识别,跨, 域,域分离,对抗学习

Abstract:

In the application of cross domain person re?identification,the source domain and the target domain are quite different,and the existing models can not effectively obtain the key identity information while stripping the domain information. This paper proposes a method to separate the image domain information and identity information based on adversarial learning. The method consists of two phases:domain separation and adversarial learning. Domain separation phase separates pedestrian features and domain features of image. In the stage of adversarial learning,feature extractor and camera classifier are used to improve the ability of distinguishing domain information from identity information. Cross domain person re?identification experiments are carried out on Market?1501,DukeMTMC?reID and MSMT17 datasets.The experimental results show that the proposed method achieves significant performance improvement on cross domain person re?identification task.

Key words: person re?identification, cross?domain, domain separation, adversarial learning

中图分类号: 

  • TP391.41

图1

不同相机视角下的行人图像对比"

图2

本文算法的总体框架"

图3

域分离网络"

图4

对抗学习网络(AL)"

表1

实验使用的数据集"

数据集数据样本数ID数相机数
Market?1501训练集129367516
测试集19732750
DukeMTMC?reID训练集165227028
测试集17661702
MSMT17训练集32621104115
测试集938203060

图5

超参数c对模型性能的影响"

表2

消融实验的结果"

Market→DukeDuke→Market
mAPRank?1mAPRank?1
Baseline0.2570.4140.2550.543
Baseline+DS0.2690.4320.2740.572
One Block DS+AL0.3640.5520.3890.664
Two Blocks DS+AL0.3870.5830.3910.662
Three Blocks DS+AL0.3910.6050.3860.672
Four Blocks DS+AL0.3950.610.4060.693

表3

在DukeMTMC?reID和Market?1501数据集上各算法的性能比较"

MethodsMarket→DukeDuke→Market
mAPRank?1mAPRank?1
TJ?AIDL[6]0.230.4430.2650.582
SPGAN+LM[22]0.2620.4640.2670.577
CamStyle[23]0.2510.4840.2740.588
SCAL[24]0.2840.4840.3040.61
OSNet?IBN[25]0.2670.4850.2610.577
SNR[21]0.3360.5510.3390.667
CCE[26]0.3670.5540.3450.643
Ours0.3950.610.4060.693

表4

在MSMT17数据集上各算法的性能比较"

MethodsSourcemAPRank?1
PTGAN[20]Market0.0290.102
ECN[27]Market0.0850.253
OursMarket0.0890.258
PTGAN[20]Duke0.0330.118
ECN[27]Duke0.1020.302
OursDuke0.1120.319
1 宋婉茹,赵晴晴,陈昌红等. 行人重识别研究综述. 智能系统学报,2017,12(6):770-780. (Song W R,Zhao Q Q,Chen C H,et al. Survey on pedestrian
research re?identification. Journal of Intelligent
Systems,2017,12(6):770-780.
2 Li D W,Chen X T,Zhang Z,et al. Learning deep context?aware features over body and latent parts for person re?dentification∥2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu,HI,USA:IEEE,2017:7398-7407.
3 Zhao H Y,Tian M Q,Sun S Y,et al. Spindle Net:Person re?identification with human body region guided feature decomposition and fusion∥2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu,HI,USA:IEEE,2017:907-915.
4 Liu J W,Zha Z J,Chen D,et al. Adaptive transfer network for cross?domain person re?identification∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach,CA,USA:IEEE,2019:7195-7204.
5 崔鹏,范志旭. 基于域鉴别网络和域自适应的行人重识别. 光电子·激光,2019,30(6):632-639. (Cui P,Fan Z X. Person re?identification based on domain discriminative network and domain adaptation.
Journal of Optoelectronics·Laser,2019,30(6):632-639.
6 Wang J S,Zhu X,Gong S J,et al. Transferable joint attribute?identity deep learning for unsupervised person re?identification∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City,UT,USA:IEEE,2018:2275-2284.
7 Zhang X Y,Cao J W,Shen C H,et al. Self?training with progressive augmentation for unsupervised
cross?domain person re?identification∥2019 IEEE/CVF International Conference on Computer Vision. Seoul,Korea (South):IEEE,2019:8221-8230.
8 Long M S,Cao Y,Cao Z J,et al. Transferable representation learning with deep adaptation networks. IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(12):3071-3085.
9 Jia X B,Jin Y,Su X,et al. Domain?invariant representation learning using an unsupervised domain adversarial adaptation deep neural network. Neurocomputing,2019(355):209-220.
10 Cai G Y,Wang Y Q,He L H,et al. Unsupervised domain adaptation with adversarial residual transform networks. IEEE Transactions on Neural Networks and Learning Systems,2020,31(8):3073-3086.
11 张伟信,刘斌. 基于残差网络的特征加权行人重识别研究. 微电子学与计算机,2020,37(4):26-31.
Zhang W X,Liu B. Person re?identification based on residual network with weightedfeatures. Microelectronics & Computer,2020,37(4):26-31.
12 Wang Z,Ye M,Yang F,et al. Cascaded SR?GAN for scale?adaptive low resolution person re?identification∥Proceedings of the 27th International Joint Conference on Artificial Intelligence. Stockholm,Sweden:AAAI,2018:3891-3897.
13 淦艳,叶茂,曾凡玉. 生成对抗网络及其应用研究综述. 小型微型计算机系统,2020,41(6):1133-1139. (Gan Y,Ye M,Zeng F Y. Review of research on
generative adversarial networks and its application. Journal of Chinese Computer Systems,2020,41(6):1133-1139.
14 Chadha A,Andreopoulos Y. Improved techniques for adversarial discriminative domain adaptation. IEEE Transactions on Image Processing,2019(29):2622-2637.
15 Hao L,Gu Y Z,Liao X Y,et al. Bag of tricks and a strong baseline for deep person re?identification∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach,CA,USA:IEEE,2019:1487-1495.
16 He K M,Zhang X Y,Ren S Q,et al. Deep residual learning for image recognition∥2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas,NV,USA:IEEE,2016:770-778.
17 Hu J,Shen L,Albanie S,et al. Squeeze?and?excitation networks. IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(8):2011-2023.
18 Zheng L,Shen L Y,Tian L,et al. Scalable person re?identification:A benchmark∥2015 IEEE Inter?national Conference on Computer Vision. Santiago,Chile:IEEE,2015:1116-1124.
19 Ristani E,Solera F,Zou R S,et al. Performance measures and a data set for multi?target,multi?camera tracking∥European Conference on Computer Vision. Springer Berlin Heidelberg,2016:17-35.
20 Wei L H,Zhang S L,Wen G,et al. Person transfer GAN to bridge domain gap for person re?identification∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City,UT,USA:IEEE,2018:79-88.
21 Jin X,Lan C L,Zeng W J,et al. Style normalization and restitution for generalizable person re?identi?fication∥2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle,WA,USA:IEEE,2020:3140-3149.
22 Deng W J,Zheng L,Ye Q X,et al. Image?image domain adaptation with preserved self?similarity and domain?dissimilarity for person re?identification∥2018 IEEE/CVF Conference on Computer Vision and Pattern recognition. Salt Lake City,UT,USA:IEEE,2018:994-1003.
23 Zhong Z,Zheng L,Zheng Z D,et al. CamStyle:a novel data augmentation method for person re?identi?fication. IEEE Transactions on Image Processing,2019,28(3):1176-1190.
24 Chen G Y,Lin C Z,Ren L L,et al. Self?critical attention learning for person re?identification∥2019 IEEE/CVF International Conference on Computer Vision. Seoul,Korea (South):IEEE,2019:9636-9645.
25 Zhou K Y,Yang Y X,Cavallaro A,et al. Omni?scale feature learning for person re?identification∥2019 IEEE/CVF International Conference on Computer Vision. Seoul,Korea (South):IEEE,2020:3701-3711.
26 Qi L,Wang L,Huo J,et al. A novel unsupervised camera?aware domain adaptation framework for person re?identification∥2019 IEEE/CVF Inter?national Conference on Computer Vision. Seoul,Korea (South):IEEE,2020:8079-8088.
27 Zhong Z,Zheng L,Luo Z M,et al. Invariance matters:exemplar memory for domain adaptive person Re?identification∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach,CA,USA:IEEE,2019:598-607.
[1] 王发旺, 陈睿, 伏云发. 基于DBN和RF的跨被试情绪识别研究[J]. 南京大学学报(自然科学版), 2021, 57(4): 617-626.
[2] 乔宇鑫, 葛洪伟. 自适应样本加权的多视图聚类算法[J]. 南京大学学报(自然科学版), 2021, 57(4): 544-550.
[3] 王晓琳, 赵磊, 张维, 伏云发. 基于HHT和核函数选择的情绪特征提取与识别[J]. 南京大学学报(自然科学版), 2021, 57(3): 502-511.
[4] 戴臣超, 王洪元, 曹亮, 殷雨昌, 张继. 一种多目标跨摄像头跟踪技术研究与实现[J]. 南京大学学报(自然科学版), 2021, 57(2): 227-236.
[5] 陈睿, 伏云发. 基于EEG握力变化及想象单次识别研究[J]. 南京大学学报(自然科学版), 2020, 56(2): 159-166.
[6] 杨 薇, 王洪元, 张 继, 张中宝. 一种基于Faster-RCNN的车辆实时检测改进算法[J]. 南京大学学报(自然科学版), 2019, 55(2): 231-237.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!