Skip to content

Latest commit

 

History

History
259 lines (188 loc) · 27.3 KB

model_zoo.md

File metadata and controls

259 lines (188 loc) · 27.3 KB
Raw

模型库

1. 图像分类

数据集：ImageNet1000类

1.1 量化

模型 压缩方法 Top-1/Top-5 Acc 模型体积（MB） TensorRT时延(V100, ms) 下载
MobileNetV1 - 70.99%/89.68% 17 - 下载链接
MobileNetV1 quant_post 70.18%/89.25% (-0.81%/-0.43%) 4.4 - 下载链接
MobileNetV1 quant_aware 70.60%/89.57% (-0.39%/-0.11%) 4.4 - 下载链接
MobileNetV2 - 72.15%/90.65% 15 - 下载链接
MobileNetV2 quant_post 71.15%/90.11% (-1%/-0.54%) 4.0 - 下载链接
MobileNetV2 quant_aware 72.05%/90.63% (-0.1%/-0.02%) 4.0 - 下载链接
ResNet50 - 76.50%/93.00% 99 2.71 下载链接
ResNet50 quant_post 76.33%/93.02% (-0.17%/+0.02%) 25.1 1.19 下载链接
ResNet50 quant_aware 76.48%/93.11% (-0.02%/+0.11%) 25.1 1.17 下载链接

分类模型Lite时延(ms)

设备 模型类型 压缩策略 armv7 Thread 1 armv7 Thread 2 armv7 Thread 4 armv8 Thread 1 armv8 Thread 2 armv8 Thread 4
高通835 MobileNetV1 FP32 baseline 96.1942 53.2058 32.4468 88.4955 47.95 27.5189
高通835 MobileNetV1 quant_aware 60.8186 32.1931 16.4275 56.4311 29.5446 15.1053
高通835 MobileNetV1 quant_post 60.5615 32.4016 16.6596 56.5266 29.7178 15.1459
高通835 MobileNetV2 FP32 baseline 65.715 38.1346 25.155 61.3593 36.2038 22.849
高通835 MobileNetV2 quant_aware 48.3655 30.2021 21.9303 46.1487 27.3146 18.3053
高通835 MobileNetV2 quant_post 48.3495 30.3069 22.1506 45.8715 27.4105 18.2223
高通835 ResNet50 FP32 baseline 526.811 319.6486 205.8345 506.1138 335.1584 214.8936
高通835 ResNet50 quant_aware 475.4538 256.8672 139.699 461.7344 247.9506 145.9847
高通835 ResNet50 quant_post 476.0507 256.5963 139.7266 461.9176 248.3795 149.353
高通855 MobileNetV1 FP32 baseline 33.5086 19.5773 11.7534 31.3474 18.5382 10.0811
高通855 MobileNetV1 quant_aware 36.7067 21.628 11.0372 14.0238 8.199 4.2588
高通855 MobileNetV1 quant_post 37.0498 21.7081 11.0779 14.0947 8.1926 4.2934
高通855 MobileNetV2 FP32 baseline 25.0396 15.2862 9.6609 22.909 14.1797 8.8325
高通855 MobileNetV2 quant_aware 28.1583 18.3317 11.8103 16.9158 11.1606 7.4148
高通855 MobileNetV2 quant_post 28.1631 18.3917 11.8333 16.9399 11.1772 7.4176
高通855 ResNet50 FP32 baseline 185.3705 113.0825 87.0741 177.7367 110.0433 74.4114
高通855 ResNet50 quant_aware 327.6883 202.4536 106.243 243.5621 150.0542 78.4205
高通855 ResNet50 quant_post 328.2683 201.9937 106.744 242.6397 150.0338 79.8659
麒麟970 MobileNetV1 FP32 baseline 101.2455 56.4053 35.6484 94.8985 51.7251 31.9511
麒麟970 MobileNetV1 quant_aware 62.5012 32.1863 16.6018 57.7477 29.2116 15.0703
麒麟970 MobileNetV1 quant_post 62.4412 32.2585 16.6215 57.825 29.2573 15.1206
麒麟970 MobileNetV2 FP32 baseline 70.4176 42.0795 25.1939 68.9597 39.2145 22.6617
麒麟970 MobileNetV2 quant_aware 52.9961 31.5323 22.1447 49.4858 28.0856 18.7287
麒麟970 MobileNetV2 quant_post 53.0961 31.7987 21.8334 49.383 28.2358 18.3642
麒麟970 ResNet50 FP32 baseline 586.8943 344.0858 228.2293 573.3344 351.4332 225.8006
麒麟970 ResNet50 quant_aware 488.361 260.1697 142.416 479.5668 249.8485 138.1742
麒麟970 ResNet50 quant_post 489.6188 258.3279 142.6063 480.0064 249.5339 138.5284

1.2 剪裁

PaddleLite推理耗时说明：

环境：Qualcomm SnapDragon 845 + armv8

速度指标：Thread1/Thread2/Thread4耗时

PaddleLite版本： v2.3

模型 压缩方法 Top-1/Top-5 Acc 模型体积（MB） GFLOPs PaddleLite推理耗时 TensorRT推理速度(FPS) 下载
MobileNetV1 Baseline 70.99%/89.68% 17 1.11 66.052\35.8014\19.5762 - 下载链接
MobileNetV1 uniform -50% 69.4%/88.66% (-1.59%/-1.02%) 9 0.56 33.5636\18.6834\10.5076 - 下载链接
MobileNetV1 sensitive -30% 70.4%/89.3% (-0.59%/-0.38%) 12 0.74 46.5958\25.3098\13.6982 - 下载链接
MobileNetV1 sensitive -50% 69.8% / 88.9% (-1.19%/-0.78%) 9 0.56 37.9892\20.7882\11.3144 - 下载链接
MobileNetV2 - 72.15%/90.65% 15 0.59 41.7874\23.375\13.3998 - 下载链接
MobileNetV2 uniform -50% 65.79%/86.11% (-6.35%/-4.47%) 11 0.296 23.8842\13.8698\8.5572 - 下载链接
ResNet34 - 72.15%/90.65% 84 7.36 217.808\139.943\96.7504 342.32 下载链接
ResNet34 uniform -50% 70.99%/89.95% (-1.36%/-0.87%) 41 3.67 114.787\75.0332\51.8438 452.41 下载链接
ResNet34 auto -55.05% 70.24%/89.63% (-2.04%/-1.06%) 33 3.31 105.924\69.3222\48.0246 457.25 下载链接

1.3 蒸馏

模型 压缩方法 Top-1/Top-5 Acc 模型体积（MB） 下载
MobileNetV1 student 70.99%/89.68% 17 下载链接
ResNet50_vd teacher 79.12%/94.44% 99 下载链接
MobileNetV1 ResNet50_vd1 distill 72.77%/90.68% (+1.78%/+1.00%) 17 下载链接
MobileNetV2 student 72.15%/90.65% 15 下载链接
MobileNetV2 ResNet50_vd distill 74.28%/91.53% (+2.13%/+0.88%) 15 下载链接
ResNet50 student 76.50%/93.00% 99 下载链接
ResNet101 teacher 77.56%/93.64% 173 下载链接
ResNet50 ResNet101 distill 77.29%/93.65% (+0.79%/+0.65%) 99 下载链接

注意：带"_vd"后缀代表该预训练模型使用了Mixup，Mixup相关介绍参考mixup: Beyond Empirical Risk Minimization

1.4 搜索

数据集: ImageNet1000

模型 压缩方法 Top-1/Top-5 Acc 模型体积（MB） GFLOPs 下载
MobileNetV2 - 72.15%/90.65% 15 0.59 下载链接
MobileNetV2 SANAS 71.518%/90.208% (-0.632%/-0.442%) 14 0.295 下载链接

数据集: Cifar10

模型 压缩方法 Acc 模型参数（MB） 下载
Darts - 97.135% 3.767 -
Darts_SA(基于Darts搜索空间) SANAS 97.276%(+0.141%) 3.344(-11.2%) -

Note: MobileNetV2_NAS 的token是：[4, 4, 5, 1, 1, 2, 1, 1, 0, 2, 6, 2, 0, 3, 4, 5, 0, 4, 5, 5, 1, 4, 8, 0, 0]. Darts_SA的token是：[5, 5, 0, 5, 5, 10, 7, 7, 5, 7, 7, 11, 10, 12, 10, 0, 5, 3, 10, 8].

2. 目标检测

2.1 量化

数据集： COCO 2017

模型 压缩方法 数据集 Image/GPU 输入608 Box AP 输入416 Box AP 输入320 Box AP 模型体积（MB） TensorRT时延(V100, ms) 下载
MobileNet-V1-YOLOv3 - COCO 8 29.3 29.3 27.1 95 - 下载链接
MobileNet-V1-YOLOv3 quant_post COCO 8 27.9 (-1.4) 28.0 (-1.3) 26.0 (-1.0) 25 - 下载链接
MobileNet-V1-YOLOv3 quant_aware COCO 8 28.1 (-1.2) 28.2 (-1.1) 25.8 (-1.2) 26.3 - 下载链接
R34-YOLOv3 - COCO 8 36.2 34.3 31.4 162 - 下载链接
R34-YOLOv3 quant_post COCO 8 35.7 (-0.5) - - 42.7 - 下载链接
R34-YOLOv3 quant_aware COCO 8 35.2 (-1.0) 33.3 (-1.0) 30.3 (-1.1) 44 - 下载链接
R50-dcn-YOLOv3 obj365_pretrain - COCO 8 41.4 - - 177 18.56 下载链接
R50-dcn-YOLOv3 obj365_pretrain quant_aware COCO 8 40.6 (-0.8) 37.5 34.1 66 14.64 下载链接

数据集：WIDER-FACE

模型 压缩方法 Image/GPU 输入尺寸 Easy/Medium/Hard 模型体积（MB） 下载
BlazeFace - 8 640 91.5/89.2/79.7 815 下载链接
BlazeFace quant_post 8 640 87.8/85.1/74.9 (-3.7/-4.1/-4.8) 228 下载链接
BlazeFace quant_aware 8 640 90.5/87.9/77.6 (-1.0/-1.3/-2.1) 228 下载链接
BlazeFace-Lite - 8 640 90.9/88.5/78.1 711 下载链接
BlazeFace-Lite quant_post 8 640 89.4/86.7/75.7 (-1.5/-1.8/-2.4) 211 下载链接
BlazeFace-Lite quant_aware 8 640 89.7/87.3/77.0 (-1.2/-1.2/-1.1) 211 下载链接
BlazeFace-NAS - 8 640 83.7/80.7/65.8 244 下载链接
BlazeFace-NAS quant_post 8 640 81.6/78.3/63.6 (-2.1/-2.4/-2.2) 71 下载链接
BlazeFace-NAS quant_aware 8 640 83.1/79.7/64.2 (-0.6/-1.0/-1.6) 71 下载链接

2.2 剪裁

数据集：Pasacl VOC & COCO 2017

PaddleLite推理耗时说明：

环境：Qualcomm SnapDragon 845 + armv8

速度指标：Thread1/Thread2/Thread4耗时

PaddleLite版本： v2.3

模型 压缩方法 数据集 Image/GPU 输入608 Box AP 输入416 Box AP 输入320 Box AP 模型体积(MB) GFLOPs (608*608) PaddleLite推理耗时(ms)(608*608) TensorRT推理速度(FPS)(608*608) 下载
MobileNet-V1-YOLOv3 Baseline Pascal VOC 8 76.2 76.7 75.3 94 40.49 1238\796.943\520.101 60.04 下载链接
MobileNet-V1-YOLOv3 sensitive -52.88% Pascal VOC 8 77.6 (+1.4) 77.7 (1.0) 75.5 (+0.2) 31 19.08 602.497\353.759\222.427 99.36 下载链接
MobileNet-V1-YOLOv3 - COCO 8 29.3 29.3 27.0 95 41.35 - - 下载链接
MobileNet-V1-YOLOv3 sensitive -51.77% COCO 8 26.0 (-3.3) 25.1 (-4.2) 22.6 (-4.4) 32 19.94 - 73.93 下载链接
R50-dcn-YOLOv3 - COCO 8 39.1 - - 177 89.60 - 27.68 下载链接
R50-dcn-YOLOv3 sensitive -9.37% COCO 8 39.3 (+0.2) - - 150 81.20 - 30.08 下载链接
R50-dcn-YOLOv3 sensitive -24.68% COCO 8 37.3 (-1.8) - - 113 67.48 - 34.32 下载链接
R50-dcn-YOLOv3 obj365_pretrain - COCO 8 41.4 - - 177 89.60 - - 下载链接
R50-dcn-YOLOv3 obj365_pretrain sensitive -9.37% COCO 8 40.5 (-0.9) - - 150 81.20 - - 下载链接
R50-dcn-YOLOv3 obj365_pretrain sensitive -24.68% COCO 8 37.8 (-3.3) - - 113 67.48 - - 下载链接

2.3 蒸馏

数据集：Pasacl VOC & COCO 2017

模型 压缩方法 数据集 Image/GPU 输入608 Box AP 输入416 Box AP 输入320 Box AP 模型体积（MB） 下载
MobileNet-V1-YOLOv3 - Pascal VOC 8 76.2 76.7 75.3 94 下载链接
ResNet34-YOLOv3 - Pascal VOC 8 82.6 81.9 80.1 162 下载链接
MobileNet-V1-YOLOv3 ResNet34-YOLOv3 distill Pascal VOC 8 79.0 (+2.8) 78.2 (+1.5) 75.5 (+0.2) 94 下载链接
MobileNet-V1-YOLOv3 - COCO 8 29.3 29.3 27.0 95 下载链接
ResNet34-YOLOv3 - COCO 8 36.2 34.3 31.4 163 下载链接
MobileNet-V1-YOLOv3 ResNet34-YOLOv3 distill COCO 8 31.4 (+2.1) 30.0 (+0.7) 27.1 (+0.1) 95 下载链接

2.4 搜索

数据集：WIDER-FACE

模型 压缩方法 Image/GPU 输入尺寸 Easy/Medium/Hard 模型体积（KB） 硬件延时（ms） 下载
BlazeFace - 8 640 91.5/89.2/79.7 815 71.862 下载链接
BlazeFace-NAS - 8 640 83.7/80.7/65.8 244 21.117 下载链接
BlazeFace-NASV2 SANAS 8 640 87.0/83.7/68.5 389 22.558 下载链接

Note: 硬件延时时间是利用提供的硬件延时表得到的，硬件延时表是在855芯片上基于PaddleLite测试的结果。BlazeFace-NASV2的详细配置在这里.

3. 图像分割

数据集：Cityscapes

3.1 量化

模型 压缩方法 mIoU 模型体积（MB） 下载
DeepLabv3+/MobileNetv1 - 63.26 6.6 下载链接
DeepLabv3+/MobileNetv1 quant_post 58.63 (-4.63) 1.8 下载链接
DeepLabv3+/MobileNetv1 quant_aware 62.03 (-1.23) 1.8 下载链接
DeepLabv3+/MobileNetv2 - 69.81 7.4 下载链接
DeepLabv3+/MobileNetv2 quant_post 67.59 (-2.22) 2.1 下载链接
DeepLabv3+/MobileNetv2 quant_aware 68.33 (-1.48) 2.1 下载链接

图像分割模型Lite时延(ms), 输入尺寸769x769

设备 模型类型 压缩策略 armv7 Thread 1 armv7 Thread 2 armv7 Thread 4 armv8 Thread 1 armv8 Thread 2 armv8 Thread 4
高通835 Deeplabv3- MobileNetV1 FP32 baseline 1227.9894 734.1922 527.9592 1109.96 699.3818 479.0818
高通835 Deeplabv3- MobileNetV1 quant_aware 848.6544 512.785 382.9915 752.3573 455.0901 307.8808
高通835 Deeplabv3- MobileNetV1 quant_post 840.2323 510.103 371.9315 748.9401 452.1745 309.2084
高通835 Deeplabv3-MobileNetV2 FP32 baseline 1282.8126 793.2064 653.6538 1193.9908 737.1827 593.4522
高通835 Deeplabv3-MobileNetV2 quant_aware 976.0495 659.0541 513.4279 892.1468 582.9847 484.7512
高通835 Deeplabv3-MobileNetV2 quant_post 981.44 658.4969 538.6166 885.3273 586.1284 484.0018
高通855 Deeplabv3- MobileNetV1 FP32 baseline 568.8748 339.8578 278.6316 420.6031 281.3197 217.5222
高通855 Deeplabv3- MobileNetV1 quant_aware 608.7578 347.2087 260.653 241.2394 177.3456 143.9178
高通855 Deeplabv3- MobileNetV1 quant_post 609.0142 347.3784 259.9825 239.4103 180.1894 139.9178
高通855 Deeplabv3-MobileNetV2 FP32 baseline 639.4425 390.1851 322.7014 477.7667 339.7411 262.2847
高通855 Deeplabv3-MobileNetV2 quant_aware 703.7275 497.689 417.1296 394.3586 300.2503 239.9204
高通855 Deeplabv3-MobileNetV2 quant_post 705.7589 474.4076 427.2951 394.8352 297.4035 264.6724
麒麟970 Deeplabv3- MobileNetV1 FP32 baseline 1682.1792 1437.9774 1181.0246 1261.6739 1068.6537 690.8225
麒麟970 Deeplabv3- MobileNetV1 quant_aware 1062.3394 1248.1014 878.3157 774.6356 710.6277 528.5376
麒麟970 Deeplabv3- MobileNetV1 quant_post 1109.1917 1339.6218 866.3587 771.5164 716.5255 500.6497
麒麟970 Deeplabv3-MobileNetV2 FP32 baseline 1771.1301 1746.0569 1222.4805 1448.9739 1192.4491 760.606
麒麟970 Deeplabv3-MobileNetV2 quant_aware 1320.2905 921.4522 676.0732 1145.8801 821.5685 590.1713
麒麟970 Deeplabv3-MobileNetV2 quant_post 1320.386 918.5328 672.2481 1020.753 820.094 591.4114

3.2 剪裁

PaddleLite推理耗时说明：

环境：Qualcomm SnapDragon 845 + armv8

速度指标：Thread1/Thread2/Thread4耗时

PaddleLite版本： v2.3

模型 压缩方法 mIoU 模型体积（MB） GFLOPs PaddleLite推理耗时 TensorRT推理速度(FPS) 下载
fast-scnn baseline 69.64 11 14.41 1226.36\682.96\415.664 39.53 下载链接
fast-scnn uniform -17.07% 69.58 (-0.06) 8.5 11.95 1140.37\656.612\415.888 42.01 下载链接
fast-scnn sensitive -47.60% 66.68 (-2.96) 5.7 7.55 866.693\494.467\291.748 51.48 下载链接