From 3745dc9314d7127d8f349aa0c4354475f261a991 Mon Sep 17 00:00:00 2001 From: "Wang, Mengni" Date: Mon, 8 May 2023 16:23:34 +0800 Subject: [PATCH 1/4] Specify ONNX model zoo in validated model list --- docs/source/validated_model_list.md | 60 ++++++++++++++--------------- 1 file changed, 30 insertions(+), 30 deletions(-) diff --git a/docs/source/validated_model_list.md b/docs/source/validated_model_list.md index 232a985e992..e8b123e08a5 100644 --- a/docs/source/validated_model_list.md +++ b/docs/source/validated_model_list.md @@ -1152,7 +1152,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.45x - BERT SQuAD model zoo DYNAMIC + BERT SQuAD model zoo DYNAMIC (ONNX Model Zoo) QLinear 80.44 80.67 @@ -1162,7 +1162,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.85x - Caffenet + Caffenet (ONNX Model Zoo) QLinear 56.21% 56.30% @@ -1172,7 +1172,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.65x - Caffenet + Caffenet (ONNX Model Zoo) QDQ 56.25% 56.30% @@ -1182,7 +1182,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.70x - Densenet + Densenet (ONNX Model Zoo) QLinear 60.53% 60.96% @@ -1212,7 +1212,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.10x - DUC + DUC (ONNX Model Zoo) QLinear 81.62% 81.92% @@ -1222,7 +1222,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.01x - EfficientNet + EfficientNet (ONNX Model Zoo) QLinear 77.57% 77.70% @@ -1232,7 +1232,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.60x - EfficientNet + EfficientNet (ONNX Model Zoo) QDQ 77.61% 77.70% @@ -1242,7 +1242,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.12x - Emotion Ferplus + Emotion Ferplus (ONNX Model Zoo) QLinear 8.00% 8.00% @@ -1252,7 +1252,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.33x - Faster R-CNN + Faster R-CNN (ONNX Model Zoo) QLinear 34.09% 34.37% @@ -1262,7 +1262,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.35x - Faster R-CNN + Faster R-CNN (ONNX Model Zoo) QDQ 33.90% 34.37% @@ -1272,7 +1272,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.57x - FCN + FCN (ONNX Model Zoo) QLinear 64.54% 64.98% @@ -1282,7 +1282,7 @@ Performance varies by use, configuration and other factors. See [platform config 3.40x - FCN + FCN (ONNX Model Zoo) QDQ 64.40% 64.98% @@ -1292,7 +1292,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.25x - GoogleNet-12 + GoogleNet-12 (ONNX Model Zoo) QLinear 67.71% 67.79% @@ -1302,7 +1302,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.35x - GoogleNet-12 + GoogleNet-12 (ONNX Model Zoo) QDQ 67.73% 67.79% @@ -1412,7 +1412,7 @@ Performance varies by use, configuration and other factors. See [platform config 3.22x - Inception V1 + Inception V1 (ONNX Model Zoo) QLinear 67.21% 67.24% @@ -1422,7 +1422,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.33x - Inception v1 + Inception v1 (ONNX Model Zoo) QDQ 67.21% 67.24% @@ -1432,7 +1432,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.32x - Mask R-CNN + Mask R-CNN (ONNX Model Zoo) QLinear 33.13% 33.72% @@ -1442,7 +1442,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.08x - Mask R-CNN + Mask R-CNN (ONNX Model Zoo) QDQ 33.28% 33.72% @@ -1602,7 +1602,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.54x - ShuffleNet V2-12 + ShuffleNet V2-12 (ONNX Model Zoo) QLinear 66.13% 66.36% @@ -1612,7 +1612,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.61x - ShuffleNet V2-12 + ShuffleNet V2-12 (ONNX Model Zoo) QDQ 66.12% 66.36% @@ -1622,7 +1622,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.35x - SqueezeNet + SqueezeNet (ONNX Model Zoo) QLinear 56.54% 56.87% @@ -1632,7 +1632,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.30x - SqueezeNet + SqueezeNet (ONNX Model Zoo) QDQ 56.39% 56.87% @@ -1692,7 +1692,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.33x - SSD-12 + SSD-12 (ONNX Model Zoo) QLinear 18.92% 18.98% @@ -1702,7 +1702,7 @@ Performance varies by use, configuration and other factors. See [platform config 3.56x - SSD-12 + SSD-12 (ONNX Model Zoo) QDQ 18.63% 18.98% @@ -1712,7 +1712,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.68x - Tiny YOLO V3 + Tiny YOLO V3 (ONNX Model Zoo) QLinear 11.82% 12.42% @@ -1722,7 +1722,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.26x - Ultraface + Ultraface (ONNX Model Zoo) QLinear 83.34% 83.65% @@ -1772,7 +1772,7 @@ Performance varies by use, configuration and other factors. See [platform config 3.21x - YOLO V3 + YOLO V3 (ONNX Model Zoo) QLinear 26.92% 28.73% @@ -1782,7 +1782,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.24x - YOLO V4 + YOLO V4 (ONNX Model Zoo) QLinear 32.33% 33.71% @@ -1792,7 +1792,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.50x - ZFNet + ZFNet (ONNX Model Zoo) QLinear 55.84% 55.96% @@ -1802,7 +1802,7 @@ Performance varies by use, configuration and other factors. See [platform config 1.72x - ZFNet + ZFNet (ONNX Model Zoo) QDQ 55.86% 55.96% From 14b1da8d4fe79aef279079a5a40c7ed916587a67 Mon Sep 17 00:00:00 2001 From: "Wang, Mengni" Date: Mon, 8 May 2023 17:03:00 +0800 Subject: [PATCH 2/4] Update README.md --- examples/README.md | 44 ++++++++++++++++++++++---------------------- 1 file changed, 22 insertions(+), 22 deletions(-) diff --git a/examples/README.md b/examples/README.md index a39f4402c43..7730894b59b 100644 --- a/examples/README.md +++ b/examples/README.md @@ -932,43 +932,43 @@ Intel® Neural Compressor validated examples with multiple compression technique qlinearops / qdq - AlexNet + AlexNet (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq - CaffeNet + CaffeNet (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq - DenseNet + DenseNet (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops - EfficientNet + EfficientNet (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq - FCN + FCN (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq - GoogleNet + GoogleNet (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq - Inception V1 + Inception V1 (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq @@ -992,13 +992,13 @@ Intel® Neural Compressor validated examples with multiple compression technique qlinearops / qdq - ShuffleNet V2 + ShuffleNet V2 (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq - SqueezeNet + SqueezeNet (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq @@ -1010,13 +1010,13 @@ Intel® Neural Compressor validated examples with multiple compression technique qlinearops / qdq - ZFNet + ZFNet (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops / qdq - ArcFace + ArcFace (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops @@ -1052,7 +1052,7 @@ Intel® Neural Compressor validated examples with multiple compression technique integerops / qdq - BERT SQuAD + BERT SQuAD (ONNX Model Zoo) Natural Language Processing Post-Training Dynamic / Static Quantization integerops @@ -1070,7 +1070,7 @@ Intel® Neural Compressor validated examples with multiple compression technique integerops / qdq - BiDAF + BiDAF (ONNX Model Zoo) Natural Language Processing Post-Training Dynamic Quantization integerops @@ -1254,55 +1254,55 @@ Intel® Neural Compressor validated examples with multiple compression technique qlinearops / qdq - DUC + DUC (ONNX Model Zoo) Object Detection Post-Training Static Quantization qlinearops - Faster R-CNN + Faster R-CNN (ONNX Model Zoo) Object Detection Post-Training Static Quantization qlinearops / qdq - Mask R-CNN + Mask R-CNN (ONNX Model Zoo) Object Detection Post-Training Static Quantization qlinearops / qdq - SSD + SSD (ONNX Model Zoo) Object Detection Post-Training Static Quantization qlinearops / qdq - Tiny YOLOv3 + Tiny YOLOv3 (ONNX Model Zoo) Object Detection Post-Training Static Quantization qlinearops - YOLOv3 + YOLOv3 (ONNX Model Zoo) Object Detection Post-Training Static Quantization qlinearops - YOLOv4 + YOLOv4 (ONNX Model Zoo) Object Detection Post-Training Static Quantization qlinearops - Emotion FERPlus + Emotion FERPlus (ONNX Model Zoo) Body Analysis Post-Training Static Quantization qlinearops - Ultra Face + Ultra Face (ONNX Model Zoo) Body Analysis Post-Training Static Quantization qlinearops From bf231fb25bd87d14406c92c35259560735d360d3 Mon Sep 17 00:00:00 2001 From: "Wang, Mengni" Date: Tue, 9 May 2023 10:22:26 +0800 Subject: [PATCH 3/4] Update validated_model_list.md --- docs/source/validated_model_list.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/source/validated_model_list.md b/docs/source/validated_model_list.md index e8b123e08a5..52a80f2cb57 100644 --- a/docs/source/validated_model_list.md +++ b/docs/source/validated_model_list.md @@ -1102,7 +1102,7 @@ Performance varies by use, configuration and other factors. See [platform config - AlexNet + AlexNet (ONNX Model Zoo) QLinear 54.73% 54.79% @@ -1112,7 +1112,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.05x - AlexNet + AlexNet (ONNX Model Zoo) QDQ 54.71% 54.79% @@ -1122,7 +1122,7 @@ Performance varies by use, configuration and other factors. See [platform config 2.01x - ArcFace + ArcFace (ONNX Model Zoo) QLinear 99.80% 99.80% From 9ba14268e57bb20d51c046079f9264f0c35e139a Mon Sep 17 00:00:00 2001 From: "Wang, Mengni" Date: Tue, 9 May 2023 10:25:04 +0800 Subject: [PATCH 4/4] Update README.md --- examples/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/examples/README.md b/examples/README.md index 7730894b59b..78bc3984e7d 100644 --- a/examples/README.md +++ b/examples/README.md @@ -974,7 +974,7 @@ Intel® Neural Compressor validated examples with multiple compression technique qlinearops / qdq - MNIST + MNIST (ONNX Model Zoo) Image Recognition Post-Training Static Quantization qlinearops