Skip to content

Commit 38e56c9

Browse files
arthwNeoZhangJianyulqnguyenJoeOstervmadananth
authored
Onsam 1406 (#671)
* create * rm wrong file * push missed files * add ci prepare cmd * add sudo in env * fix the env by clone to private env * fix env setting * mv the ilit to new folder, clear the output of ipy * rm temp files * Lqnguyen branch3 (#210) * Add bitonic-sort sample. * Add a note about common file in README. Signed-off-by: Loc Nguyen <[email protected]> * Move 1d_HeatTransfer sample to open source GitHub. Signed-off-by: Loc Nguyen <[email protected]> * Updating License file to remove date * Adding Buffer Object approach. * Add comment about the location of dpc_common.hpp. * New sample: Prefix Sum. * Remove new sample. * New code sample PrefixSum in ParallelPatterns. Signed-off-by: Loc Nguyen <[email protected]> * Integrate MPI code sample with dpc_reduce code sample. * Update README.md * Update main.cpp * Integrate MPI with latest dpc_reduce for beta09. * Update README.md * Update main.cpp * Update main.cpp * Update README.md * Update CXX to icpx and compiler option for beta09. Signed-off-by: Loc Nguyen <[email protected]> * Add "export I_MPI_CXX=dpcpp" in sample.json file. Signed-off-by: Loc Nguyen <[email protected]> * Update json file. * Sync with master. * Update bitonic-sort code sample according to the latest guideline. Signed-off-by: Loc Nguyen <[email protected]> Co-authored-by: JoeOster <[email protected]> * Lqnguyen branch1 (#201) * Add bitonic-sort sample. * Add a note about common file in README. Signed-off-by: Loc Nguyen <[email protected]> * Move 1d_HeatTransfer sample to open source GitHub. Signed-off-by: Loc Nguyen <[email protected]> * Updating License file to remove date * Adding Buffer Object approach. * Add comment about the location of dpc_common.hpp. * New sample: Prefix Sum. * Remove new sample. * New code sample PrefixSum in ParallelPatterns. Signed-off-by: Loc Nguyen <[email protected]> * Integrate MPI code sample with dpc_reduce code sample. * Update README.md * Update main.cpp * Integrate MPI with latest dpc_reduce for beta09. * Update README.md * Update main.cpp * Update main.cpp * Update README.md * Update CXX to icpx and compiler option for beta09. Signed-off-by: Loc Nguyen <[email protected]> * Add "export I_MPI_CXX=dpcpp" in sample.json file. Signed-off-by: Loc Nguyen <[email protected]> * Update json file. * Sync with master. * Update the PrefixSum code sample according to the latest guidelines. Signed-off-by: Loc Nguyen <[email protected]> * Update based on comments from reviewer. Signed-off-by: Loc Nguyen <[email protected]> * Restructure the Usage function. Signed-off-by: Loc Nguyen <[email protected]> Co-authored-by: JoeOster <[email protected]> * Lqnguyen branch2 (#209) * Add bitonic-sort sample. * Add a note about common file in README. Signed-off-by: Loc Nguyen <[email protected]> * Move 1d_HeatTransfer sample to open source GitHub. Signed-off-by: Loc Nguyen <[email protected]> * Updating License file to remove date * Adding Buffer Object approach. * Add comment about the location of dpc_common.hpp. * New sample: Prefix Sum. * Remove new sample. * New code sample PrefixSum in ParallelPatterns. Signed-off-by: Loc Nguyen <[email protected]> * Integrate MPI code sample with dpc_reduce code sample. * Update README.md * Update main.cpp * Integrate MPI with latest dpc_reduce for beta09. * Update README.md * Update main.cpp * Update main.cpp * Update README.md * Update CXX to icpx and compiler option for beta09. Signed-off-by: Loc Nguyen <[email protected]> * Add "export I_MPI_CXX=dpcpp" in sample.json file. Signed-off-by: Loc Nguyen <[email protected]> * Update json file. * Sync with master. * Update 1d_HeatTransfer code sample according to the new guideline. * Add comment about dpc_common.hpp . Signed-off-by: Loc Nguyen <[email protected]> Co-authored-by: JoeOster <[email protected]> * namespace change for montecarlo (#208) * Adding mandelbrot sample to the repository Signed-off-by: vmadanan <[email protected]> * Adding changes to mandelbrot to remove libsycl-complex.so dependency * namespace change for Monte Carlo * Updated samples to newest coding guidelines * Updating samples- Mandelbrot, DCT and MonteCarlo with newest coding guidelines * Adding changes to buffer and accessor declarations (#214) * Initial commit for iso3dfd_dpcpp code sample Signed-off-by: Gogar, Sunny L <[email protected]> * Update License.txt * Update sample.json * Adding iso3dfd_omp_offload and changing dpc++ compile for windows to dpcpp * Delete .nfs000000043228fc3f00000140 * Removing build directory accidently checked in * Update sample.json Fixing a missing comma * Adding couple of changes as per Paul's recommendation * Updating some variable names as per guidelines * Moving iso3dfd_omp_offload to C++ folder * Fixing a windows related error about missing std:: for tranform * Adding algorithm header explicity in iso3dfd.h * Fixing the sample.json to eliminate recent errors * Adding changes to buffer and accessor declarations * Update samples for beta10 release (#207) * Update simple add sample Signed-off-by: Maria, Moushumi <[email protected]> * Update make files Signed-off-by: Maria, Moushumi <[email protected]> * Update fpga make file Signed-off-by: Maria, Moushumi <[email protected]> * Add dpc_common.hpp * Update sample.json * Fix Makefile.win * Update Makefile.win * Update sample.json * Remove dpc_common.hpp * Update VS project file * Update README.md * Update sample.json * Add stb * Update read me file * Initial commit * Update License.txt * Change location of matrix multiplication sample * Fix matrix mul sample VS project file * Update samples for beta10 release * Fix for Windows * Fix for FPGA * Fix for FPGA * Fix for FPGA to support both beta09 and beta10 * Add header comment Co-authored-by: JoeOster <[email protected]> * folder structures changes following saumya's request (#217) * Beta10 GZIP performance update (#204) * Beta10 GZIP update -- use USM for data transfer Signed-off-by: Audrey Kertesz <[email protected]> * Trivial change to re-trigger CI Signed-off-by: Audrey Kertesz <[email protected]> * Update top level README (#222) * Update top-level README and improve format Signed-off-by: Audrey Kertesz <[email protected]> * Minor formatting update Signed-off-by: Audrey Kertesz <[email protected]> * Fix path to oneDPL for Beta10 (#224) * initial commit of openMP example. Signed-off-by: todd.erdner <[email protected]> * Initial commit of the dpc_reduce Signed-off-by: todd.erdner <[email protected]> * added guid to sample.json Signed-off-by: todd.erdner <[email protected]> * fixed sample.json files. Signed-off-by: todd.erdner <[email protected]> * fixed the include files. Somehow I copied a slightly old repo and it still had <chrono> and the omp_common.hpp file. They have been removed. Signed-off-by: todd.erdner <[email protected]> * added license.txt file ran through formating tool one more time removed all calls to "std::endl" and replaced with " \n" Signed-off-by: todd.erdner <[email protected]> * renamed license.txt to License.txt Signed-off-by: todd.erdner <[email protected]> * added "ciTests" to the sample.json file. It passed the check. Signed-off-by: todd.erdner <[email protected]> * fixed make error Signed-off-by: todd.erdner <[email protected]> * fixed sample.json Signed-off-by: todd.erdner <[email protected]> * removed "2020" from the License.txt file due to update guidelines. Signed-off-by: todd.erdner <[email protected]> * added comment regarding where you can find dpc_common in both files per Paul's comments. Signed-off-by: todd.erdner <[email protected]> * Modified names of the functions to represent what they do (ie. calc_pi_*) per suggestion from Paul. Signed-off-by: todd.erdner <[email protected]> * initial check-in to the C++ repo Signed-off-by: todd.erdner <[email protected]> * put correct comment on dpc_common.hpp Signed-off-by: todd.erdner <[email protected]> * added commenting indicating where they can find corresponding include files. Signed-off-by: todd.erdner <[email protected]> * added comment line Signed-off-by: todd.erdner <[email protected]> * removed openMP repo from DPC++ as it will be moved to C++ directory * Update README.md * Update README.md * Update README.md * Update README.md * fixed category line in sample.json to match exact text expected. * removing openMP from the DPC directory. It has been moved to C++ directory. * fixed tf_init call Signed-off-by: todd.erdner <[email protected]> * removed all calls into PSTL internal logic. This is what was causing fails between beta08 and beta09. Signed-off-by: todd.erdner <[email protected]> * fixed env variable to run on CPU Signed-off-by: todd.erdner <[email protected]> * update Readme file to include information about setting env variable to allocate more memory for any runs on the cpu Signed-off-by: todd.erdner <[email protected]> * added option in Cmake file to support unnamed lambda option. You need this to compile if the environment doesn't have this set by default. Signed-off-by: todd.erdner <[email protected]> * path to output file from compile has changed. it no longer seems to create the src directory. * started to remove get_access and change it to accessor name() Signed-off-by: todd.erdner <[email protected]> * fixed remaining get_access Signed-off-by: todd.erdner <[email protected]> * removed commented out old code Signed-off-by: todd.erdner <[email protected]> * Fixed path in Cmakelists.txt to suport both beta10 and beta09. The location of the oneDPL library changed between the two releases. * Update CMakeLists.txt Co-authored-by: JoeOster <[email protected]> * Added new Sample (TensorFlow Multinode Training with Horovod) (#197) * Added new Sample (TensorFlow Multinode Training with Horovod) Signed-off-by: Shailen Sobhee <[email protected]> * Fixed assert reported by bandit code checker tool. Signed-off-by: Shailen Sobhee <[email protected]> * Fix CI issue (MPI bug) - Upload to new folder structure Signed-off-by: Shailen Sobhee <[email protected]> * Minor little fix in sample.json; A comma was missing. Signed-off-by: Shailen Sobhee <[email protected]> * Removed old references to old folder structure Signed-off-by: Shailen Sobhee <[email protected]> * Update third_party_programs.txt (#221) * Updating License file to no date in the title /* * Copyright (c) 2020 Intel Corporation * * This program and the accompanying materials are made available under the * terms of the The MIT License which is available at * https://opensource.org/licenses/MIT. * * SPDX-License-Identifier: MIT */ * Update README.md * Fix FPGA entries * Update README.md Updates per request of sranikonda * Update README.md * removing duplicate samples after transfering to dwarves folders * Update Makefile.win changing compiler name from "dpcpp-cl" to "dpcpp" * Update Makefile.win * Update Makefile.win.fpga * Update CMakeLists.txt * Update CMakeLists.txt * Update CMakeLists.txt * Update README.md * Update README.md * Update from Legal Approval of 10/05/2020 Co-authored-by: akertesz <[email protected]> * Update Buffers/Accessors according to latest coding guidelines (Matrix_multiply Advisor and VTune). (#215) * TBB Samples Migration Signed-off-by: root <[email protected]> * Addressing PR Change Requests Signed-off-by: root <[email protected]> * Fill in "Purpose" Section of both README files. Signed-off-by: root <[email protected]> * Remove binary and build files Signed-off-by: root <[email protected]> * include dpc_common header, remove exception handler, fix json files. (all changes apply to both samples) Signed-off-by: root <[email protected]> * include dpc_common headers, remove exception handlers (both samples) Signed-off-by: root <[email protected]> * Fix README files, include header files for windows * Remove namespace, end files, use "std::iota", fix README Signed-off-by: root <[email protected]> * fix README Signed-off-by: root <[email protected]> * Fix "matrix_multiply" samples failures on Windows. * buffer/accessor updates for coding guidelines (matrix mul). Co-authored-by: root <[email protected]> * oneMKL sample updates for beta10 (#213) * Jupyter notebooks update as per the latest guidelines (#223) * updated the simplied version of the accessors, used auto for parallel_for index * using vector.size() instead of the global variables as per the comments * fixed the typo. Also check the output vector size * Updated Readme to add the include files path for dpc_common.hpp Updated the cpp file with the comments on dev_utilities folder * Updated the Jupyter notebooks as per the beta10 guidelines <[email protected]> * removed sample.json as these are jupyter notebooks <[email protected]> * removed some checkpoint files that are not necessary <[email protected]> * removed unwanted files <[email protected]> * removed unwanted checkpoint files <[email protected]> * Samples: block APSP and merge SPMV (#219) * Update simple add sample Signed-off-by: Maria, Moushumi <[email protected]> * Update make files Signed-off-by: Maria, Moushumi <[email protected]> * Update fpga make file Signed-off-by: Maria, Moushumi <[email protected]> * Add dpc_common.hpp * Update sample.json * Fix Makefile.win * Update Makefile.win * Update sample.json * Remove dpc_common.hpp * Update VS project file * Update README.md * Update sample.json * Add stb * Update read me file * Initial commit * Update License.txt * Change location of matrix multiplication sample * Fix matrix mul sample VS project file * Update samples for beta10 release * Fix for Windows * Fix for FPGA * Fix for FPGA * Fix for FPGA to support both beta09 and beta10 * Add header comment * Samples: block apsp and merge spmv * Add readme files * Update readme file * Update sample.json Co-authored-by: JoeOster <[email protected]> * move TF GS sample to new folder structure according to Saumya's direction (#227) * Update sample.json (#228) * Update simple add sample Signed-off-by: Maria, Moushumi <[email protected]> * Update make files Signed-off-by: Maria, Moushumi <[email protected]> * Update fpga make file Signed-off-by: Maria, Moushumi <[email protected]> * Add dpc_common.hpp * Update sample.json * Fix Makefile.win * Update Makefile.win * Update sample.json * Remove dpc_common.hpp * Update VS project file * Update README.md * Update sample.json * Add stb * Update read me file * Initial commit * Update License.txt * Change location of matrix multiplication sample * Fix matrix mul sample VS project file * Update samples for beta10 release * Fix for Windows * Fix for FPGA * Fix for FPGA * Fix for FPGA to support both beta09 and beta10 * Add header comment * Samples: block apsp and merge spmv * Add readme files * Update readme file * Update sample.json * Update sample.json Co-authored-by: JoeOster <[email protected]> * Edit for readme and some json files (#229) * Updating License file to no date in the title /* * Copyright (c) 2020 Intel Corporation * * This program and the accompanying materials are made available under the * terms of the The MIT License which is available at * https://opensource.org/licenses/MIT. * * SPDX-License-Identifier: MIT */ * Update README.md * Fix FPGA entries * Update README.md Updates per request of sranikonda * Update README.md * removing duplicate samples after transfering to dwarves folders * Update Makefile.win changing compiler name from "dpcpp-cl" to "dpcpp" * Update Makefile.win * Update Makefile.win.fpga * Update CMakeLists.txt * Update CMakeLists.txt * Update CMakeLists.txt * Update README.md * Update README.md * Update from Legal Approval of 10/05/2020 * Create README.md * Add files via upload * Update README.md minor modifications to content, purpose and key implementation details. * Update sample.json aligned description with readme * Update README.md reshuffled parts of the purpose and implementation details and abstracted a few key concepts into better summaries. * Update sample.json synched description with readme. * Update README.md Co-authored-by: akertesz <[email protected]> Co-authored-by: tomlenth <[email protected]> * Changed folder structure (#220) * Moved model zoo sample to new directory (#216) * moved model zoo sample to new directory * added runipy dependency installation * added error handling * minor fix * Updating buffers/accessors for TBB Samples according to coding guidelines. Update CMake files to use defaults. (#230) * TBB Samples Migration Signed-off-by: root <[email protected]> * Addressing PR Change Requests Signed-off-by: root <[email protected]> * Fill in "Purpose" Section of both README files. Signed-off-by: root <[email protected]> * Remove binary and build files Signed-off-by: root <[email protected]> * include dpc_common header, remove exception handler, fix json files. (all changes apply to both samples) Signed-off-by: root <[email protected]> * include dpc_common headers, remove exception handlers (both samples) Signed-off-by: root <[email protected]> * Fix README files, include header files for windows * Remove namespace, end files, use "std::iota", fix README Signed-off-by: root <[email protected]> * fix README Signed-off-by: root <[email protected]> * Fix "matrix_multiply" samples failures on Windows. * buffer/accessor updates for coding guidelines (matrix mul). * Update buffers/accessors for TBB Samples. Update CMake files to use defaults. Co-authored-by: root <[email protected]> * Update oneVPL samples for Beta10 (#218) * Add computed_tomography sample (#212) * create * rm wrong file * push missed files * add ci prepare cmd * add sudo in env * fix the env by clone to private env * fix env setting * mv the ilit to new folder, clear the output of ipy * rm temp files * change structure * rebase the update * rm .gitkeep * update for new API and config for ilit 1.0 in golden release * update the script to prepare running env * optimize for CPU to fix the latency of int8 low issue * rm unused code * fix the latency issue by script * correct the file name in text * support tf2.5 * rm old folder Co-authored-by: Zhang, Jianyu <[email protected]> Co-authored-by: lqnguyen <[email protected]> Co-authored-by: JoeOster <[email protected]> Co-authored-by: vmadananth <[email protected]> Co-authored-by: slgogar <[email protected]> Co-authored-by: Moushumi <[email protected]> Co-authored-by: Louie Tsai <[email protected]> Co-authored-by: akertesz <[email protected]> Co-authored-by: terdner <[email protected]> Co-authored-by: Shailen Sobhee <[email protected]> Co-authored-by: clevels <[email protected]> Co-authored-by: root <[email protected]> Co-authored-by: petercad <[email protected]> Co-authored-by: praveenkk123 <[email protected]> Co-authored-by: tomlenth <[email protected]> Co-authored-by: Jing Xu <[email protected]> Co-authored-by: Jitendra Patil <[email protected]> Co-authored-by: Marc Valle <[email protected]>
1 parent acadae3 commit 38e56c9

File tree

2 files changed

+31
-15
lines changed

2 files changed

+31
-15
lines changed

‎AI-and-Analytics/Getting-Started-Samples/LPOT-Sample-for-Tensorflow/lpot_sample_tensorflow.ipynb‎

Lines changed: 28 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@
5151
"source": [
5252
"Import python packages and check version.\n",
5353
"\n",
54-
"Make sure the Tensorflow is **2.2** or newer and LPOT is **1.0, 1,1 ** or **1.1**, matplotlib are installed.\n",
54+
"Make sure the Tensorflow is **2.2** or newer, LPOT is **not 1.2** and matplotlib are installed.\n",
5555
"\n",
5656
"Note， LPOT has an old name **ilit**. Following script supports to old package name **ilit**."
5757
]
@@ -76,6 +76,29 @@
7676
"import numpy as np"
7777
]
7878
},
79+
{
80+
"cell_type": "markdown",
81+
"metadata": {},
82+
"source": [
83+
"### Environment Setting"
84+
]
85+
},
86+
{
87+
"cell_type": "markdown",
88+
"metadata": {},
89+
"source": [
90+
"Intel Optimized TensorFlow 2.5.0 requires to set environment variable **TF_ENABLE_MKL_NATIVE_FORMAT=0** before running LPOT quantize Fp32 model or deploying the quantized model."
91+
]
92+
},
93+
{
94+
"cell_type": "code",
95+
"execution_count": null,
96+
"metadata": {},
97+
"outputs": [],
98+
"source": [
99+
"%env TF_ENABLE_MKL_NATIVE_FORMAT=0"
100+
]
101+
},
79102
{
80103
"cell_type": "markdown",
81104
"metadata": {},
@@ -346,15 +369,6 @@
346369
"We will execute the \"**lpot_quantize_model.py**\" to show the whole process of quantizing a model."
347370
]
348371
},
349-
{
350-
"cell_type": "code",
351-
"execution_count": null,
352-
"metadata": {},
353-
"outputs": [],
354-
"source": [
355-
"!export TF_ENABLE_MKL_NATIVE_FORMAT=0"
356-
]
357-
},
358372
{
359373
"cell_type": "code",
360374
"execution_count": null,
@@ -363,7 +377,7 @@
363377
},
364378
"outputs": [],
365379
"source": [
366-
"!TF_ENABLE_MKL_NATIVE_FORMAT=0 python lpot_quantize_model.py"
380+
"!python lpot_quantize_model.py"
367381
]
368382
},
369383
{
@@ -567,9 +581,9 @@
567581
],
568582
"metadata": {
569583
"kernelspec": {
570-
"display_name": "tensorflow",
584+
"display_name": "Python 3 (ipykernel)",
571585
"language": "python",
572-
"name": "tensorflow"
586+
"name": "python3"
573587
},
574588
"language_info": {
575589
"codemirror_mode": {
@@ -581,7 +595,7 @@
581595
"name": "python",
582596
"nbconvert_exporter": "python",
583597
"pygments_lexer": "ipython3",
584-
"version": "3.7.10"
598+
"version": "3.7.11"
585599
}
586600
},
587601
"nbformat": 4,

‎AI-and-Analytics/Getting-Started-Samples/LPOT-Sample-for-Tensorflow/profiling_lpot.py‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,7 @@
11

22
import tensorflow as tf
3+
+print("Tensorflow version {}".format(tf.__version__))
4+
35
import numpy as np
46
import time
57
import argparse
@@ -106,4 +108,4 @@ def save_res(result):
106108
os.environ["TF_NUM_INTEROP_THREADS"] = args.num_inter_threads
107109
os.environ["TF_NUM_INTRAOP_THREADS"] = args.num_intra_threads
108110

109-
save_res(infer_perf_pb(args.input_graph, val_data()))
111+
save_res(infer_perf_pb(args.input_graph, val_data()))

0 commit comments

Comments
 (0)