Merge branch 'master' into master

Author: laurenyu

.github/PULL_REQUEST_TEMPLATE.md

@@ -8,11 +8,17 @@
 
 _Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request._
 
+#### General
+
 - [ ] I have read the [CONTRIBUTING](https://github.com/aws/sagemaker-python-sdk/blob/master/CONTRIBUTING.md) doc
 - [ ] I used the commit message format described in [CONTRIBUTING](https://github.com/aws/sagemaker-python-sdk/blob/master/CONTRIBUTING.md#committing-your-change)
 - [ ] I have used the regional endpoint when creating S3 and/or STS clients (if appropriate)
+- [ ] I have updated any necessary documentation, including [READMEs](https://github.com/aws/sagemaker-python-sdk/blob/master/README.rst) and [API docs](https://github.com/aws/sagemaker-python-sdk/tree/master/doc) (if appropriate)
+
+#### Tests
+
 - [ ] I have added tests that prove my fix is effective or that my feature works (if appropriate)
 - [ ] I have checked that my tests are not configured for a specific region or account (if appropriate)
-- [ ] I have updated any necessary documentation, including [READMEs](https://github.com/aws/sagemaker-python-sdk/blob/master/README.rst) and [API docs](https://github.com/aws/sagemaker-python-sdk/tree/master/doc) (if appropriate)
+- [ ] I have used [`unique_name_from_base`](https://github.com/aws/sagemaker-python-sdk/blob/master/src/sagemaker/utils.py#L77) to create resource names in integ tests (if appropriate)
 
 By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

README.rst

@@ -65,6 +65,7 @@ Table of Contents
 21. `SageMaker Workflow <#sagemaker-workflow>`__
 22. `SageMaker Autopilot <#sagemaker-autopilot>`__
 23. `Model Monitoring <#amazon-sagemaker-model-monitoring>`__
+24. `SageMaker Debugger <#amazon-sagemaker-debugger>`__
 
 
 Installing the SageMaker Python SDK
@@ -366,3 +367,13 @@ You can use Amazon SageMaker Model Monitoring to automatically detect concept dr
 For more information, see `Amazon SageMaker Model Monitoring`_.
 
 .. _Amazon SageMaker Model Monitoring: https://sagemaker.readthedocs.io/en/stable/amazon_sagemaker_model_monitoring.html
+
+Amazon SageMaker Debugger
+-------------------------
+
+You can use Amazon SageMaker Debugger to automatically detect anomalies while training your machine learning models.
+
+For more information, see `Amazon SageMaker Debugger`_.
+
+.. _Amazon SageMaker Debugger: https://sagemaker.readthedocs.io/en/stable/amazon_sagemaker_debugger.html
+

doc/amazon_sagemaker_debugger.rst

@@ -82,12 +82,11 @@ IAM role-based operator deployment
 Before you can deploy your operator using an IAM role, associate an OpenID Connect (OIDC) provider with your role to
 authenticate with the IAM service.
 
-Associate an OpenID Connect Provider to Your Instance
-^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+Create an OpenID Connect Provider for Your Cluster
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 
-Create an OIDC identity provider for your cluster. If your
-cluster is managed by EKS, then your cluster will already have an OIDC
-attached to it. 
+The following instruction will create and associate an OIDC provider
+with your EKS cluster.
 
 Set the local ``CLUSTER_NAME`` and \ ``AWS_REGION`` environment
 variables as follows:

doc/amazon_sagemaker_operators_for_kubernetes.rst

@@ -29,8 +29,13 @@ Download the sample YAML file for training using the following command:
 
     wget https://github.com/aws/amazon-sagemaker-operator-for-k8s/blob/master/samples/xgboost-mnist-trainingjob.yaml
 
-Edit the \ ``xgboost-mnist-trainingjob.yaml`` file to replace the ``roleArn`` parameter with your \ ``<sagemaker-execution-role>``, and \ ``outputPath`` with your S3 bucket that the Amazon SageMaker
-execution role has write access to. Apply the YAML file using the
+Edit the ``xgboost-mnist-trainingjob.yaml`` file to replace the ``roleArn`` parameter with your ``<sagemaker-execution-role>``, and ``outputPath`` with your S3 bucket that the Amazon SageMaker
+execution role has write access to. The ``roleArn`` must have permissions so that Amazon SageMaker
+can access Amazon S3, Amazon CloudWatch, and other services on your 
+behalf. For more information on creating an Amazon SageMaker
+ExecutionRole, see `Amazon SageMaker
+Roles <https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-roles.html#sagemaker-roles-createtrainingjob-perms>`__.
+Apply the YAML file using the
 following command:
 
 ::

doc/amazon_sagemaker_operators_for_kubernetes_jobs.rst

@@ -208,3 +208,13 @@ You can use Amazon SageMaker Model Monitoring to automatically detect concept dr
     :maxdepth: 2
 
     amazon_sagemaker_model_monitoring
+
+*************************
+Amazon SageMaker Debugger
+*************************
+You can use Amazon SageMaker Debugger to automatically detect anomalies while training your machine learning models.
+
+.. toctree::
+    :maxdepth: 2
+
+    amazon_sagemaker_debugger

doc/index.rst

@@ -1048,6 +1048,15 @@ For more information, see `SageMaker Model Monitoring`_.
 
 .. _SageMaker Model Monitoring: https://github.com/aws/sagemaker-python-sdk/blob/master/doc/amazon_sagemaker_model_monitoring.rst
 
+******************
+SageMaker Debugger
+******************
+You can use Amazon SageMaker Debugger to automatically detect anomalies while training your machine learning models.
+
+For more information, see `SageMaker Debugger`_.
+
+.. _SageMaker Debugger: https://github.com/aws/sagemaker-python-sdk/blob/master/doc/amazon_sagemaker_debugger.rst
+
 ***
 FAQ
 ***

doc/overview.rst

@@ -116,7 +116,10 @@ When running your training script on SageMaker, it will have access to some pre-
 For more information on the runtime environment, including specific package versions, see `SageMaker Chainer Docker containers <#sagemaker-chainer-docker-containers>`__.
 
 If there are other packages you want to use with your script, you can include a ``requirements.txt`` file in the same directory as your training script to install other dependencies at runtime.
-A ``requirements.txt`` file is a text file that contains a list of items that are installed by using ``pip install``. You can also specify the version of an item to install.
+Both ``requirements.txt`` and your training script should be put in the same folder.
+You must specify this folder in ``source_dir`` argument when creating a Chainer estimator.
+A ``requirements.txt`` file is a text file that contains a list of items that are installed by using ``pip install``.
+You can also specify the version of an item to install.
 For information about the format of a ``requirements.txt`` file, see `Requirements Files <https://pip.pypa.io/en/stable/user_guide/#requirements-files>`__ in the pip documentation.
 
 Create an Estimator
@@ -637,4 +640,4 @@ SageMaker Chainer Docker containers
 
 You can visit the SageMaker Chainer containers repository here: https://github.com/aws/sagemaker-chainer-container
 
-For information about SageMaker Chainer Docker containers and their dependencies, see `SageMaker Chainer Docker containers <https://github.com/aws/sagemaker-python-sdk/tree/master/src/sagemaker/chainer#sagemaker-chainer-docker-containers>`_.
+For information about SageMaker Chainer Docker containers and their dependencies, see `SageMaker Chainer Docker containers <https://github.com/aws/sagemaker-python-sdk/tree/master/src/sagemaker/chainer#sagemaker-chainer-docker-containers>`_.

doc/using_chainer.rst

@@ -310,7 +310,10 @@ When running your training script on SageMaker, it will have access to some pre-
 For more information on the runtime environment, including specific package versions, see `SageMaker MXNet Containers <#sagemaker-mxnet-containers>`__.
 
 If there are other packages you want to use with your script, you can include a ``requirements.txt`` file in the same directory as your training script to install other dependencies at runtime.
-A ``requirements.txt`` file is a text file that contains a list of items that are installed by using ``pip install``. You can also specify the version of an item to install.
+Both ``requirements.txt`` and your training script should be put in the same folder.
+You must specify this folder in ``source_dir`` argument when creating an MXNet estimator.
+A ``requirements.txt`` file is a text file that contains a list of items that are installed by using ``pip install``.
+You can also specify the version of an item to install.
 For information about the format of a ``requirements.txt`` file, see `Requirements Files <https://pip.pypa.io/en/stable/user_guide/#requirements-files>`__ in the pip documentation.
 
 Create an Estimator

doc/using_mxnet.rst

@@ -131,7 +131,6 @@ The function of installing packages using ``requirements.txt`` is supported for
 
 A ``requirements.txt`` file is a text file that contains a list of items that are installed by using ``pip install``. You can also specify the version of an item to install. For information about the format of a ``requirements.txt`` file, see `Requirements Files <https://pip.pypa.io/en/stable/user_guide/#requirements-files>`__ in the pip documentation.
 
-
 Create an Estimator
 ===================