Commit 2c3d606
feat: Benchmark feature initial commit (aws#1463)
* Sync Master benchmark feature (aws#1461)
* feat: support config_name in all JumpStart interfaces (aws#4583) (aws#4607)
* add-config-name
* address comments
* updates for set config
* docstyle
* updates
* fix
* format
* format
* remove tests
* Add ReadOnly APIs (aws#4606)
* Add ReadOnly APIs
* Resolving PR review comments
* Resolve PR review comments
* Refactoring
* Refactoring
* Add Caching
* Refactore
* Resolving conflicts
* Add Unit Tests
* Fix Unit Tests
* Fix unit tests
* Fix UT
* Refactoring
* Fix Integ tests
* refactoring after Notebook testing
* Fix code styles
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* feat: tag JumpStart resource with config names (aws#4608)
* tag config name
* format
* resolving comments
* format
* format
* update
* fix
* format
* updates inference component config name
* fix: tests
* ModelBuilder: Add functionalities to get and set deployment config. (aws#4614)
* Add funtionalities to get and set deployment config
* Resolve PR comments
* ModelBuilder-JS
* Add Unit tests
* Refactoring
* Testing with Notebook
* Test backward compatibility
* Remove Accelerated column if all not enabled
* Fix docstring
* Resolved PR Review comments
* Docstring
* increase code coverage
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* Benchmark feature v2 (aws#4618)
* Add funtionalities to get and set deployment config
* Resolve PR comments
* ModelBuilder-JS
* Add Unit tests
* Refactoring
* Testing with Notebook
* Test backward compatibility
* Remove Accelerated column if all not enabled
* Fix docstring
* Resolved PR Review comments
* Docstring
* increase code coverage
* Testing fix with Notebook
* Only fetch instance rate metrics if not present
* Increase code coverage
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* fix: populate default config name to model (aws#4617)
* fix: populate default config name to model
* update condition
* fix
* format
* flake8
* fix tests
* fix coverage
* temporarily skip integ test vulnerbility
* fix tolerate attach method
* format
* fix predictor
* format
* Fix fetch instance rate bug (aws#4624)
Co-authored-by: Jonathan Makunga <[email protected]>
* chore: require config name and instance type in set_deployment_config (aws#4625)
* require config_name and instance_type in set config
* docstring
* add supported instance types check
* add more tests
* format
* fix tests
* Deployment Configs - Follow-ups (aws#4626)
* Init Deployment configs outside Model init.
* Testing with NB
* Testing with NB-V2
* Refactoring, NB testing
* NB Testing and Refactoring
* Testing
* Refactoring
* Testing with NB
* Debug
* Debug display API
* Debug with NB
* Testing with NB
* Refactoring
* Refactoring
* Refactoring and NB testing
* Testing with NB
* Refactoring
* Prefix instance type with ml
* Fix unit tests
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* fix: use different separator to flatten dict (aws#4629)
* Use separate tags for inference and training configs (aws#4635)
* Use separate tags for inference and training
* format
* format
* format
* format
* Add supported inference and incremental training configs (aws#4637)
* supported inference configs
* add tests
* format
* tests
* tests
* address comments
* format and address comments
* updates
* formt
* format
* Benchmark feature fixes (aws#4632)
* Filter down Benchmark Metrics
* Filter down Benchmark Metrics
* Testing NB
* Testing MB
* Testing
* Refactoring
* Unit tests
* Display instance type first, and instance rate last
* Display unbalanced metrics
* Testing with NB
* Testing with NB
* Debug
* Debug
* Testing with NB
* Testing with NB
* Testing with NB
* Refactoring
* Refactoring
* Refactoring
* Unit tests
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Refactoring
* Debug
* Config ranking
* Debug
* Debug
* Debug
* Debug
* Debug
* Ranking
* Ranking-Debug
* Ranking-Debug
* Ranking-Debug
* Ranking-Debug
* Ranking-Debug
* Ranking-Debug
* Debug
* Debug
* Debug
* Debug
* Refactoring
* Contact JumpStart team to fix flaky test. test_list_jumpstart_models_script_filter
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* fix: typo and merge with master branch (aws#4649)
* Merge master into benchmark feature (aws#4652)
* Merge master into master-benchmark-feature (aws#4656)
* Master benchmark feature (aws#4658)
* Master benchmark feature merge master (aws#4661)
* Master benchmark feature (aws#4672)
* fix: mainline alt config parsing (aws#4602)
* fix: parsing
* fix: commit tests
* fix: types
* updated
* fix
* Add Triton v24.03 URI (aws#4605)
Co-authored-by: Nikhil Kulkarni <[email protected]>
* feature: support session tag chaining for training job (aws#4596)
* feature: support session tag chaining for training job
* fix: resolve typo
* fix: resolve typo and build failure
* fix: resolve typo and unit test failure
---------
Co-authored-by: Jessica Zhu <jessicazhu3@[email protected]>
* prepare release v2.217.0
* update development version to v2.217.1.dev0
* fix: properly close files in lineage queries and tests (aws#4587)
Closes aws#4458
* feature: set default allow_pickle param to False (aws#4557)
* breaking: set default allow_pickle param to False
* breaking: fix unit tests and linting
NumpyDeserializer will not allow deserialization
unless allow_pickle flag is set to True explicitly
* fix: black-check
---------
Co-authored-by: Ashwin Krishna <[email protected]>
* Fix:invalid component error with new metadata (aws#4634)
* fix: invalid component name
* tests
* format
* fix vulnerable model integ tests llama 2
* updated
* fix: training dataset location
* prepare release v2.218.0
* update development version to v2.218.1.dev0
* chore: update skipped flaky tests (aws#4644)
* Update skipped flaky tests
* flake8
* format
* format
* chore: release tgi 2.0.1 (aws#4642)
* chore: release tgi 2.0.1
* minor fix
---------
Co-authored-by: Zhaoqi <[email protected]>
* fix: Fix UserAgent logging in Python SDK (aws#4647)
* prepare release v2.218.1
* update development version to v2.218.2.dev0
* feature: allow choosing js payload by alias in private method
* Updates for SMP v2.3.1 (aws#4660)
Co-authored-by: Suhit Kodgule <[email protected]>
* chore(deps): bump jinja2 from 3.1.3 to 3.1.4 in /doc (aws#4655)
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](pallets/jinja@3.1.3...3.1.4)
---
updated-dependencies:
- dependency-name: jinja2
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump tqdm from 4.66.2 to 4.66.3 in /tests/data/serve_resources/mlflow/pytorch (aws#4650)
Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.66.2 to 4.66.3.
- [Release notes](https://github.com/tqdm/tqdm/releases)
- [Commits](tqdm/tqdm@v4.66.2...v4.66.3)
---
updated-dependencies:
- dependency-name: tqdm
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump jinja2 from 3.1.3 to 3.1.4 in /requirements/extras (aws#4654)
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](pallets/jinja@3.1.3...3.1.4)
---
updated-dependencies:
- dependency-name: jinja2
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* prepare release v2.219.0
* update development version to v2.219.1.dev0
* fix: skip flakey tests pending investigation (aws#4667)
* change: update image_uri_configs 05-09-2024 07:17:41 PST
* Add tensorflow_serving support for mlflow models and enable lineage tracking for mlflow models (aws#4662)
* Initial commit for tensorflow_serving support of MLflow
* Add integ tests for mlflow tf_serving
* fix style issues
* remove unused attributes from tf builder
* Add deep ping for tf_serving local mode
* Initial commit for lineage impl
* Initial commit for tensorflow_serving support of MLflow
* Add integ tests for mlflow tf_serving
* fix style issues
* remove unused attributes from tf builder
* Add deep ping for tf_serving local mode
* Add integ tests and uts
* fix local mode for tf_serving
* Allow lineage tracking only in sagemaker endpoint mode
* fix regex pattern
* fix style issues
* fix regex pattern and hard coded py version in ut
* fix missing session
* Resolve pr comments and fix regex for mlflow registry and ids
* fix: model builder race condition on sagemaker session (aws#4673)
Co-authored-by: Jonathan Makunga <[email protected]>
* feat: Add telemetry support for mlflow models (aws#4674)
* Initial commit for telemetry support
* Fix style issues and add more logger messages
* fix value error messages in ut
* feat: add new images for HF TGI release (aws#4677)
* chore: add new images for HF TGI release
* test
* feature: AutoGluon 1.1.0 image_uris update (aws#4679)
Co-authored-by: Ubuntu <[email protected]>
* change: add debug logs to workflow container dist creation (aws#4682)
* prepare release v2.220.0
* update development version to v2.220.1.dev0
* fix: Image URI should take precedence for HF models (aws#4684)
* Fix: Image URI should take precedence for HF models
* Fix formatting
* Fix formatting
* Fix formatting
* Increase coverage - UT pass
* feat: support config_name in all JumpStart interfaces (aws#4583) (aws#4607)
* add-config-name
* address comments
* updates for set config
* docstyle
* updates
* fix
* format
* format
* remove tests
* Add ReadOnly APIs (aws#4606)
* Add ReadOnly APIs
* Resolving PR review comments
* Resolve PR review comments
* Refactoring
* Refactoring
* Add Caching
* Refactore
* Resolving conflicts
* Add Unit Tests
* Fix Unit Tests
* Fix unit tests
* Fix UT
* Refactoring
* Fix Integ tests
* refactoring after Notebook testing
* Fix code styles
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* feat: tag JumpStart resource with config names (aws#4608)
* tag config name
* format
* resolving comments
* format
* format
* update
* fix
* format
* updates inference component config name
* fix: tests
* ModelBuilder: Add functionalities to get and set deployment config. (aws#4614)
* Add funtionalities to get and set deployment config
* Resolve PR comments
* ModelBuilder-JS
* Add Unit tests
* Refactoring
* Testing with Notebook
* Test backward compatibility
* Remove Accelerated column if all not enabled
* Fix docstring
* Resolved PR Review comments
* Docstring
* increase code coverage
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* Benchmark feature v2 (aws#4618)
* Add funtionalities to get and set deployment config
* Resolve PR comments
* ModelBuilder-JS
* Add Unit tests
* Refactoring
* Testing with Notebook
* Test backward compatibility
* Remove Accelerated column if all not enabled
* Fix docstring
* Resolved PR Review comments
* Docstring
* increase code coverage
* Testing fix with Notebook
* Only fetch instance rate metrics if not present
* Increase code coverage
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* fix: populate default config name to model (aws#4617)
* fix: populate default config name to model
* update condition
* fix
* format
* flake8
* fix tests
* fix coverage
* temporarily skip integ test vulnerbility
* fix tolerate attach method
* format
* fix predictor
* format
* Fix fetch instance rate bug (aws#4624)
Co-authored-by: Jonathan Makunga <[email protected]>
* chore: require config name and instance type in set_deployment_config (aws#4625)
* require config_name and instance_type in set config
* docstring
* add supported instance types check
* add more tests
* format
* fix tests
* Deployment Configs - Follow-ups (aws#4626)
* Init Deployment configs outside Model init.
* Testing with NB
* Testing with NB-V2
* Refactoring, NB testing
* NB Testing and Refactoring
* Testing
* Refactoring
* Testing with NB
* Debug
* Debug display API
* Debug with NB
* Testing with NB
* Refactoring
* Refactoring
* Refactoring and NB testing
* Testing with NB
* Refactoring
* Prefix instance type with ml
* Fix unit tests
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* fix: use different separator to flatten dict (aws#4629)
* Use separate tags for inference and training configs (aws#4635)
* Use separate tags for inference and training
* format
* format
* format
* format
* Add supported inference and incremental training configs (aws#4637)
* supported inference configs
* add tests
* format
* tests
* tests
* address comments
* format and address comments
* updates
* formt
* format
* Benchmark feature fixes (aws#4632)
* Filter down Benchmark Metrics
* Filter down Benchmark Metrics
* Testing NB
* Testing MB
* Testing
* Refactoring
* Unit tests
* Display instance type first, and instance rate last
* Display unbalanced metrics
* Testing with NB
* Testing with NB
* Debug
* Debug
* Testing with NB
* Testing with NB
* Testing with NB
* Refactoring
* Refactoring
* Refactoring
* Unit tests
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Custom lru
* Refactoring
* Debug
* Config ranking
* Debug
* Debug
* Debug
* Debug
* Debug
* Ranking
* Ranking-Debug
* Ranking-Debug
* Ranking-Debug
* Ranking-Debug
* Ranking-Debug
* Ranking-Debug
* Debug
* Debug
* Debug
* Debug
* Refactoring
* Contact JumpStart team to fix flaky test. test_list_jumpstart_models_script_filter
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* fix: typo and merge with master branch (aws#4649)
* Merge master into benchmark feature (aws#4652)
* Merge master into master-benchmark-feature (aws#4656)
* Master benchmark feature (aws#4658)
* Remove duplicate line in types.py
* Remove duplicate lines
* Remove duplicate lines
* Remove duplicate lines
* Remove duplicate lines
* fix unit test
---------
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Haotian An <[email protected]>
Co-authored-by: Nikhil Kulkarni <[email protected]>
Co-authored-by: Nikhil Kulkarni <[email protected]>
Co-authored-by: jessicazhu3 <[email protected]>
Co-authored-by: Jessica Zhu <jessicazhu3@[email protected]>
Co-authored-by: ci <ci>
Co-authored-by: Justin <[email protected]>
Co-authored-by: ASHWIN KRISHNA <[email protected]>
Co-authored-by: Ashwin Krishna <[email protected]>
Co-authored-by: Haixin Wang <[email protected]>
Co-authored-by: Zhaoqi <[email protected]>
Co-authored-by: Kalyani Nikure <[email protected]>
Co-authored-by: Keerthan Vasist <[email protected]>
Co-authored-by: SuhitK <[email protected]>
Co-authored-by: Suhit Kodgule <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: sagemaker-bot <[email protected]>
Co-authored-by: jiapinw <[email protected]>
Co-authored-by: Jonathan Makunga <[email protected]>
Co-authored-by: Jonathan Makunga <[email protected]>
Co-authored-by: Prateek M Desai <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Mufaddal Rohawala <[email protected]>
Co-authored-by: Samrudhi Sharma <[email protected]>
Co-authored-by: evakravi <[email protected]>
* fix benchmark feature read-only apis (aws#4675)
* Rearrange benchmark metric table
* Refactoring
* Refactoring
* Refactoring
* Refactoring
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* Refactoring
* Refactoring
* Refactoring
* Refactoring
* Refactoring
* Add Unit tests
* Refactoring
* Refactoring
* hide index from DataFrame
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* feat: update alt config to work with model packages (aws#4706)
* feat: update alt config to work with model packages
* format
* remove env vars for model package
* fix tests
* Update: ReadOnly APIs (aws#4707)
* Model data arn
* Refactoring
* Refactoring
* acceleration_configs
* Refactoring
* UT
* Add Filter
* UT
* Revert "UT"
* UT
* UT
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* ModelBuilder to support display with filter. (aws#4712)
Co-authored-by: Jonathan Makunga <[email protected]>
* Sync branch (aws#4718)
* fix: mainline alt config parsing (aws#4602)
* fix: parsing
* fix: commit tests
* fix: types
* updated
* fix
* Add Triton v24.03 URI (aws#4605)
Co-authored-by: Nikhil Kulkarni <[email protected]>
* feature: support session tag chaining for training job (aws#4596)
* feature: support session tag chaining for training job
* fix: resolve typo
* fix: resolve typo and build failure
* fix: resolve typo and unit test failure
---------
Co-authored-by: Jessica Zhu <jessicazhu3@[email protected]>
* prepare release v2.217.0
* update development version to v2.217.1.dev0
* fix: properly close files in lineage queries and tests (aws#4587)
Closes aws#4458
* feature: set default allow_pickle param to False (aws#4557)
* breaking: set default allow_pickle param to False
* breaking: fix unit tests and linting
NumpyDeserializer will not allow deserialization
unless allow_pickle flag is set to True explicitly
* fix: black-check
---------
Co-authored-by: Ashwin Krishna <[email protected]>
* Fix:invalid component error with new metadata (aws#4634)
* fix: invalid component name
* tests
* format
* fix vulnerable model integ tests llama 2
* updated
* fix: training dataset location
* prepare release v2.218.0
* update development version to v2.218.1.dev0
* chore: update skipped flaky tests (aws#4644)
* Update skipped flaky tests
* flake8
* format
* format
* chore: release tgi 2.0.1 (aws#4642)
* chore: release tgi 2.0.1
* minor fix
---------
Co-authored-by: Zhaoqi <[email protected]>
* fix: Fix UserAgent logging in Python SDK (aws#4647)
* prepare release v2.218.1
* update development version to v2.218.2.dev0
* feature: allow choosing js payload by alias in private method
* Updates for SMP v2.3.1 (aws#4660)
Co-authored-by: Suhit Kodgule <[email protected]>
* chore(deps): bump jinja2 from 3.1.3 to 3.1.4 in /doc (aws#4655)
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](pallets/jinja@3.1.3...3.1.4)
---
updated-dependencies:
- dependency-name: jinja2
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump tqdm from 4.66.2 to 4.66.3 in /tests/data/serve_resources/mlflow/pytorch (aws#4650)
Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.66.2 to 4.66.3.
- [Release notes](https://github.com/tqdm/tqdm/releases)
- [Commits](tqdm/tqdm@v4.66.2...v4.66.3)
---
updated-dependencies:
- dependency-name: tqdm
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump jinja2 from 3.1.3 to 3.1.4 in /requirements/extras (aws#4654)
Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](pallets/jinja@3.1.3...3.1.4)
---
updated-dependencies:
- dependency-name: jinja2
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* prepare release v2.219.0
* update development version to v2.219.1.dev0
* fix: skip flakey tests pending investigation (aws#4667)
* change: update image_uri_configs 05-09-2024 07:17:41 PST
* Add tensorflow_serving support for mlflow models and enable lineage tracking for mlflow models (aws#4662)
* Initial commit for tensorflow_serving support of MLflow
* Add integ tests for mlflow tf_serving
* fix style issues
* remove unused attributes from tf builder
* Add deep ping for tf_serving local mode
* Initial commit for lineage impl
* Initial commit for tensorflow_serving support of MLflow
* Add integ tests for mlflow tf_serving
* fix style issues
* remove unused attributes from tf builder
* Add deep ping for tf_serving local mode
* Add integ tests and uts
* fix local mode for tf_serving
* Allow lineage tracking only in sagemaker endpoint mode
* fix regex pattern
* fix style issues
* fix regex pattern and hard coded py version in ut
* fix missing session
* Resolve pr comments and fix regex for mlflow registry and ids
* fix: model builder race condition on sagemaker session (aws#4673)
Co-authored-by: Jonathan Makunga <[email protected]>
* feat: Add telemetry support for mlflow models (aws#4674)
* Initial commit for telemetry support
* Fix style issues and add more logger messages
* fix value error messages in ut
* feat: add new images for HF TGI release (aws#4677)
* chore: add new images for HF TGI release
* test
* feature: AutoGluon 1.1.0 image_uris update (aws#4679)
Co-authored-by: Ubuntu <[email protected]>
* change: add debug logs to workflow container dist creation (aws#4682)
* prepare release v2.220.0
* update development version to v2.220.1.dev0
* fix: Image URI should take precedence for HF models (aws#4684)
* Fix: Image URI should take precedence for HF models
* Fix formatting
* Fix formatting
* Fix formatting
* Increase coverage - UT pass
* feat: onboard tei image config to pysdk (aws#4681)
* feat: onboard tei image config to pysdk
* fix formatting issue
* minor fix func name
* fix unit tests
---------
Co-authored-by: Mufaddal Rohawala <[email protected]>
* fix: model builder limited container support for endpoint mode. (aws#4683)
* Allow ModelBuilder's endpoint mode for Jumpstart models packaged with containers other than TGI and DJL
* increase coverage
* Add JS Support for MMS Serving
* Add JS Support for MMS Serving
* Unit tests
* Refactoring
* Refactoring
* Refactoring
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* change: Add more debuging (aws#4687)
* change: cover tei with image_uris.retrieve API (aws#4689)
* fix: JS Model with non-TGI/non-DJL deployment failure (aws#4688)
* Debug
* Debug
* Debug
* Debug
* Debug
* Debug
* fix docstyle
* Refactoring
* Add Integ tests
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* Feat: Pull latest tei container for sentence similiarity models on HuggingFace hub (aws#4686)
* Update: Pull latest tei container for sentence similiarity models
* Fix formatting
* Address PR comments
* Fix formatting
* Fix check
* Switch sentence similarity to be deployed on tgi
* Fix formatting
* Fix formatting
* Fix formatting
* Fix formatting
* Introduce TEI builder with TGI server
* Fix formmatting
* Add integ test
* Fix formatting
* Add integ test
* Add integ test
* Add integ test
* Add integ test
* Add integ test
* Fix formatting
* Move to G5 for integ test
* Fix formatting
* Integ test updates
* Integ test updates
* Integ test updates
* Fix formatting
* Integ test updates
* Move back to generate for ping
* Integ test updates
* Integ test updates
* Fix: Add Image URI overrides for transformers models (aws#4693)
* Fix: Add Image URI overrides for transformers models
* Increase coverage
* Fix formatting
* prepare release v2.221.0
* update development version to v2.221.1.dev0
* Add tei cpu image (aws#4695)
* Add tei cpu image
* fix format issue
* fix unit tests
* fix typo
* fix typo
* Feat: Add TEI support for ModelBuilder (aws#4694)
* Add TEI Serving
* Add TEI Serving
* Add TEI Serving
* Add TEI Serving
* Add TEI Serving
* Add TEI Serving
* Notebook testing
* Notebook testing
* Notebook testing
* Refactoring
* Refactoring
* UT
* UT
* Refactoring
* Test coverage
* Refactoring
* Refactoring
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* Convert pytorchddp distribution to smdistributed distribution (aws#4698)
* rewrite pytorchddp to smdistributed
* remove instance type check
* Update estimator.py
* remove validate_pytorch_distribution
* fix
* fix unit tests
* fix formatting
* check instance type not None
* prepare release v2.221.1
* update development version to v2.221.2.dev0
* Update: SM Endpoint Routing Strategy Support. (aws#4702)
* RoutingConfig
* Refactoring
* Docstring
* UT
* Refactoring
* Refactoring
---------
Co-authored-by: Jonathan Makunga <[email protected]>
* change: update image_uri_configs 05-29-2024 07:17:35 PST
* Making project name in workflow files dynamic (aws#4708)
* fix: Fix ci unit-tests (aws#4713)
* chore(deps): bump requests from 2.31.0 to 2.32.2 in /tests/data/serve_resources/mlflow/pytorch (aws#4709)
Bumps [requests](https://github.com/psf/requests) from 2.31.0 to 2.32.2.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](psf/requests@v2.31.0...v2.32.2)
---
updated-dependencies:
- dependency-name: requests
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump apache-airflow from 2.9.0 to 2.9.1 in /requirements/extras (aws#4703)
* chore(deps): bump apache-airflow in /requirements/extras
Bumps [apache-airflow](https://github.com/apache/airflow) from 2.9.0 to 2.9.1.
- [Release notes](https://github.com/apache/airflow/releases)
- [Changelog](https://github.com/apache/airflow/blob/main/RELEASE_NOTES.rst)
- [Commits](apache/airflow@2.9.0...2.9.1)
---
updated-dependencies:
- dependency-name: apache-airflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
* Update tox.ini to bump apache-airflow
---------
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kalyani Nikure <[email protected]>
* chore(deps): bump mlflow from 2.10.2 to 2.12.1 in /tests/data/serve_resources/mlflow/pytorch (aws#4690)
Bumps [mlflow](https://github.com/mlflow/mlflow) from 2.10.2 to 2.12.1.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](mlflow/mlflow@v2.10.2...v2.12.1)
---
updated-dependencies:
- dependency-name: mlflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump mlflow from 2.11.1 to 2.12.1 in /tests/data/serve_resources/mlflow/xgboost (aws#4692)
Bumps [mlflow](https://github.com/mlflow/mlflow) from 2.11.1 to 2.12.1.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](mlflow/mlflow@v2.11.1...v2.12.1)
---
updated-dependencies:
- dependency-name: mlflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(deps): bump mlflow from 2.11.1 to 2.12.1 in /tests/data/serve_resources/mlflow/tensorflow (aws#4691)
Bumps [mlflow](https://github.com/mlflow/mlflow) from 2.11.1 to 2.12.1.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](mlflow/mlflow@v2.11.1...v2.12.1)
---
updated-dependencies:
- dependency-name: mlflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* change: Updates for DJL 0.28.0 release (aws#4701)
* Sync Branch
---------
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Haotian An <[email protected]>
Co-authored-by: Nikhil Kulkarni <[email protected]>
Co-authored-by: Nikhil Kulkarni <[email protected]>
Co-authored-by: jessicazhu3 <[email protected]>
Co-authored-by: Jessica Zhu <jessicazhu3@[email protected]>
Co-authored-by: ci <ci>
Co-authored-by: Justin <[email protected]>
Co-authored-by: ASHWIN KRISHNA <[email protected]>
Co-authored-by: Ashwin Krishna <[email protected]>
Co-authored-by: Haixin Wang <[email protected]>
Co-authored-by: Zhaoqi <[email protected]>
Co-authored-by: Kalyani Nikure <[email protected]>
Co-authored-by: Keerthan Vasist <[email protected]>
Co-authored-by: SuhitK <[email protected]>
Co-authored-by: Suhit Kodgule <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: sagemaker-bot <[email protected]>
Co-authored-by: jiapinw <[email protected]>
Co-authored-by: Jonathan Makunga <[email protected]>
Co-authored-by: Prateek M Desai <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Mufaddal Rohawala <[email protected]>
Co-authored-by: Samrudhi Sharma <[email protected]>
Co-authored-by: Tom Bousso <[email protected]>
Co-authored-by: Zhaoqi <[email protected]>
Co-authored-by: Tyler Osterberg <[email protected]>
* Merge
---------
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Haotian An <[email protected]>
Co-authored-by: Jonathan Makunga <[email protected]>
Co-authored-by: evakravi <[email protected]>
Co-authored-by: Erick Benitez-Ramos <[email protected]>
Co-authored-by: Nikhil Kulkarni <[email protected]>
Co-authored-by: Nikhil Kulkarni <[email protected]>
Co-authored-by: jessicazhu3 <[email protected]>
Co-authored-by: Jessica Zhu <jessicazhu3@[email protected]>
Co-authored-by: Justin <[email protected]>
Co-authored-by: ASHWIN KRISHNA <[email protected]>
Co-authored-by: Ashwin Krishna <[email protected]>
Co-authored-by: Haixin Wang <[email protected]>
Co-authored-by: Zhaoqi <[email protected]>
Co-authored-by: Kalyani Nikure <[email protected]>
Co-authored-by: Keerthan Vasist <[email protected]>
Co-authored-by: SuhitK <[email protected]>
Co-authored-by: Suhit Kodgule <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: sagemaker-bot <[email protected]>
Co-authored-by: jiapinw <[email protected]>
Co-authored-by: Prateek M Desai <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Mufaddal Rohawala <[email protected]>
Co-authored-by: Samrudhi Sharma <[email protected]>
Co-authored-by: Tom Bousso <[email protected]>
Co-authored-by: Zhaoqi <[email protected]>
Co-authored-by: Tyler Osterberg <[email protected]>
* Fix UT (aws#1465)
Co-authored-by: Jonathan Makunga <[email protected]>
---------
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Jonathan Makunga <[email protected]>
Co-authored-by: Haotian An <[email protected]>
Co-authored-by: Jonathan Makunga <[email protected]>
Co-authored-by: evakravi <[email protected]>
Co-authored-by: Erick Benitez-Ramos <[email protected]>
Co-authored-by: Nikhil Kulkarni <[email protected]>
Co-authored-by: Nikhil Kulkarni <[email protected]>
Co-authored-by: jessicazhu3 <[email protected]>
Co-authored-by: Jessica Zhu <jessicazhu3@[email protected]>
Co-authored-by: Justin <[email protected]>
Co-authored-by: ASHWIN KRISHNA <[email protected]>
Co-authored-by: Ashwin Krishna <[email protected]>
Co-authored-by: Haixin Wang <[email protected]>
Co-authored-by: Zhaoqi <[email protected]>
Co-authored-by: Keerthan Vasist <[email protected]>
Co-authored-by: SuhitK <[email protected]>
Co-authored-by: Suhit Kodgule <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: sagemaker-bot <[email protected]>
Co-authored-by: jiapinw <[email protected]>
Co-authored-by: Prateek M Desai <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Mufaddal Rohawala <[email protected]>
Co-authored-by: Samrudhi Sharma <[email protected]>
Co-authored-by: Tom Bousso <[email protected]>
Co-authored-by: Zhaoqi <[email protected]>
Co-authored-by: Tyler Osterberg <[email protected]>1 parent ed43b07 commit 2c3d606
File tree
53 files changed
+3900
-423
lines changed- src/sagemaker
- jumpstart
- artifacts
- factory
- serve/builder
- tests/unit
- sagemaker
- jumpstart
- estimator
- model
- serve
- builder
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
53 files changed
+3900
-423
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
77 | 77 | | |
78 | 78 | | |
79 | 79 | | |
| 80 | + | |
80 | 81 | | |
81 | 82 | | |
82 | 83 | | |
| |||
98 | 99 | | |
99 | 100 | | |
100 | 101 | | |
| 102 | + | |
101 | 103 | | |
102 | 104 | | |
103 | 105 | | |
| |||
117 | 119 | | |
118 | 120 | | |
119 | 121 | | |
| 122 | + | |
120 | 123 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
77 | 77 | | |
78 | 78 | | |
79 | 79 | | |
| 80 | + | |
80 | 81 | | |
81 | 82 | | |
82 | 83 | | |
| |||
98 | 99 | | |
99 | 100 | | |
100 | 101 | | |
| 102 | + | |
101 | 103 | | |
102 | 104 | | |
103 | 105 | | |
| |||
117 | 119 | | |
118 | 120 | | |
119 | 121 | | |
| 122 | + | |
120 | 123 | | |
121 | 124 | | |
122 | 125 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
97 | 97 | | |
98 | 98 | | |
99 | 99 | | |
| 100 | + | |
100 | 101 | | |
101 | 102 | | |
102 | 103 | | |
| |||
118 | 119 | | |
119 | 120 | | |
120 | 121 | | |
| 122 | + | |
121 | 123 | | |
122 | 124 | | |
123 | 125 | | |
| |||
138 | 140 | | |
139 | 141 | | |
140 | 142 | | |
| 143 | + | |
141 | 144 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
| 39 | + | |
39 | 40 | | |
40 | 41 | | |
41 | 42 | | |
| |||
65 | 66 | | |
66 | 67 | | |
67 | 68 | | |
| 69 | + | |
68 | 70 | | |
69 | 71 | | |
70 | 72 | | |
| |||
87 | 89 | | |
88 | 90 | | |
89 | 91 | | |
| 92 | + | |
90 | 93 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
| 39 | + | |
39 | 40 | | |
40 | 41 | | |
41 | 42 | | |
| |||
66 | 67 | | |
67 | 68 | | |
68 | 69 | | |
| 70 | + | |
69 | 71 | | |
70 | 72 | | |
71 | 73 | | |
| |||
86 | 88 | | |
87 | 89 | | |
88 | 90 | | |
| 91 | + | |
89 | 92 | | |
90 | 93 | | |
91 | 94 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
70 | 70 | | |
71 | 71 | | |
72 | 72 | | |
| 73 | + | |
73 | 74 | | |
74 | 75 | | |
75 | 76 | | |
| |||
123 | 124 | | |
124 | 125 | | |
125 | 126 | | |
| 127 | + | |
126 | 128 | | |
127 | 129 | | |
128 | 130 | | |
| |||
162 | 164 | | |
163 | 165 | | |
164 | 166 | | |
| 167 | + | |
165 | 168 | | |
166 | 169 | | |
167 | 170 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
| 39 | + | |
39 | 40 | | |
40 | 41 | | |
41 | 42 | | |
| |||
64 | 65 | | |
65 | 66 | | |
66 | 67 | | |
| 68 | + | |
67 | 69 | | |
68 | 70 | | |
69 | 71 | | |
| |||
88 | 90 | | |
89 | 91 | | |
90 | 92 | | |
| 93 | + | |
91 | 94 | | |
92 | 95 | | |
93 | 96 | | |
| |||
Lines changed: 7 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
39 | 39 | | |
40 | 40 | | |
41 | 41 | | |
| 42 | + | |
42 | 43 | | |
43 | 44 | | |
44 | 45 | | |
| |||
68 | 69 | | |
69 | 70 | | |
70 | 71 | | |
| 72 | + | |
71 | 73 | | |
72 | 74 | | |
73 | 75 | | |
| |||
84 | 86 | | |
85 | 87 | | |
86 | 88 | | |
| 89 | + | |
87 | 90 | | |
88 | 91 | | |
89 | 92 | | |
| |||
121 | 124 | | |
122 | 125 | | |
123 | 126 | | |
| 127 | + | |
124 | 128 | | |
125 | 129 | | |
126 | 130 | | |
| |||
167 | 171 | | |
168 | 172 | | |
169 | 173 | | |
| 174 | + | |
170 | 175 | | |
171 | 176 | | |
172 | 177 | | |
| |||
190 | 195 | | |
191 | 196 | | |
192 | 197 | | |
| 198 | + | |
193 | 199 | | |
194 | 200 | | |
195 | 201 | | |
| |||
211 | 217 | | |
212 | 218 | | |
213 | 219 | | |
| 220 | + | |
214 | 221 | | |
215 | 222 | | |
216 | 223 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
| 39 | + | |
39 | 40 | | |
40 | 41 | | |
41 | 42 | | |
| |||
66 | 67 | | |
67 | 68 | | |
68 | 69 | | |
| 70 | + | |
69 | 71 | | |
70 | 72 | | |
71 | 73 | | |
| |||
82 | 84 | | |
83 | 85 | | |
84 | 86 | | |
| 87 | + | |
85 | 88 | | |
86 | 89 | | |
87 | 90 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
46 | 46 | | |
47 | 47 | | |
48 | 48 | | |
| 49 | + | |
49 | 50 | | |
50 | 51 | | |
51 | 52 | | |
| |||
95 | 96 | | |
96 | 97 | | |
97 | 98 | | |
| 99 | + | |
98 | 100 | | |
99 | 101 | | |
100 | 102 | | |
| |||
116 | 118 | | |
117 | 119 | | |
118 | 120 | | |
| 121 | + | |
119 | 122 | | |
120 | 123 | | |
121 | 124 | | |
| |||
200 | 203 | | |
201 | 204 | | |
202 | 205 | | |
| 206 | + | |
203 | 207 | | |
0 commit comments