Skip to content

Conversation

@lahsivjar
Copy link
Contributor

@lahsivjar lahsivjar commented Nov 4, 2022

The PR adds code for benchmarking lambda functions (currently supports go1.x and python3.8 runtimes) with extension layer. The PR uses artillery for load generation and terraform for infra management.

How to run?

  1. cd testing
  2. LAMBDA_RUNTIME=go1.x EC_API_KEY=<ec_api_key> make bench

Sample report

--------------------------------
Summary report @ 06:53:39(+0000)
--------------------------------

http.codes.200: ................................... 500
http.request_rate: ................................ 50/sec
http.requests: .................................... 500
http.response_time:
  min: ............................................ 18
  max: ............................................ 4418
  median: ......................................... 89.1
  p95: ............................................ 4147.4
  p99: ............................................ 4316.6
http.responses: ................................... 500
vusers.completed: ................................. 500
vusers.created: ................................... 500
vusers.created_by_name.get: ....................... 500
vusers.failed: .................................... 0
vusers.session_length:
  min: ............................................ 29.8
  max: ............................................ 4431.3
  median: ......................................... 133
  p95: ............................................ 4231.1
  p99: ............................................ 4316.6
with-coldstart:
  min: ............................................ 3743
  max: ............................................ 4418
  median: ......................................... 3984.7
  p95: ............................................ 4231.1
  p99: ............................................ 4316.6
with-coldstart.codes.200: ......................... 228
without-coldstart:
  min: ............................................ 18
  max: ............................................ 184
  median: ......................................... 56.3
  p95: ............................................ 104.6
  p99: ............................................ 147
without-coldstart.codes.200: ...................... 272

@github-actions github-actions bot added the aws-λ-extension AWS Lambda Extension label Nov 4, 2022
@ghost
Copy link

ghost commented Nov 4, 2022

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2022-11-04T07:47:17.923+0000

  • Duration: 8 min 40 sec

Test stats 🧪

Test Results
Failed 0
Passed 202
Skipped 2
Total 204

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

  • run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@lahsivjar lahsivjar requested review from a team and axw November 4, 2022 04:43
@lahsivjar lahsivjar requested a review from axw November 4, 2022 07:13
Copy link
Member

@axw axw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@lahsivjar lahsivjar merged commit 5ac2037 into elastic:main Nov 4, 2022
@lahsivjar lahsivjar deleted the 1323_benchmarking branch November 4, 2022 16:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

aws-λ-extension AWS Lambda Extension

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants