feat: Use Lift in aws-sqs-python-worker

Author: pgrzesik

aws-python-sqs-worker/README.md

@@ -16,7 +16,7 @@ This template demonstrates how to develop and deploy a simple SQS-based producer
 
 ## Anatomy of the template
 
-This template defines two functions, `producer` and `consumer`. First of them, `producer`, is triggered by `http` event type, accepts JSON payload and sends it to a corresponding SQS queue for further processing. To learn more about `http` event configuration options, please refer to [http event docs](https://www.serverless.com/framework/docs/providers/aws/events/apigateway/). Second function, `consumer`, is responsible for processing messages from SQS queue thanks to its `sqs` trigger definition. To learn more about `sqs` event configuration options, please refer to [sqs event docs](https://www.serverless.com/framework/docs/providers/aws/events/sqs/). Additionally, the template takes care of provisioning underlying SQS queue along with corresponding SQS dead-letter queue, which are defined in `resources` section. The dead-letter queue is defined in order to prevent processing invalid messages over and over. In our case, if message is delivered to the source queue more than 5 times, it will be moved to dead-letter queue. For more details, please refer to official [AWS documentation](https://docs.aws.amazon.com/lambda/latest/dg/with-sqs.html). To learn more about `resources`, please refer to [our docs](https://www.serverless.com/framework/docs/providers/aws/guide/resources/).
+This template defines one function `producer` and one Lift construct - `jobs`. Producer function is triggered by `http` event type, accepts JSON payload and sends it to a corresponding SQS queue for further processing. To learn more about `http` event configuration options, please refer to [http event docs](https://www.serverless.com/framework/docs/providers/aws/events/apigateway/). Jobs construct is responsible for two things. It creates SQS queue along with corresponding "dead-letter queue" and defines `worker` function that is responsible for processing events from created SQS queue. For more details about `queue` construct type and Serverless Lift plugin in general, please refer to [docs](https://github.com/getlift/lift/blob/master/docs/queue.md). For more details about SQS processing with AWS Lambda, please refer to official [AWS documentation](https://docs.aws.amazon.com/lambda/latest/dg/with-sqs.html). 
 
 ## Usage
 
@@ -38,7 +38,7 @@ serverless deploy
 
 After running deploy, you should see output similar to:
 
-```bash
+``` bash
 Serverless: Packaging service...
 Serverless: Excluding development dependencies...
 Serverless: Creating Stack...
@@ -47,7 +47,7 @@ Serverless: Checking Stack create progress...
 Serverless: Stack create finished...
 Serverless: Uploading CloudFormation file to S3...
 Serverless: Uploading artifacts...
-Serverless: Uploading service aws-python-sqs-worker.zip file to S3 (1.04 KB)...
+Serverless: Uploading service aws-python-sqs-worker.zip file to S3 (21.44 MB)...
 Serverless: Validating template...
 Serverless: Updating Stack...
 Serverless: Checking Stack update progress...
@@ -62,12 +62,14 @@ resources: 17
 api keys:
   None
 endpoints:
-  POST - https://xxxxxxx.execute-api.us-east-1.amazonaws.com/dev/produce
+  POST - https://xxx.execute-api.us-east-1.amazonaws.com/dev/produce
 functions:
   producer: aws-python-sqs-worker-dev-producer
-  consumer: aws-python-sqs-worker-dev-consumer
+  jobsWorker: aws-python-sqs-worker-dev-jobsWorker
 layers:
   None
+jobs:
+  queueUrl: https://sqs.us-east-1.amazonaws.com/xxxx/aws-python-sqs-worker-dev-jobs
 ```
 
 _Note_: In current form, after deployment, your API is public and can be invoked by anyone. For production deployments, you might want to configure an authorizer. For details on how to do that, refer to [http event docs](https://www.serverless.com/framework/docs/providers/aws/events/apigateway/).

aws-python-sqs-worker/package.json

@@ -3,5 +3,8 @@
   "version": "1.0.0",
   "description": "Serverless Framework Python SQS Producer-Consumer on AWS",
   "author": "",
-  "license": "MIT"
+  "license": "MIT",
+  "dependencies": {
+    "serverless-lift": "^1.1.2"
+  }
 }

aws-python-sqs-worker/serverless.yml

@@ -8,14 +8,12 @@ provider:
   runtime: python3.8
   lambdaHashingVersion: '20201221'
   stage: dev
-  iam:
-    role:
-      statements:
-        - Effect: Allow
-          Action:
-            - sqs:SendMessage
-          Resource:
-            - Fn::GetAtt: [ WorkerQueue, Arn ]
+
+constructs:
+  jobs:
+    type: queue
+    worker:
+      handler: handler.consumer
 
 functions:
   producer:
@@ -25,32 +23,7 @@ functions:
           method: post
           path: produce
     environment:
-      QUEUE_URL:
-        Ref: WorkerQueue
-
-  consumer:
-    handler: handler.consumer
-    events:
-      - sqs:
-          batchSize: 1
-          arn:
-            Fn::GetAtt:
-              - WorkerQueue
-              - Arn
+      QUEUE_URL: ${construct:jobs.queueUrl}
 
-resources:
-  Resources:
-    WorkerQueue:
-      Type: AWS::SQS::Queue
-      Properties:
-        QueueName: workerQueue-${self:provider.stage}
-        RedrivePolicy:
-          deadLetterTargetArn:
-            Fn::GetAtt:
-              - WorkerDLQ
-              - Arn
-          maxReceiveCount: 5
-    WorkerDLQ:
-      Type: AWS::SQS::Queue
-      Properties:
-        QueueName: workerDlq-${self:provider.stage}
+plugins:
+  - serverless-lift