Skip to content

Latest commit

 

History

History
24 lines (21 loc) · 574 Bytes

README.md

File metadata and controls

24 lines (21 loc) · 574 Bytes

Real-time Data Stream Framework

Tutorial of Real-time Data Streaming Architecture Based on AWS Kinesis Firehose & AWS GLue Crawlers

ERD

Execution

  • Dependency Installation
pip install -r */requirements.txt
  • Build:
sam build -u
  • Local Testing:
sam local invoke "StreamingFunction" -e event.json --env-vars channels/variables.json
  • Deploy:
sam deploy --parameter-overrides Environment=dev --stack-name test-stack --confirm-changeset --no-fail-on-empty-changeset --capabilities CAPABILITY_NAMED_IAM