• Design, build and
operationalize large scale enterprise data solutions and applications using one
or more of AWS data and analytics services with AWS DMS, Glue and Redshift.
• Design and build
production data pipelines from ingestion to consumption within along with AWS
Glue using Python (PySpark Package). Furthermore, able to create Glue workflows
to orchestrate the entire ETL flow all the way up to Redshift.
• Design and
implement data engineering, ingestion and curation functions on AWS Lambda
using Python.
• Ability to setup
table mapping and task setting rules using JSON in AWS DMS.
• Setup exception
controls using AWS SNS which help notify developers to look at specific
resource.
• Ability to setup SQS to handle large
number of messages from different AWS native services and communicate with
other services with messages