What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Strong AWS data engineering experience
- Hands on experience with Spark and dbt
- Experience with AWS Lambda AWS Glue and Lake Formation
- Experience migrating from Amazon Redshift to modern data lake architectures
- Terraform infrastructure provisioning experience
- Ability to troubleshoot complex data pipelines and production issues
Nice to have
- Hands on
- Analytical
- Proactive
- Enterprise focused
Day to day
- Design and build scalable data machine learning and Generative AI solutions on AWS
- Migrate Silver and Gold data layers from legacy Redshift into a modern event-driven data lake
- Troubleshoot dbt pipelines Spark jobs and release issues during development and testing
- Support governance permissions and access control in a hub and spoke AWS architecture