Senior Data Engineer
Skills
Computer ScienceData EngineeringAmazon Web ServicesData PipelinesData ProcessingData QualityData Science
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Degree in Computer Science Data Science or a related field with equivalent experience
- 5+ years of experience as a Data Engineer with a proven track record in building complex data pipelines within an AWS environment
- Experience with IaC tools to deploy and maintain infrastructure such as Pulumi or Terraform
- Some knowledge of machine learning concepts and familiarity with common ML algorithms
- Experience with CI/CD tools like CircleCI Github CI/CD and containerization technologies such as Docker or ECS
- Experience with cloud platforms like AWS Azure or GCP
- Strong programming skills particularly in Python or SQL
- Excellent communication and participation skills
- Ability to work independently and manage multiple priorities effectively
Nice to have
- Strong tailwinds in the pet and travel industry
- Supportive culture
- Collaborative environment
Day to day
- Design build and maintain scalable secure and reliable data pipelines for general data processing and analytics needs
- Implement CI/CD pipelines for data processing workflows
- Ensure data quality and consistency throughout the entire data processing lifecycle
- Develop and implement monitoring and logging solutions to track data pipeline health
- Advocate for data governance best practices and ensure compliance with relevant regulations
Hiring process
- Submit an application with your pronouns if desired
- Equal opportunity interview process
- Employment offers based on merit