Senior Data Engineer
Skills
ArtifactsContextData SystemsDatabasesDownstream Oil And GasECSSchemas
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 4+ years of data engineering experience
- Strong Python skills with real-world parsers validators and transformation scripts
- Schema design instincts for downstream use
- Data quality mindset with validation and completeness checks
- Cross-functional collaboration with non-engineers
- Provisioning and monitoring of data infrastructure
- Familiarity with IaC tools such as Terraform and Terragrunt
- Experience with ECS EKS lambdas and S3 buckets
- Bachelor's or Master's degree in CS or equivalent experience
Nice to have
- Education background
- Curriculum design background
- Ed-tech experience
- Vector database experience
- Embedding pipeline tooling
- Agentic AI familiarity
- MCP familiarity
Day to day
- Design and own curriculum content schemas and data models for downstream AI use
- Build ingestion pipelines that process inconsistent source formats including XML JSON PDF-derived and API-delivered content
- Develop Python parsers transformers and validation scripts that enforce schema conformance and content quality at scale
- Collaborate with Instructional Designers product teams and AI engineers to translate workflows into robust data infrastructure
- Build and maintain embedding and vector database pipelines that power AI-assisted content features as the system scales
- Work in Git-based workflows with versioned reviewed and documented data artifacts
