Senior Data Engineer

Skills
ArtifactsContextData SystemsDatabasesDownstream Oil And GasECSSchemas
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • 4+ years of data engineering experience
  • Strong Python skills with real-world parsers validators and transformation scripts
  • Schema design instincts for downstream use
  • Data quality mindset with validation and completeness checks
  • Cross-functional collaboration with non-engineers
  • Provisioning and monitoring of data infrastructure
  • Familiarity with IaC tools such as Terraform and Terragrunt
  • Experience with ECS EKS lambdas and S3 buckets
  • Bachelor's or Master's degree in CS or equivalent experience

Nice to have

  • Education background
  • Curriculum design background
  • Ed-tech experience
  • Vector database experience
  • Embedding pipeline tooling
  • Agentic AI familiarity
  • MCP familiarity

Day to day

  • Design and own curriculum content schemas and data models for downstream AI use
  • Build ingestion pipelines that process inconsistent source formats including XML JSON PDF-derived and API-delivered content
  • Develop Python parsers transformers and validation scripts that enforce schema conformance and content quality at scale
  • Collaborate with Instructional Designers product teams and AI engineers to translate workflows into robust data infrastructure
  • Build and maintain embedding and vector database pipelines that power AI-assisted content features as the system scales
  • Work in Git-based workflows with versioned reviewed and documented data artifacts