Data Engineer

Skills
Amazon Web ServicesAnalyticsDBEData AnalyticsECSEnglish As A Second LanguageEnhanced Data Rates For GSM Evolution
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • 6+ years of data engineering experience
  • Python and Django at production scale
  • Postgres at production scale
  • Solid ELT ETL design including idempotency late arriving data and replayability
  • Comfort with Redis and RabbitMQ in production
  • AWS native experience with RDS S3 ECS Fargate IAM and CloudWatch

Nice to have

  • Government open data integration experience
  • Mapbox or Deck.GL experience
  • Geocoding experience
  • Entity resolution experience
  • Fuzzy matching at scale

Day to day

  • Own the daily directory pipeline for certified MWBE DBE SDVOB and LBE sources
  • Build idempotent ingest normalize diff and snapshot workflows so each project reflects the directory state on the search date
  • Operate Postgres analytics and messaging systems to support search reports reingestion recompute and data quality checks

Hiring process

  • Send a résumé and a few sentences about a project you’re proud of
  • Apply by email
  • Reply within one business day