Data Engineer
Skills
Amazon Web ServicesAnalyticsDBEData AnalyticsECSEnglish As A Second LanguageEnhanced Data Rates For GSM Evolution
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 6+ years of data engineering experience
- Python and Django at production scale
- Postgres at production scale
- Solid ELT ETL design including idempotency late arriving data and replayability
- Comfort with Redis and RabbitMQ in production
- AWS native experience with RDS S3 ECS Fargate IAM and CloudWatch
Nice to have
- Government open data integration experience
- Mapbox or Deck.GL experience
- Geocoding experience
- Entity resolution experience
- Fuzzy matching at scale
Day to day
- Own the daily directory pipeline for certified MWBE DBE SDVOB and LBE sources
- Build idempotent ingest normalize diff and snapshot workflows so each project reflects the directory state on the search date
- Operate Postgres analytics and messaging systems to support search reports reingestion recompute and data quality checks
Hiring process
- Send a résumé and a few sentences about a project you’re proud of
- Apply by email
- Reply within one business day
