Data Engineer

Skills
AirflowApache ImpalaApache KafkaCloud FirestoreGitHelmKubernetes
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • Degree in a scientific or quantitative field required.
  • Proven experience with Python, Airflow, Terraform, Git, GitLab (including CI/CD pipelines), and GCP (especially Kubernetes and Helm).
  • Proficiency in SQL and capacity to work with complex data structures and large data volumes.
  • Independent, responsible, proactive, and detail-oriented personality.

Nice to have

  • Experience with NoSQL databases
  • Experience with Kafka, Pub/Sub, Grafana
  • Knowledge of sports betting and Casino data

Day to day

  • Design and develop robust data infrastructure for Data Science projects.
  • Maintain existing data infrastructure like Airflow instances and Kubernetes clusters.
  • Collaborate with data scientists on technical aspects of project designs.

Hiring process

  • Conversational interviews
  • Encouragement for questions during the interview
  • Early application recommended