RRemoteville
GoGuardian logoGoGuardian

Data Engineer II

Skills
Computer ScienceWarehouse OperationsContinuous ImprovementData AnalyticsData WarehousingECSEvolution
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • Bachelor's degree in Computer Science Engineering or related field
  • 2–4 years building and operating large-scale data systems
  • Proficiency in Python and SQL with experience in PySpark pandas or similar frameworks
  • Experience with DBT
  • Experience with Databricks or similar lakehouse platform
  • Hands-on experience with Airflow Dagster or Prefect
  • Strong understanding of data modeling ETL design and distributed data systems
  • Experience with AWS data and compute services or equivalent cloud platforms
  • Familiarity with MLOps concepts including feature stores model registries and CI/CD for ML
  • Experience with Infrastructure as Code preferably Terraform
  • Excellent problem-solving collaboration and communication skills

Nice to have

  • Curious
  • Collaborative
  • Mission-driven
  • Detail-oriented
  • Adaptable
  • Analytical

Day to day

  • Design and optimize ETL pipelines that support analytics data science and ML workflows using Databricks PySpark and Airflow
  • Build and maintain labeling retraining and MLOps pipelines that improve model quality reproducibility and production observability
  • Collaborate with data scientists and cross functional teams to productionize scale and monitor model training inference and evaluation pipelines
  • Contribute to data lakehouse architecture data modeling governance and performance tuning while documenting lineage and dependencies