RRemoteville

How Remoteville checks and expires listings

Hack The Box logoHack The Box

Senior Data Engineer

Skills
Software As A ServiceApache BeamApache SparkData ServicesDriftModelingMusic Composition
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • Strong data modelling and warehouse architecture skills
  • Hands-on experience with GCP data services
  • Production experience with streaming pipelines using Dataflow Beam Flink or Spark Structured Streaming
  • Solid SQL and strong Python
  • Experience with ClickHouse or another columnar OLAP engine
  • Workflow orchestration experience with Airflow or similar
  • Comfortable with dbt or equivalent transformation frameworks
  • Experience migrating off legacy warehouses to cloud-native stacks is a plus
  • Working knowledge of ML in production
  • Docker and Kubernetes experience
  • CI/CD mindset and infrastructure-as-code sensibility
  • Bonus: CDC tooling and Vertex AI or Feature Store

Nice to have

  • Opinionated about clean architecture
  • Allergic to over-engineering
  • Comfortable owning systems end-to-end
  • Bias for simple observable systems

Day to day

  • Own and evolve data pipelines on GCP, improving reliability data quality and accessibility across the organisation
  • Design and build streaming and batch data workflows using BigQuery ClickHouse Pub/Sub Kafka Dataflow and Airflow
  • Partner with ML engineers to build feature pipelines monitor drift and support training and low-latency inference

Hiring process

  • Submit your application
  • Meet Talent Acquisition team
  • Meet the hiring team
  • Complete 2 assignments and debrief
  • Final conversation with senior leadership
  • Receive and accept offer