Principal Data Platform Engineer

Skills
Cloud ComputingAmazon Web ServicesCode ReviewEngineeringExtractTransformLoad
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • 7+ years of experience in data engineering with progression into technical leadership and architecture ownership
  • Deep expertise in Databricks and modern lakehouse architectures including Delta Lake and Spark-based processing
  • Advanced proficiency in SQL and Python with experience building and optimizing large-scale data pipelines
  • Hands-on experience with cloud platforms such as AWS Azure or GCP including data services and infrastructure design
  • Strong understanding of data modeling concepts ETL ELT patterns and distributed data processing
  • Experience with orchestration tools such as Airflow and transformation frameworks such as dbt
  • Proven ability to lead technical delivery while remaining hands-on when needed
  • Strong client-facing experience including requirements gathering solution design and executive communication
  • Ability to navigate ambiguity prioritize effectively and drive clarity in complex environments
  • Healthcare data experience such as Epic HL7 FHIR or claims data is strongly preferred
  • Experience with CI/CD DevOps practices and infrastructure-as-code tools is a plus

Nice to have

  • Professional
  • Organized
  • Self-Motivated
  • Highly Adaptable
  • Creative
  • Communication
  • Proactive
  • Team-Oriented

Day to day

  • Own the end-to-end architecture and delivery of scalable data platforms with a strong focus on Databricks and modern cloud ecosystems
  • Lead the design and implementation of data pipelines data models and transformation frameworks that support analytics reporting and advanced use cases
  • Serve as a client-facing technical leader by building trusted stakeholder relationships guiding solution decisions and mentoring delivery teams
  • Translate ambiguous business needs into clear technical architectures delivery plans and best-practice engineering approaches

Hiring process

  • Apply below to connect with our Talent team about immediate openings and future consulting projects