Principal Data Platform Engineer
Skills
Cloud ComputingAmazon Web ServicesCode ReviewEngineeringExtractTransformLoad
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 7+ years of experience in data engineering with progression into technical leadership and architecture ownership
- Deep expertise in Databricks and modern lakehouse architectures including Delta Lake and Spark-based processing
- Advanced proficiency in SQL and Python with experience building and optimizing large-scale data pipelines
- Hands-on experience with cloud platforms such as AWS Azure or GCP including data services and infrastructure design
- Strong understanding of data modeling concepts ETL ELT patterns and distributed data processing
- Experience with orchestration tools such as Airflow and transformation frameworks such as dbt
- Proven ability to lead technical delivery while remaining hands-on when needed
- Strong client-facing experience including requirements gathering solution design and executive communication
- Ability to navigate ambiguity prioritize effectively and drive clarity in complex environments
- Healthcare data experience such as Epic HL7 FHIR or claims data is strongly preferred
- Experience with CI/CD DevOps practices and infrastructure-as-code tools is a plus
Nice to have
- Professional
- Organized
- Self-Motivated
- Highly Adaptable
- Creative
- Communication
- Proactive
- Team-Oriented
Day to day
- Own the end-to-end architecture and delivery of scalable data platforms with a strong focus on Databricks and modern cloud ecosystems
- Lead the design and implementation of data pipelines data models and transformation frameworks that support analytics reporting and advanced use cases
- Serve as a client-facing technical leader by building trusted stakeholder relationships guiding solution decisions and mentoring delivery teams
- Translate ambiguous business needs into clear technical architectures delivery plans and best-practice engineering approaches
Hiring process
- Apply below to connect with our Talent team about immediate openings and future consulting projects
