Senior Data Engineer
Skills
ETL ToolsSQLWarehouse OperationsContinuous ImprovementData EngineeringData WarehousingDatabricks
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 8+ years of experience in Data Engineering or a related field
- Strong hands-on experience with Databricks including PySpark Spark SQL Delta Lake Unity Catalog and Lakehouse architecture
- Advanced SQL and Python development skills
- Proven experience building and optimising enterprise-scale data pipelines and ETL ELT solutions
- Strong understanding of data architecture data modelling data warehousing and modern data platform design
- Experience working with cloud platforms preferably AWS
- Experience implementing data governance security controls and role-based access models
- Experience with source control CI/CD and software engineering best practices
- Excellent problem-solving communication and stakeholder management skills
Nice to have
- Mentoring experience
- Leadership experience
- AI/BI exposure
- SaaS background
- Analytical mindset
- Collaborative
Day to day
- Design and maintain scalable data pipelines and products in Databricks using PySpark Spark SQL and Delta Lake
- Build and optimise ETL and ELT processes to ingest transform and curate data from multiple internal and external sources
- Shape enterprise data architecture and governance to deliver secure reliable and trusted self-service access to data
- Partner with stakeholders across the business to translate needs into technical solutions and enable analytics reporting AI and automation
Hiring process
- Apply for this position and tell us about yourself