Data Engineer
Skills
Amazon Web ServicesAnalyticsApache SparkBronzeBusiness IntelligenceData AnalyticsDownstream Oil And Gas
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Strong commercial experience building production-grade data pipelines using Apache Spark
- Experience delivering modern data platforms using Databricks or an equivalent Spark-based platform
- Strong SQL skills and experience with data modelling
- Good understanding of Lakehouse architecture and Delta Lake
- Experience working with AWS Azure or GCP
- Experience implementing CI/CD version control and deployment automation
- Strong communication skills and experience working with technical and business stakeholders
Nice to have
- Autonomy
- Client-facing
- Collaborative
- Growth mindset
- Detail-oriented
Day to day
- Design and build scalable batch and streaming data pipelines using Spark and Databricks
- Develop modern Lakehouse architectures with Delta Lake and Medallion design principles
- Build robust ingestion frameworks and production-grade data platforms for enterprise clients
- Ensure data quality monitoring observability governance and performance across complex data solutions