Senior Data Engineer
Skills
Apache SparkAzure DatabricksBAUBusiness IntelligenceData AnalyticsData ScienceDelivery Of Projects
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Experience as a Data Engineer
- Databricks
- Apache Spark
- Python
- BitBucket or GitHub
- Strong data modelling experience
- ETL process experience
- Ability to work independently and self-motivate
- Strong communication skills with stakeholders
- Ability to troubleshoot and resolve issues quickly
Nice to have
- Delivery-focused
- Self-motivated
- Collaborative
- Detail-oriented
- Continuous improver
Day to day
- Design, build, and maintain robust data solutions across mission-critical cloud platforms, with a strong focus on Databricks on AWS, SQL, Power BI, and related technologies.
- Own the delivery of projects and BAU support, resolving faults swiftly, monitoring background processes, and improving data quality across the environment.
- Work closely with stakeholders, project managers, and product owners to communicate progress, present solutions, reduce technical debt, and continuously improve technical best practice.