Data Engineer
Skills
Azure Data FactoryAnalytical SkillsAzure DatabricksBusiness IntelligenceEngineeringEnhanced Data Rates For GSM EvolutionEvent-Driven
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Strong experience with Python PySpark and SQL for data engineering
- Hands-on experience with Azure Databricks
- Strong knowledge of Azure Data Factory and Fabric
- Experience with Microsoft Purview
- Familiarity with event-driven data ingestion such as Event Grid or Pub-Sub
- Understanding of SOLID principles async programming and Mediator or Factory patterns
- Experience delivering unit and integration testing in Databricks
- Knowledge of secure ETL design with Entra IMID or SCIM integration
- Understanding of Azure best practices APIM and platform governance
- Ability to build and serve Power BI models via Databricks data sources
- Prior experience working within UK Public Sector environments
Nice to have
- Strong stakeholder communication
- Cross-team collaboration
- Analytical mindset
- Solution-focused
- Independent
- Ownership-driven
- Proactive
- Adaptable
Day to day
- Build and maintain ETL pipelines in cloud data platforms
- Support ingestion and onboarding of new data sources using Azure services and Databricks
- Develop scalable data flows data models and performance-optimised data products while improving engineering patterns and reusable tooling