How Remoteville checks and expires listings
Data Engineer
Skills
Azure Data FactoryAzure Data LakeMicrosoft AzureSQLAzure DatabricksData EngineeringDatasets
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Python
- PySpark
- SQL
- Azure Databricks
- Azure Data Factory
- Microsoft Fabric
- Microsoft Purview
- Event-driven ingestion
- SOLID principles
- Async programming
- Mediator pattern
- Factory pattern
- Unit testing
- Integration testing
- Secure ETL design
- Entra IMID/SCIM integration
- APIM
- Platform governance
- Power BI models
- UK Public Sector experience
Nice to have
- Strong stakeholder communication
- Cross-team collaboration
- Analytical mindset
- Solution-focused
- Self-directed
- Ownership
- Proactive
- Adaptable
Day to day
- Build and maintain ETL pipelines and cloud data platform code
- Support ingestion activity and onboard new data sources into the data ecosystem
- Develop scalable Databricks workloads and optimise transformation and performance