Data Engineer
Skills
DevopsETL ToolsMicrosoft AzureData EngineeringDatabricksDomain Name SystemMicrosoft Endpoint Configuration Manager
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 5 years data engineering ETL ELT and integration development experience with complex data pipelines
- 3 years Azure cloud development and administration with Databricks Synapse Link and AIS focus
- 3 years networking experience including DNS VPN Private Endpoint and Service Endpoint configuration
- 1 years practical experience using Application Insights and Log Analytics in Azure solutions
- Experience with IaC and ClickOps deployment methodologies
- Strong communication skills and stakeholder collaboration
- Ability to mentor developers on security performance and connectivity best practices
- Willingness to learn wider Azure SQL administration and support DBA cover
Nice to have
- self-directed
- detail-oriented
- collaborative
- professional
- proactive
Day to day
- Build, maintain and secure Azure data platform components with a strong focus on Databricks Synapse Link and AIS resources
- Develop complex performant data pipelines across on-premises and Azure endpoints using multiple data formats and delivery mechanisms
- Support monitoring troubleshooting and optimisation using Application Insights Log Analytics and KQL while collaborating with developers DBA and stakeholders