Lead Data Engineer

Skills
DevopsApache SparkBusiness RequirementsData AnalyticsData PipelinesData ScienceData Services
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • Extensive experience with Azure Data Services Spark and Python
  • Proven expertise in SQL including T-SQL and integration technologies like SSIS and Azure Data Factory
  • Ability to lead teams and prioritize technical deliveries alongside business requirements
  • Experience with data visualization tools such as Tableau and Power BI.

Nice to have

  • DevOps
  • Apache Spark
  • Data Visualization

Day to day

  • Develop and maintain data solutions using Azure Data Platform
  • Collaborate with team members and Product Owners to produce high-quality data solutions
  • Support migration of legacy solutions and drive the adoption of standardized data methodologies
  • Act as a technical lead for releases prioritizing quality and continuous improvement.