How Remoteville checks and expires listings
Lead Data Engineer
Skills
Azure Data FactoryComputer ScienceDevopsWarehouse OperationsApache SparkConsumer TextilesData Warehousing
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Bachelor's degree in Computer Science or related field or equivalent experience
- 8+ years of experience in data warehouse architecture data delivery data modeling ETL tools master data management and automated documented solutions
- 5+ years of experience with Microsoft Cloud Data Platform solutions including Microsoft Fabric OneLake Azure Synapse DevOps Data Factory pipelines and notebooks
- Experience with monitoring and optimization tools such as Azure Monitor Application Insights or Fabric capacity metrics
- Strong experience with medallion architecture modeling
- Strong Python programming and data processing skills including dataframes and Spark
- Strong SQL development and performance optimization skills
- Experience with Microsoft Power BI is a plus
- Strong communicative analytical problem solving and organizational skills
- Ability to mentor team members in cloud technologies
Nice to have
- Technical leadership
- Cross-functional collaboration
- Mentoring mindset
- Analytical thinking
- Problem solving
- Organizational skills
Day to day
- Lead the design and delivery of modern data engineering solutions using Microsoft Fabric and Azure Synapse Analytics.
- Build and optimize data pipelines lakehouse architectures and enterprise data warehousing platforms from blueprint to hypercare support.
- Guide junior engineers and collaborate with cross functional teams to improve data quality governance security performance and service delivery.
