Data Engineer
Skills
Azure Data FactoryData EngineeringRelational DatabasesAzure DatabricksAzure Logic AppsBig DataCatalogue Design
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Experienced with Databricks including Unity Catalogue and cluster administration
- Proficient in SQL for complex query writing and relational databases
- Skilled in Python and familiar with DevOps practices including Terraform and Azure DevOps for CI/CD.
Nice to have
- Microsoft Azure
- Microsoft Fabric
- Application Platform Services
Day to day
- Provide technical leadership in big data projects
- Design and develop Databricks solutions
- Administrate Databricks environments and manage ETL/ELT workstreams
- Stay informed on emerging data engineering technologies.