Senior Data Engineer
Skills
Azure Data FactoryMicrosoft AzureAzure DatabricksPysparkMicroservicesScalable Data PlatformHigh Quality Documentation
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Substantial experience in data engineering and Azure data services.
- Strong analytical and problem-solving skills essential.
- In-depth knowledge of engineering best practices and processes.
- Experience in developing data pipelines managing APIs and handling multiple file formats and databases.
Nice to have
- Fabric
- Azure Databricks
Day to day
- Design and develop scalable data platforms using Azure Synapse Analytics Databricks PySpark Python and Microservices.
- Maintain high-quality documentation related to the project development lifecycle.
- Research and integrate new cutting-edge technologies to enhance data platform solutions.
- Develop best practices and innovate continuously by mentoring team members.