Data Engineer
Skills
Data EngineeringETL ToolsApache SparkData AnalyticsData CleaningData ScienceData Warehousing
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Experience with Python SQL Data Warehousing
- Knowledge in ETL Databricks Druid
- Familiarity with Azure Machine Learning Distributed Systems (Spark Hadoop)
- Competencies in data optimization tuning and performance
- Software Development and Delivery skills.
Nice to have
- Azure
- Machine Learning
- Spark
- Hadoop
Day to day
- Design and develop data pipeline and storage solutions for the Corvidae project.
- Implement and manage end-to-end data delivery processes.
- Set up and maintain cloud-based data processing infrastructure including storage and compute resources.
Hiring process
- Prescreen
- Online technical assessment
- Interview with Hiring Manager
- Technical interview
- HR Interview