Senior Data Engineer
Skills
Data EngineeringAirflowData ModelingData ModelsData PipelinesData QualityData Science
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Proven experience as a Data Engineer or Data Quality Engineer in a dynamic setting
- Expertise in SQL and Python
- Experience with Data Bricks or Spark and knowledge of ETL and ELT necessary.
Nice to have
- Automated Testing Frameworks
- Airflow
- Data Modeling Methodologies
- CI/CD automation
- Batch and Streaming data pipelines
Day to day
- Directly engage in the design and construction of advanced data models
- Create and manage APIs and data products to enhance system integration
- Maintain and monitor data pipelines
- Coordinate with business partners and developers to meet project requirements.