Data Engineer
Skills
Cloud ComputingJavascriptAnalytical SkillsData AnalyticsData PipelinesExtractTransform
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Solid experience as a Data Engineer building data pipelines
- Strong SQL skills with large and complex datasets
- Proficiency in Python and PySpark for ETL and data processing
- Experience with cloud-based data platforms
- Experience with distributed data processing
Nice to have
- Innovative
- Collaborative
- Detail-oriented
- Analytical
Day to day
- Collaborate with Subject Matter Experts to design and develop data models and ontologies
- Build and maintain robust data pipelines and ETL processes that support reliable data movement
- Develop cloud-based storage and processing solutions that are scalable secure and high-performing
- Partner with analysts and data scientists to deliver high-quality data solutions and improve availability
- Monitor troubleshoot and optimize pipelines to ensure continuous data integrity and dependable workflows