Data Engineer
Skills
AWS Cloud MigrationAmazon Web ServicesDatabricksPythonPySparkSpark SQL
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 5+ years of experience in Data Engineering
- 3+ years of hands-on experience with Databricks
- Strong experience with AWS Cloud services
- Proficiency in Python PySpark and Spark SQL
- Experience building ETL/ELT pipelines using Databricks
Day to day
- Design and develop scalable data engineering solutions using Databricks and AWS cloud services.
- Build and optimize ETL/ELT pipelines for large datasets with strong performance and reliability.
- Implement cloud-native data solutions leveraging Python PySpark and Spark SQL.