Data Engineer
Skills
Computer ScienceComplex SystemsDatabasesGlueJava DevelopmentORCOptimization
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Bachelor's degree in Computer Science Engineering or a related technical field
- 4+ years of professional experience in data engineering or related domains
- Hands-on experience with Databricks Apache Spark Python SQL PostgreSQL and dbt
- Experience designing and maintaining AWS-native data platforms using Glue EMR MWAA Lambda Step Functions S3 Redshift RDS DMS and CloudWatch
- Experience developing scalable data pipelines workflow orchestration and data integration solutions
- Experience with Apache Iceberg and data formats such as Parquet ORC and Avro
- Experience with relational and NoSQL databases including PostgreSQL Redshift Oracle GraphDB and other NoSQL platforms
- Experience building reliable high-performance data platforms through tuning optimization and enterprise-scale ETL/ELT architectures
- Java development and modern CI/CD practices using Harness
- Strong analytical and problem-solving skills
- Experience working in agile iterative software development environments
- Ability to quickly learn and apply new technologies and domain knowledge
- Excellent written and verbal communication skills
Nice to have
- Strategic
- Collaborative
- Proactive
- Adaptable
- Communicative
Day to day
- Design, build, and maintain scalable data pipelines and ETL/ELT workflows using Python Spark Databricks dbt SQL and AWS Glue
- Develop high-performance AWS-native data platforms and orchestration workflows across Glue EMR MWAA Lambda Step Functions S3 Redshift RDS DMS and CloudWatch
- Modernize legacy data systems and collaborate with cross-functional teams to deliver secure compliant mission-critical analytics solutions in an Agile environment
