Data Engineer
Skills
Cloud ComputingJavaApacheApache SparkArchitectureArtificial IntelligenceBusiness
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 8+ years in data engineering or related field
- Hands-on experience with Java Scala and Apache Spark
- Experience with Apache Kafka and Amazon Firehose
- Experience with AWS Lambda AWS Glue and Amazon EMR
- Expertise in Apache Airflow workflow orchestration
- Strong knowledge of data lake and cloud data warehouse architectures
- Experience with CI/CD tools such as Maven Stash Bamboo and GitLab
- Experience designing enterprise-scale cloud data platforms
- Background in AI or machine learning data pipelines preferred
Nice to have
- Cloud-native mindset
- AI-focused
- Collaborative
- Detail-oriented
- Performance-driven
Day to day
- Design and build scalable cloud-native data pipelines for ingesting processing and securing enterprise data
- Support data lake cloud warehouse and downstream mart architectures that power analytics and AI initiatives
- Work with distributed processing frameworks streaming systems and orchestration tools to improve performance reliability and deployment
- Contribute to design reviews testing validation certification and CI/CD practices across the full development lifecycle