Senior Data Engineer
Skills
Cloud ComputingAmazon Web ServicesApacheApache SparkFunctional ProgrammingGoogle Cloud PlatformGraphic Design Principles
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Deep knowledge of at least one cloud platform such as AWS Azure or GCP
- Hands-on experience building production-grade data pipelines with Apache Spark and or Databricks
- Experience with scalable streaming and batch data solutions using cloud-native components
- Strong Python skills or Scala proficiency with object-oriented and functional programming principles
- Experience building pipelines with CI CD capabilities
- Ability to identify debug and optimize slow-running data pipelines
- Experience migrating legacy Hadoop or data warehouse applications to the cloud is a plus
- Databricks certifications and lakehouse architecture knowledge are highly desirable
- Strong consulting skills with customer focus and clear communication
Nice to have
- Customer focused
- Highly motivated
- Creative problem solver
- Resourceful under pressure
- Confident presenter
- Proactive communicator
Day to day
- Work directly with enterprise customers on large-scale Data & AI projects and translate business needs into robust technical solutions.
- Mentor junior consultants while contributing to thought leadership across data modeling data governance data integration and data transformation.
- Design scalable architectures reusable frameworks and accelerators that improve standardization speed and delivery quality across migration and modernization work.
Hiring process
- Apply online