Senior Data Engineer - Platform Engineering
Skills
Computer ScienceData EngineeringAmazon Web ServicesData ArchitectureData ModelingData PipelinesQuery Tuning
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Bachelor's degree in Computer Science, Information Technology, or related field
- 8+ years of experience in data engineering
- Extensive experience with AWS cloud platform and data-related services
- Proficiency in automation frameworks (e.g., Terraform, Cloud Formation)
- Proficiency in data lake and pipeline tools (e.g., Databricks, Apache Kafka/Kinesis, AWS Glue)
- Proficiency in one or more programming languages (e.g. Python, Java)
- Strong understanding of SQL (e.g. Redshift, Snowflake, RDS) and NoSQL databases (e.g., DynamoDB)
- Experience with search optimization, including schema design and query tuning
- Experience in building CI/CD pipelines, testing frameworks (e.g. dbt)
- Strong problem-solving skills and proactive approach
- Ability to independently own and execute projects while collaborating with the team
- Strong communication skills and mentoring ability
Day to day
- Play a pivotal role in designing, implementing, and optimizing data services and pipelines
- Collaborate with cross-functional teams to enable operational data analysis, enhance eventing systems, and develop tools to empower data and services teams
- Drive 100% automation, create scalable architectures, and optimize data environments