Senior Staff Data Engineer
Skills
Computer ScienceAmdocs CRMApache SparkConfiguration ManagementContinuous ImprovementData AnalyticsData Warehousing
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 12+ years of software engineering experience in Python or Java preferably JDK17+
- 7+ years designing building and managing data pipelines using Spark BigQuery AWS EMR and GCP Cloud Analytics
- 7+ years of experience crafting REST API based microservices and scalable products using cloud platforms ideally AWS
- Experience with cloud data warehouse and analytics platforms such as Snowflake and BigQuery
- Experience with observability tools such as Prometheus Grafana and ELK stack
- Experience with data pipeline expectations frameworks such as Monte Carlo Great Expectations or Soda
- Experience working with containers such as Docker and Kubernetes
- Experience with messaging platforms and stream data processing such as Kafka Flink or Pub/Sub
- Strong understanding of engineering software processes lifecycle methodology configuration management release management and system verification and testing
- Bachelor’s Degree in Computer Science Mathematics or a similar field
- Must have legal right to work in the U.S.
Nice to have
- Strong ownership
- Meticulous attention to detail
- Continuous improvement mindset
- Independent worker
- Strong analytical thinking
Day to day
- Design and build high-performance reporting APIs and scalable data pipelines.
- Lead architecture discussions and planning for ad measurement revenue and addressability data.
- Collaborate across engineering product operations and cloud teams to deliver reliable deployments and maintain production support.