Senior Staff Data Engineer
Skills
Computer ScienceAmdocs CRMApache SparkConfiguration ManagementContinuous ImprovementData AnalyticsData Warehousing
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 12+ years software engineering experience in Python or Java preferably JDK17+
- 7+ years designing building and managing data pipelines with Spark BigQuery AWS EMR and GCP Cloud Analytics
- 7+ years crafting REST API microservices and scalable products across cloud platforms ideally AWS
- Experience with cloud data warehouse and analytics platforms such as Snowflake and BigQuery
- Experience with observability tools such as Prometheus Grafana and ELK stack
- Experience with data pipeline expectation frameworks such as Monte Carlo Great Expectations or Soda
- Experience working with containers including Docker and Kubernetes
- Experience with messaging platforms and stream data processing such as Kafka Flink and Pub/Sub
- Strong understanding of engineering software processes lifecycle methodology configuration management release management and system verification and testing
- Bachelor’s degree in Computer Science Mathematics or similar field
- Legal right to work in the U.S.
Day to day
- Design and build high-performance reporting APIs and scalable data pipelines for audio advertising data.
- Lead architecture discussions and planning sessions across ad measurement revenue and addressability systems.
- Collaborate closely with engineering Product Global Operations and Cloud Infrastructure teams to deliver reliable deployments support incidents and mentor junior engineers.