What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Mastery of SQL with cloud-based database experience
- 3+ years delivering data products in modern BI technology or open source data frameworks
- Programming languages experience (e.g. Python, Scala) for data architecture and automation
- Collaboration with data analysts, scientists, business and product managers
- Full continuous delivery pipelines implementation using tools like Git or Jenkins
- Executional capacity in dev/data/security operations, including cloud infrastructure and security management
- Great communication and data modeling skills (e.g. Kimball)
- High degree of self-sufficiency with proven delivery track record in high autonomy environments
Nice to have
- Committed
- Creator
- Connector
- Perfectionist
- Evangelist
- Purpose driven
Day to day
- Collaborate with software engineers and system owners to document data sources and ensure data quality and integrity
- Engineer data pipelines from multiple sources into a single storage solution for reporting and ML products
- Make data architecture and technology decisions with technical and data leadership, establishing selection criteria and evaluating options for future needs
- Implement best practices for data pipelines, including defining and instrumenting metrics for team OKRs
- Mentor and develop data engineering team, driving own development towards data engineering mastery
- Lead initiatives to improve data accuracy, availability, granularity, and robustness