Data Engineer
Skills
Business Intelligence ToolsCloud PlatformsData PipelinesData WarehousingPythonSQLETL
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 5+ years of hands-on experience in cloud data engineering
- Strong proficiency in Python and SQL
- Experience with at least one modern orchestration or transformation framework
- Deep understanding of high-volume API requests token management pagination and error handling
- Proven ability to build data test suites for schemas row counts uniqueness and distribution
- Experience architecting and querying cloud data warehouses
- Familiarity with BI tool integration and migration off third-party visualization platforms
Nice to have
- Collaborative
- Analytical
- Detail-oriented
- Critical thinker
- Cost-conscious
Day to day
- Design and build a centralized cloud data warehouse to create a dependable single source of truth.
- Develop robust ingestion pipelines for structured and unstructured data while handling API constraints, caching, and error recovery.
- Implement automated QA, monitoring, and alerting frameworks to validate data quality and catch anomalies before they affect reporting.