Data Engineer - GCP
Skills
Warehouse OperationsApache AirflowBronzeCloud SecurityData AnalyticsData WarehousingIdentity And Access Management
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Hands-on experience with Google Cloud Platform GCP
- Expertise in BigQuery including partitioning clustering and query optimization
- Proven experience implementing Medallion Data Architecture
- Strong programming skills in Python and PySpark
- Advanced proficiency in SQL including complex joins window functions and performance tuning
- Hands-on experience with Cloud Dataflow
- Experience with Cloud Composer Airflow for orchestration
- Experience working with Google Cloud Storage GCS
- Knowledge of Git and CI/CD practices
- Strong understanding of GCP IAM and cloud security best practices
Nice to have
- Enterprise-scale mindset
- Data governance focus
- Agile teamwork
- Performance oriented
Day to day
- Design and maintain scalable batch and real-time data pipelines on GCP for enterprise use cases
- Implement Medallion Architecture across Bronze Silver and Gold layers to structure and process data efficiently
- Build optimized data transformations and analytical workflows using Python PySpark BigQuery Dataflow and Airflow
- Strengthen data governance security and performance across cloud data solutions while improving reliability and cost efficiency