GCP Data Engineer
Skills
Google BigqueryGoogle Cloud PlatformTerraformCloud DatastreamDataflowPub/SubCloud Storage
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Strong hands-on experience with Google Cloud Platform
- Expertise in BigQuery and real-time data ingestion
- Experience with Terraform or OpenTofu for infrastructure as code
- GitLab CI/CD knowledge
- Strong understanding of data engineering best practices and production support
- Experience with secure GCP networking such as Private Service Connect VPN or Interconnect is highly desirable
Nice to have
- Experienced
- Hands-on
- Scalable
- Production-focused
- Troubleshooting mindset
Day to day
- Build and enhance GCP-based data pipelines for high-volume CDC and real-time ingestion
- Work with Cloud Datastream BigQuery Dataflow Pub/Sub and Cloud Storage to move and transform data
- Develop scalable CDC solutions from SQL Server MySQL and MongoDB into BigQuery while optimising performance and supporting production pipelines
Hiring process
- ASAP start