Data Engineer
Skills
Data EngineeringData ArchitectureData GovernanceData IngestionData ModelsDatabasesExtract
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- At least 2 years of experience as a Data Engineer
- Understanding data warehousing and ETL/ELT processes
- Proficiency in SQL and BigQuery Standard SQL
- Ability to translate requirements into data ingestion pipelines and models
- Familiarity with GCP services, especially BigQuery and Cloud Composer
- Proficiency in Python scripting
- Strong communication and collaboration skills
- Passionate about data and eager to learn new technologies
Nice to have
- Data governance
- Cloud-based workflow orchestration
- Data visualization
Day to day
- Designing and deploying data pipelines on Google Cloud Platform (GCP)
- Crafting and optimizing data models in BigQuery
- Leveraging BigQuery features for data transformation and summarization
- Developing automated checks for data consistency
- Collaborating with cross-functional teams to design data solutions
- Refining data pipelines for peak performance through code reviews
