Freelance Data Engineer
Skills
AirflowCreativeData ModelingData QualityData StandardsGoogle BigquerySnowflake
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Enterprise-level data modeling experience
- Proficiency in SQL, including multi-table joins, window functions, indexing strategies
- Experience with Python for data ingestion via REST APIs
- Experience with AWS Services including Lambda functions, EC2/ECS instances, S3, SQS, DynamoDB Tables, MWAA
- Experience with Apache Airflow for developing and deploying data pipelines
- Experience with Snowflake, including storage integrations, external stages, data shares, snowpipes, RBAC, using Snowpark API
- Ability to work independently with minimal supervision
- Strong communication skills for escalating issues
- Strong team player willing to learn new skills
- Experience working with complex data sets
Nice to have
- DevOps experience
- Event tracking configuration in Google GA4 and analysis using BigQuery
- Data migration project refactoring and optimizing complex SQL logic
- Experience with financial data
- Experience using The Motley Fool's service offerings
Day to day
- Responsible for expanding and optimizing data, data pipeline architecture, data flow, and collection for cross-functional teams
- Guide and support software developers, database architects, data analysts, and data scientists on business initiatives, ensuring optimal data delivery architecture
- Self-directed and comfortable supporting data needs of multiple teams, systems, and products