How Remoteville checks and expires listings
Data Engineer
Skills
Amazon RedshiftAmazon Web ServicesAnalyticsApache SparkDatabasesGlueSnowflake Cloud
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Experience in data engineering with focus on data pipelines analytics and reporting
- Exposure to the AWS Cloud Platform
- Experience in SQL data transformations and troubleshooting across at least one database platform
- Experience designing and building ETL processes with custom data pipelines
- Experience in a scripting language such as Python
- Experience designing and building solutions using AWS services such as EC2 S3 EMR Kinesis RDS Redshift Spectrum Lambda Glue Athena and API Gateway
Nice to have
- Adaptable
- Analytical
- Data-driven
- Collaborative
- Detail-oriented
- Fast learner
Day to day
- Design and build scalable data pipelines and APIs using Python SQL Spark and AWS services
- Translate business needs into technical specifications and detailed functional documents for implementation
- Support cloud deployments configuration and troubleshooting across AWS environments while improving data systems and workflows
- Move data from on-premises systems to cloud platforms and manage cloud data conversions
- Collaborate with partners to plan projects define milestones and deliver data driven solutions
