How Remoteville checks and expires listings
Senior Data Engineer
Skills
DevopsWarehouse OperationsApache AirflowBusiness IntelligenceData ServicesData WarehousingGlue
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Proven experience in data engineering testing or data QA or ETL validation
- Strong hands-on experience with AWS data services including Redshift Glue and DMS
- Proficiency in Python for test automation and validation
- Experience with Airflow and orchestration testing
- Hands-on experience with dbt and data transformation validation
- Familiarity with CDK for infrastructure validation
- Experience in BI testing in Quicksuite is highly beneficial
- Experience with data quality tools such as PySpark Deequ or similar
- Strong understanding of data warehousing concepts
- Strong understanding of ETL and ELT pipelines
- Strong understanding of data validation techniques including schema reconciliation and anomaly detection
Nice to have
- Detail-oriented
- Collaborative
- Analytical
- Quality-focused
- Proactive
Day to day
- Define and implement end-to-end testing strategies for a modern AWS data platform.
- Develop comprehensive test plans and automated frameworks to validate ingestion transformation and reporting workflows.
- Collaborate with cross-functional teams to review architecture data models and technical documentation while improving data quality and reliability.