How Remoteville checks and expires listings
Data Engineer
Skills
SQLAmazon Web ServicesAzure DatabricksChange Data CaptureData PipelinesData TransformationExtract
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Proven experience designing and maintaining reliable data pipelines
- Comfortable working in the cloud with Databricks and AWS
- Strong Python skills for pipelines automation and testing
- Strong SQL skills with PostgreSQL/PostGIS or spatial data
- Experience with Bronze Silver and Gold layer modelling using Python and Spark SQL
- Experience with Lakeflow Spark Declarative Pipelines ETL Delta Unity Catalog Data Quality Medallion Architecture Change Data Capture SCD Types Python Git and GitHub
Nice to have
- Curious about geospatial data
- Clear communicator
- Adaptable
- Learning mindset
Day to day
- Design, build, and maintain scalable data pipelines and platforms that transform large-scale geospatial datasets.
- Automate ETL processes and help deliver a modern medallion architecture with bronze, silver, and gold layers.
- Partner with senior engineers and product teams to create trustworthy, well-governed data products and improve pipeline performance.
