RRemoteville

How Remoteville checks and expires listings

Apollo.io logoApollo.io

Senior Data Engineer

Skills
Computer ScienceData EngineeringCritical ThinkingData ModelingData ModelsData QualityData Warehousing
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • 5+ years experience in data engineering or in data facing role
  • Experience in data modeling, data warehousing, and building ETL pipelines
  • Deep knowledge of data warehousing with an ability to collaborate cross-functionally
  • Bachelor's degree in a quantitative field (Physical/Computer Science, Engineering or Mathematics / Statistics)

Nice to have

  • Experience using the Python data stack
  • Experience deploying and managing data pipelines in the cloud
  • Experience working with technologies like Airflow, Hadoop and Spark
  • Understanding of streaming technologies like Kafka, Spark Streaming

Day to day

  • As a Senior Data Engineer, you will be responsible for maintaining and operating the data warehouse and connecting in Apollo’s data sources.
  • Develop and maintain scalable data pipelines and build new integrations to support continuing increases in data volume and complexity.
  • Implement automated monitoring, alerting, self-healing features while building the consumption pipelines.
  • Implement processes and systems to monitor data quality, ensuring production data is always accurate and available.
  • Write unit/integration tests, contribute to engineering wiki and document work.
  • Define company data models and write jobs to populate data models in our data warehouse.
  • Work closely with all business units and engineering teams to develop a strategy for long-term data platform architecture.