RRemoteville
Apollo.io logoApollo.io

Senior Data Engineer

Skills
Computer ScienceData EngineeringCritical ThinkingData ModelingData ModelsData QualityData Warehousing
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • 5+ years experience in data engineering or in data facing role
  • Experience in data modeling, data warehousing, and building ETL pipelines
  • Deep knowledge of data warehousing with an ability to collaborate cross-functionally
  • Bachelor's degree in a quantitative field (Physical/Computer Science, Engineering or Mathematics / Statistics)

Nice to have

  • Experience using the Python data stack
  • Experience deploying and managing data pipelines in the cloud
  • Experience working with technologies like Airflow, Hadoop and Spark
  • Understanding of streaming technologies like Kafka, Spark Streaming

Day to day

  • As a Senior Data Engineer, you will be responsible for maintaining and operating the data warehouse and connecting in Apollo’s data sources.
  • Develop and maintain scalable data pipelines and build new integrations to support continuing increases in data volume and complexity.
  • Implement automated monitoring, alerting, self-healing features while building the consumption pipelines.
  • Implement processes and systems to monitor data quality, ensuring production data is always accurate and available.
  • Write unit/integration tests, contribute to engineering wiki and document work.
  • Define company data models and write jobs to populate data models in our data warehouse.
  • Work closely with all business units and engineering teams to develop a strategy for long-term data platform architecture.