RRemoteville
SailPoint logoSailPoint

Senior Data Engineer

Skills
Data EngineeringSQLAirflowAmazon Web ServicesExtractTransformLoad
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • 5+ years of Data Engineering experience
  • Hands-on experience with containerization platforms such as Docker and container orchestration tools like Kubernetes
  • Hands on experience with automation tools like Jenkins and Terraform
  • Proficiency in Python programming, SQL and performance tuning of queries, and AWS service stack
  • Familiarity with workflow orchestration tools such as Airflow
  • Comfortable working in ambiguous team-situations, showcasing adaptability and drive in solving novel problems in the data-engineering space

Day to day

  • Develop and maintain scalable data pipelines for both streaming and batch processing
  • Collaborate with cross-functional teams to understand diverse data sources and environment contexts, ensuring seamless integration into our data ecosystem
  • Utilize AWS service-stack wherever possible to implement lean design solutions for data storage, data integration, and data streaming problems
  • Stay abreast of emerging technologies in the data engineering space, proactively incorporating them into our ETL processes