Data EngineeringSQLAirflowAmazon Web ServicesExtract Transform LoadJenkinsPerformance TuningPythonStackTest Automation Tools
Senior (5-8 years) - Expert (9+ years)
United States
2680+ employees
Security
Role
Who you are
5+ years of Data Engineering experience
Hands-on experience with containerization platforms such as Docker and container orchestration tools like Kubernetes
Hands on experience with automation tools like Jenkins and Terraform
Proficiency in Python programming, SQL and performance tuning of queries, and AWS service stack
Familiarity with workflow orchestration tools such as Airflow
Comfortable working in ambiguous team-situations, showcasing adaptability and drive in solving novel problems in the data-engineering space
What the job involves
Develop and maintain scalable data pipelines for both streaming and batch processing
Collaborate with cross-functional teams to understand diverse data sources and environment contexts, ensuring seamless integration into our data ecosystem
Utilize AWS service-stack wherever possible to implement lean design solutions for data storage, data integration, and data streaming problems
Stay abreast of emerging technologies in the data engineering space, proactively incorporating them into our ETL processes