RRemoteville
Cars Commerce logoCars Commerce

Sr. Data Engineer

Skills
APIData EngineeringAmazon Web ServicesAnalyticsApache KafkaApache SparkBig Data
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • Ability to develop Spark jobs to cleanse enrich process large amounts of data
  • Ability to develop jobs to read from various source systems such as kafka databases APIs files etc
  • Experience with tuning Spark jobs for efficient performance
  • Sound understanding of various file formats and compression techniques
  • Experience with source code management systems such as Github and developing CI CD pipelines with tools such as Jenkins for data
  • Ability to understand deeply the entire architecture for a major part of the business
  • Ability to mentor developers and lead projects of medium to high complexity
  • Excellent communication and collaboration skills

Nice to have

  • Experience with developing REST APIs
  • Experience in deploying ML models into production
  • Experience with machine learning deep learning
  • Experience with developing real-time data analytics

Day to day

  • Build data pipelines and deriving insights out of the data using advanced analytic techniques streaming and machine learning at scale
  • Work within a dynamic forward thinking team environment where you will design develop and maintain mission-critical highly visible Big Data and Machine Learning applications
  • Build deploy and support data pipelines and ML models into production
  • Work in close partnership with other Engineering teams including Data Science & cross-functional teams such as Product Management & Product Design
  • Mentor others on the team and share your knowledge across the Cars.com organization