RemotevilleRemote Senior Data Engineer Job in London, UK Metapack
Senior Data Engineer Metapack
£ -
AirflowAthenaBig DataData ArchitectureData ModelingDatabasesDatasetsGoogle BigqueryPandasQuery Writing
LondonUK
Effortless ecommerce everywhere
155+ employees
eCommerceLogisticsSoftwareSaaS
Role
Who you are
- A Software Engineering background
- Experience developing and supporting robust, automated and reliable data pipelines in Python and SQL
- Experience with data processing frameworks like Pandas, Polars, dbt or Spark
- Experience with streaming data processing
- AWS, Azure or Google Cloud experience
- Continuous integration/delivery environment experience with a passion for automation
- Knowledge of a data orchestration solution like Airflow, Oozie, Luigi or Prefect
- Knowledge of both relational and non-relational database design and internals
- Knowledge of how to design distributed systems and the trade-offs involved
- Experience working with software engineering best practices for development, including source control systems, automated deployment pipelines like Jenkins and devops tools like Terraform
Desirables
- MLOps know-how
- Fast-learner
- Interest in evaluating new technologies
- Willing to attend conferences, webinars and meet-ups
What the job involves
- Contribute to the design, build and operational management of our data lake and analytics solution on top of proven AWS data technologies like S3, Athena, Lambda, Kinesis and ECS
- Use state of the art technologies like Airflow, dbt and Spark to process data and get our dataset just right
- Develop frameworks and solutions that enable us to acquire, process, monitor and extract value from our massive dataset
- Support the Data Analysts and Data Scientists with automation, tooling, data pipelines and data engineering expertise, enabling them to deliver complex analytics products and machine learning solutions
- Deliver highly reliable software and data pipelines using Software Engineering best practices like automation, version control, continuous integration/continuous delivery, testing, security, etc
- Define, implement and enforce automated data security and data governance best practices within the solutions designed
- Mentor more junior colleagues and receive mentorship by more senior colleagues
Application process
- Salary discussion in first interview
Company
Company mission
Metapack is dedicated to simplifying and enhancing delivery experiences for online retailers and brands worldwide. With our extensive carrier network and cutting-edge API solutions, we empower businesses to efficiently manage deliveries, offering customers convenience and confidence. Through our commitment to innovation, we aim to make eCommerce effortless and accessible, ensuring that every order reaches its destination smoothly and reliably.Company benefits
- Clear compensation
- Tools for the job
- Flexible hybrid working approach
- Central London location
- 25 days holiday plus public holidays increases to max of 30 days based on length of service
- Company Pension up to 4% employee matches
- Life insurance 4x base salary
- Long term income protection 50% base salary up to 5 years
- Private Medical and Dental Insurance available post probation
- Personal Training Budget up to £2000 per year plus LinkedIn Learning available post probation
- Health and Wellbeing benefits such as gym membership and subsidies 24/7 EAP virtual GP appointments subsidised eye care counselling sessions physiotherapy sessions PT nutrition advice financial and legal support extensive resource library
- Tax-Free Childcare
- Cycle to work scheme available post-probation
- Interest-free season ticket loan of up to £7,000 available post-probation
- Referral Bonus up to £3,000
- Postal Services 99% discount on personal shipments
Company values
- Customer focus
- Innovation
- Collaboration
- Efficiency