How Remoteville checks and expires listings
Data Engineer II
Skills
Computer ScienceData EngineeringAirflowApache SparkData AnalyticsData ArchitectureData Modeling
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Minimum of 3 years of experience working with high volume data infrastructure.
- Experience with cloud platforms like Databricks and AWS, or a cloud framework like dbt.
- Experience with job orchestration tooling like Airflow.
- Proficiency in programming in either Python or Java.
- Proficiency with SQL and ability to optimize queries.
- Experience in data modeling and database design.
- Experience with large-scale data processing using Spark and/or Presto/Trino.
- Experience with ads-related data systems like Google Ad Manager, Adbutler, Kevel, Acxiom, Fantix, LiveRamp.
- Experience in modern development lifecycle including Agile methodology, CI/CD, automated deployments using Terraform, GitHub Actions.
- Knowledge of the latest open source, data frameworks, and modern data platform tech stacks and tools.
- Good communication skills and ability to work independently.
- BS in Computer Science, Software Engineering, Mathematics, or equivalent experience.
Nice to have
- Always learning
- Highly collaborative
- Open-minded
Day to day
- Enhance and maintain data processing and storage pipelines/workflows for a robust and secure data lake.
- Take ownership of our data systems to make them world class.
- Collaborate with ads analytics teams and apply best practices.
