How Remoteville checks and expires listings
Data Engineer
Skills
Computer ScienceData EngineeringData AnalyticsData QualityData ScienceDatasetsExtract
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology or related field
- 3+ years of experience designing data solutions, modeling data, and developing ETL/ELT pipelines at large scale
- 3+ years of experience in a programming language (e.g., Python, Java, Scala, Golang)
- Experience in developing large-scale data solutions using cloud platforms (e.g., AWS, Azure, Google Cloud) and big data technologies (e.g., Apache Spark)
- Experience in data cataloging, classification, data quality, metadata management, and data lifecycle
- Experience with SQL and data visualization/analytics tools (e.g., Tableau, Looker Studio)
- Experience with CI/CD pipelines and source control
- Experience with Infrastructure as Code tools like Terraform
- Proficiency in API design and development of RESTful web services or GraphQL
- Working knowledge of containerization technologies like Kubernetes and Docker
- Experience with machine learning techniques and tools is a plus
Nice to have
- Curious
- Empathetic
- Willing to relocate
Day to day
- Design, build, and maintain data pipelines and infrastructure for data science initiatives
- Work closely with data scientists to ensure data accessibility and quality
- Support building solutions using Large Language Models and AI services