Data Engineer
Skills
Computer ScienceData EngineeringApache SparkBig DataData ScienceExtractTransform
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Minimum 4 years of proven professional experience in the IT industry within the U.S.
- Bachelor's degree in Computer Science or related field.
- Experience with cloud-based Big Data technologies.
- Proficiency in Hive / Spark SQL / SQL.
- Experience with Spark and programming languages like Python Java Scala.
- Ability to independently pursue better technological alternatives.
Nice to have
- AWS
- Python
- Java
- Scala
Day to day
- Analyze system requirements and design responsive algorithms and solutions.
- Use big data and cloud technologies to produce production quality code.
- Engage in performance tuning and scalability engineering.
- Work with team peers and management to identify objectives and set priorities.
- Perform related SDLC engineering activities like sprint planning and estimation.
- Work effectively in small agile teams.
- Provide creative solutions to problems.
- Identify opportunities for improvement and execute.