Data Engineer II

Skills
Computer ScienceApache SparkAzure DatabricksData ArchitectureData ModelingData WarehousingDatabase Design
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

  • B.S. in Computer Science or equivalent
  • 2-3 years' experience in data engineering and big data
  • 1 year of working directly with clients and external stakeholders
  • Extensive knowledge of data warehousing concepts
  • Hands-on experience deploying pipelines using Databricks and/or Spark a MUST
  • Writing and debugging Python, SQL, and possibly Scala code
  • Basic data modeling and database design skills
  • Knowledge of version control
  • Excellent verbal and written communication skills
  • Databricks certification a plus

Nice to have

  • ambitious
  • collaborative
  • dynamic
  • inclusive
  • passionate
  • excellent communication skills

Day to day

  • Participating in engagements with clients related to data warehousing, ETL development, data integrations, and data modeling.
  • Work effectively and directly with both internal and client and/or partner teams.
  • Support data integration efforts using cloud services. Deliver ETL/ELT pipelines for small-scale projects independently.
  • Apply your skills with Databricks, using Python, and big data streaming to pioneer client technologies and data.

Hiring process

  • Not Provided