Principal Software Engineer
Skills
Computer ScienceDevopsAnalytical SkillsDatabasesHeavy EquipmentInternet ExplorerOracle Database
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Minimum 9 years of experience with Data Engineering background and deep understanding of Databricks Architecture Power BI Architecture and Data Lake Architecture
- Minimum 9 years of experience designing developing and supporting enterprise analytical applications in the cloud preferably Azure
- Minimum 9 years of experience with big data technologies such as Hadoop Apache Spark and or Databricks
- Minimum 3 years of experience developing distributed systems in Python Scala or PySpark
- Minimum 3 years of experience transporting data from enterprise systems to Azure using Azure Data Factory or Azure Databricks
- Minimum 3 years of experience building data visualization reporting and data models in Power BI
- Minimum 3 years of experience with complex DAX transformations and complex querying
- Experience creating end to end data pipelines in Databricks using Databricks Notebooks Databricks Jobs Auto Loader and Databricks Structured Streaming
- Bachelor’s degree in Computer Science or related analytical field or equivalent experience
Nice to have
- Apache Spark Certification
- Azure Certification
- Enterprise database experience
- Azure DevOps experience
- .NET web development
Day to day
- Analyze and translate business requirements into effective technology solutions.
- Perform detailed data analysis by writing and executing complex queries and interpreting results.
- Communicate findings clearly to both technical and nontechnical audiences.