Sr Data Engineer (Databricks)
Skills
Azure Data FactoryAzure Data LakeComputer ScienceDevopsWarehouse OperationsCloud AdministrationData Analytics
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Minimum 8 years developing software and data solutions in enterprise environments
- Direct experience with application development data warehouse and BI design implementation and operation
- Hands-on experience with Azure Databricks Azure Synapse Azure Data Factory Azure Data Lake Storage and Power BI
- Knowledge of infrastructure operating system networking and cloud administration
- Experience with Infrastructure as Code such as Terraform
- Knowledge of DevOps tools such as GitHub Actions or PowerShell
- Experience with SQL Azure C# or Python application development
- Experience with machine learning and MLOps
- Experience with investment management systems and processes
- Experience working in Agile methodologies
Day to day
- Work with business and technology partners to analyze how the data warehouse analytics and applications meet organizational goals
- Evaluate incoming requests to determine fit with data warehouse analytics and application solution architecture
- Own the Azure data warehouse and analytics platform from implementation through enhancements ongoing operations and support