Sr Data Engineer (Databricks)
Skills
Azure Data FactoryAzure Data LakeComputer ScienceDevopsWarehouse OperationsCloud AdministrationData Analytics
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Minimum 8 years of experience developing software and data solutions in an enterprise environment
- Direct experience with application development data warehouse design implementation and operations
- Experience with Azure Databricks Azure Synapse Azure Data Factory Azure Data Lake Storage and Power BI
- Knowledge of infrastructure operating systems networking and cloud administration
- Experience with Terraform for Infrastructure as Code
- Knowledge of DevOps tools such as GitHub Actions or PowerShell
- Experience with SQL Azure C# or Python application development
- Experience with Machine Learning and MLOps
- Experience with investment management systems and processes
- Experience working in Agile methodologies across cloud application database data warehousing and BI
Nice to have
- Analytical
- Collaborative
- Detail-oriented
- Proactive
- Strategic
Day to day
- Analyze business and technology needs to shape data warehouse, analytics, and application solutions.
- Own the Azure data platform end to end including implementation enhancements operations and troubleshooting.
- Design develop and coordinate cloud data and application projects across architecture identity access network and data teams.
- Provide technical direction standards and best practices while supporting monitoring capacity planning cost optimization and after-hours support.