Senior Data Engineer
Skills
Agile DevelopmentMicrosoft AzureSQLApache AirflowAzure Devops ServicesData Build ToolPython
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Experience in utilizing Azure DevOps Services for data engineering environment
- Proficiency in working with Snowflake for data warehousing
- Implementing and managing data transformations using DBT
- Building and managing data pipelines using Apache Airflow
- Strong scripting skills for automation and data manipulation
- Experience with Databricks for collaborative and scalable data analytics
- Working knowledge and experience in an agile development environment
Nice to have
- EHR Experience
- RCM Data Experience
Day to day
- Develop a platform in Azure for efficient data processing
- Implement a large complex data warehouse in an agile manner
- Pull data from independent systems efficiently then transform and normalize data rapidly
- Utilize Azure services for data engineering tasks
- Work with Snowflake DBT and Airflow for effective data processing
- Use Python for scripting and automation
- Leverage Databricks for scalable and collaborative data analytics
- Work in an agile fashion to ensure quick and adaptive development