Senior Data Engineer
Skills
Azure Data FactoryAzure Data LakeComputer ScienceDevopsApache SparkConsumer TextilesHealthcare
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Senior-level Azure data engineering experience across Azure Data Factory Databricks Synapse Analytics and Azure Data Lake ADLS Gen2
- Strong SQL and Python Spark skills
- Hands-on experience designing and implementing ETL ELT pipelines and data models
- Experience with streaming and ingestion technologies such as Event Hubs Kafka or similar
- Proficiency with Git and Azure DevOps workflows
- Understanding of data governance security and lineage practices in regulated environments
- Experience preparing data for AI ML workloads including feature pipelines embeddings and vector data
- Bachelor's degree in Computer Science Information Systems Engineering or related field or equivalent experience
Nice to have
- Healthcare experience
- Microsoft Fabric
- Power BI
- dbt
- Regulated industry experience
Day to day
- Design, build, and maintain ETL and ELT pipelines across the Azure data stack to support analytics and AI initiatives
- Develop and orchestrate reliable data workflows in Azure Data Factory and Databricks while improving performance and scalability
- Model and optimize data in Synapse and Azure Data Lake, with careful attention to quality, security, and governance for sensitive healthcare data
- Collaborate with full-stack and AI engineers to prepare data for feature pipelines, embeddings, and production AI workloads