Senior Data Engineer
Skills
Computer ScienceDevopsSoftware As A ServiceApache SparkBusiness IntelligenceConsumer TextilesContinuous Integration
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 5+ years of experience in data engineering or data platform engineering
- Bachelor’s degree in Computer Science Data Science or related field or equivalent experience
- Strong hands-on experience with Microsoft Fabric including Lakehouse Warehouse Data Pipelines Notebooks and OneLake
- Experience with CI/CD and DevOps practices using Git and Azure DevOps
- Strong proficiency with Spark and PySpark notebook-based transformations
- Advanced SQL skills including complex transformations performance tuning and dimensional design
- Strong scripting and engineering skills in Python
- Experience with Azure-based data services and modern cloud data platform concepts
- Strong understanding of Delta Lake Parquet partitioning and incremental processing
- Strong experience designing dimensional and analytical models for reporting and self-service consumption
- Experience building robust integrations using REST APIs file-based ingestion JSON and related patterns
- Experience with version control reusable code patterns testing documentation and collaborative workflows
Nice to have
- Hands-on
- High-impact
- Production-oriented
- Collaborative
- Detail-oriented
Day to day
- Design and build scalable data solutions in Microsoft Fabric across Lakehouse Warehouse Pipelines Notebooks and OneLake
- Build and maintain reliable ingestion and transformation pipelines across SaaS platforms operational systems flat files and APIs
- Design curated dimensional and analytical data models and partner with stakeholders to deliver production-ready data products
Hiring process
- Submit application
- Final interviews may be held in person at one of the listed offices