Senior Data Engineer (Databricks)
Skills
Cloud ComputingSQLSoftware DevelopmentApache SparkArtificial IntelligenceAzure DatabricksBig Data
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 5+ years of data engineering experience with cloud platforms
- Proven Databricks experience including PySpark SQL Delta Lake and Unity Catalog
- Strong ETL/ELT development and data pipeline orchestration experience
- Proficiency in SQL and Python for data transformation and optimization
- Hands-on CI/CD and Infrastructure as Code experience
- Experience integrating Databricks with BI tools
- Consulting and client-facing experience with solution design and stakeholder communication
- Experience delivering data lakehouse buildouts or cloud data migrations
Nice to have
- Customer-facing
- Consultative mindset
- Flexible
- Resilient
- Problem-solver
- Clear communicator
Day to day
- Deliver complex data engineering projects across multiple industries, either individually or by leading small delivery teams
- Work directly with customers on fast-paced 2 to 4 month engagements, solving data engineering, ML, MLOps, and cloud migration challenges
- Support pre-sales activities, mentor junior engineers, and contribute to hiring while helping shape the team and organization
Hiring process
- Submit your application
- Interview process with selection discussions