Data Engineer
Skills
AggregationAzure DatabricksData AggregationData GovernanceData IntegrityEngineeringRecruiting
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 3+ years experience in data engineering or ETL development
- Hands-on experience with Databricks PySpark SQL and cloud data platforms
- Experience implementing data quality frameworks rules and automated checks
- Understanding of data lineage metadata and risk or regulatory data processes
- Experience in financial services or risk data programmes BCBS 239 preferred
- Strong communication skills with technical and non-technical stakeholders
Nice to have
- Detail-oriented
- Collaborative
- Proactive
- Analytical
Day to day
- Build and maintain data pipelines that support BCBS 239 risk data aggregation initiatives
- Develop and automate data quality controls and checks to strengthen data integrity and traceability
- Work with metadata and lineage processes across Databricks and cloud data platforms
- Collaborate with technical and non-technical stakeholders to deliver regulatory-grade data solutions
Hiring process
- Send your CV to Nick.chambers@methodresourcing.co.uk