Data Engineer
Skills
DatabricksSQLData GovernanceData QualitySemantic DefinitionsResponsible AILLM Validation
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Strong SQL skills
- Experience working in data lake warehouse or analytics environments
- Ability to read and reason through data pipelines and transformation logic
- Strong documentation skills translating technical logic into business-friendly definitions
- Comfortable leading discovery conversations with technical and business stakeholders
- Familiarity with data governance data quality semantic definitions and responsible AI or LLM validation preferred
Nice to have
- Detail oriented
- Analytical mindset
- Business focused communication
- Collaborative
- Governance aware
Day to day
- Review and improve Unity Catalog table and field documentation to close gaps and correct inaccuracies.
- Trace upstream data pipelines and SQL logic to understand how data is sourced transformed and published.
- Document approved data use cases and data restrictions for reporting analysis and AI or LLM scenarios.