Data Engineer
Skills
Azure Data FactoryAlteryxAzure DatabricksData Build ToolData PipelinesEnterprise Solution Design
What the job involves
The main requirements, responsibilities and hiring steps.
Day to day
- Contribute to mission by creating solutions supporting informed decision-making innovation providing clean protected effective data management practices
- Report to Vice President of Business Systems collaborate with Data Engineers BI Analysts Business Systems Support Project Development Managers
- Enable rapid software innovation in the enterprise
- Design, develop, test, deploy, monitor data pipelines in Azure Data Factory Databricks Synapse Analytics for ELT/ETL
- Design, develop, test, deploy scalable code with Python and SQL in Databricks, dbt, other platforms
- Integrate source systems with information management solutions and target systems for automated migration processes
- Identify, design, implement internal process improvements optimize data delivery redesign infrastructure for scalability
- Lead data migration efforts for mergers acquisitions
- Build data quality dashboards/monitoring tools for active monitoring actionable insights
- Assist Data Architect in migration of data from legacy systems to new solutions
- Collaborate with IT administrators technical architects business analysts product owners to determine requirements plan strategies
- Follow lead best practices on data security retention privacy policies
- Partner with Business Systems Support Project Development Managers for rapid software innovation
Hiring process
- Pre-employment screening background check drug screen reasonable accommodation for qualified individuals