Data Engineer
Skills
Azure Data FactoryData EngineeringBusiness RequirementsData ArchitectureData PipelinesData ScienceDatabase Administration
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Advanced SQL knowledge and experience with relational databases
- Experience building and optimizing data pipelines and architectures
- Experience with programming to develop ETL
- Experience performing root cause analysis on internal and external data and processes
- Strong analytic skills with unstructured datasets
- Build processes supporting data transformation and other data needs
- 3+ years experience in a Data Engineer role
- Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a similar field
- Experience with Database Administration and Maintenance
- Experience with big data tools: Azure Data Factory/Synapse
- Experience with relational SQL, including Postgres and SQL Server
- Experience with Analytics Tools: Power BI
- Experience with Microsoft Azure cloud services
- Experience with scripting languages: Python, Java, C++, Scala, Go
Day to day
- Responsible for expanding and optimizing data and data pipeline architecture. Optimizing data flow and collection for cross-functional teams. Support software developers on data initiatives and ensure optimal data delivery architecture.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from various sources using SQL and Azure cloud technologies.
- Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.