Data Engineer
Skills
Apache SparkDatabasesDebuggingDialectical Behavior TherapyDownstream Oil And GasEnglishGood Clinical Practice
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Strong in SQL and Python with real pipeline experience
- Comfortable with Spark or PySpark dbt and Airflow
- Experience with at least one major cloud platform AWS GCP or Azure
- Worked with vector databases or feature stores or can learn quickly
- Treats data reliability as an engineering discipline
- Fluent English and comfortable working async in a global team
Nice to have
- Ownership mindset
- Async communication
- Data reliability focus
- Cloud cost awareness
Day to day
- Build and maintain data pipelines that support the full AI lifecycle from ingestion to model training to serving
- Work with structured and unstructured data in both batch and real time environments
- Keep feature stores and vector databases consistent so downstream engineers can trust the data they use
- Own data quality reliability lineage documentation and cloud cost management across the platforms used
Hiring process
- Message Farah directly
- Apply