How Remoteville checks and expires listings
Senior AI & Data Engineer
Skills
Back-End Web DevelopmentAmazon Web ServicesApache SparkArtificial IntelligenceData EngineeringEngineeringExtract
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 7+ years in backend data heavy development or data engineering
- Previous startup experience
- Highly proficient in Python
- Hands on experience with large datasets and high velocity data streams such as Kafka Flink or Spark
- Strong with pipeline orchestration tools such as Airflow MLflow or equivalent
- Solid SQL skills and NoSQL experience
- Real experience with LLM workflows including RAG embeddings vector DBs prompt engineering function or tool calling and observability
- Deep understanding of ETL and ELT patterns and data processing at scale
Nice to have
- Autonomous
- Production focused
- Curious
- Ownership mindset
- Fast moving startup experience
Day to day
- Design, build, and maintain batch and streaming data pipelines for ingestion cleaning normalisation enrichment and deduplication
- Own end to end ML and LLM pipelines including document parsing chunking embeddings vector indexing and agentic tool calling
- Write production grade Python to process large volumes of data and documents reliably while owning pipeline health and troubleshooting issues