Senior ML Engineer VLM
Skills
Computer ScienceApache SparkData AnalyticsDatabasesDesktop VirtualizationECSLabels
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Bachelor’s degree in Computer Science Robotics Electrical Engineering or related technical field plus 6+ years of experience OR Master’s degree plus 3+ years of experience
- Strong computer vision and deep learning experience including at least two of 2D/3D object detection tracking sensor fusion semantic segmentation BEV or depth estimation
- Hands-on multimodal or VLM experience with vision-language models open-vocabulary or zero-shot recognition dense captioning or semantic embeddings applied to perception data
- Experience building targeted datasets that measurably improve model performance and processing large-scale Parquet data
- Experience with distributed ML and data frameworks such as PyTorch Lightning Ray Spark or equivalent
- Experience with scaled MLOps tooling including experiment tracking model registry MLflow or Weights & Biases ML metrics evaluation and quality
- Strong Python software development experience with cloud-based development environments CI systems and Docker
Nice to have
- Independent judgment
- Cross-team alignment
- Mentoring ability
- Technical leadership
- Research awareness
Day to day
- Own cloud-based offline data pipelines that transform logged multi-sensor fleet data into high-quality VLM/VLA training datasets
- Develop VLM-assisted auto-labeling workflows including open-vocabulary detection dense captioning semantic enrichment and scenario description generation
- Create reasoning-grounded annotations and curated long-tail datasets that improve downstream model performance and support explainable driving behavior