How Remoteville checks and expires listings
AI Engineer
Skills
Computer ScienceJavaApache SparkArtificial IntelligenceAutocadC++Data Science
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 3+ years shipping AI in production at scale with direct ownership of model quality
- Experience building evaluation sets and using them to make release decisions
- Built systems where offline evaluation production behavior and customer feedback all mattered
- Owned more than integration work and been responsible for model behavior itself
- Comfort working directly with technical and non-technical stakeholders including domain experts
- Judgment about when to use rules prompts retrieval fine-tuning or workflow changes
- Experience in environments where both false positives and false negatives have real cost
- Ability to explain technical tradeoffs clearly and without hand-waving
Day to day
- Own production LLM systems and agentic workflows that deliver accurate and usable end-user experiences
- Build evaluation frameworks with gold sets scoring rubrics regression tests and release gates to catch quality issues early
- Work directly with SMEs and enterprise customers to diagnose failures and improve models prompts retrieval and workflows
- Generalize customer-specific solutions into reusable platform primitives so each deployment strengthens the core learning library
- Keep the system observable measurable and stable while using feedback loops to drive continuous product improvement