How Remoteville checks and expires listings
AI Test Engineer
Skills
Analytical SkillsArtificial IntelligenceBankingDesign PatternsEngineeringHTMLQuality Assurance
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- Experience testing AI-driven or data-driven systems such as LLMs ML models rule engines recommendation systems or NLP-based features
- Understanding of AI ML behavior concepts including prompt variability non-deterministic outputs confidence thresholds bias hallucinations and edge-case handling
- Ability to design validation strategies for probabilistic systems where results may not always be binary pass fail
- Strong hands-on experience with Playwright automation framework
- Proficiency in JavaScript or TypeScript
- Demonstrated expertise using GitHub Copilot Codex or AI coding assistants as part of daily development workflow
- Solid understanding of automation framework architecture and design patterns
- Regulatory experience in pharmaceuticals clinical trials insurance banking or fintech is advantageous
Nice to have
- Analytical
- Detail-oriented
- Collaborative
- Innovative
- Adaptable
Day to day
- Test AI-powered features across the application with a focus on reliability accuracy robustness and explainability.
- Design prompt-based and scenario-driven tests to evaluate model behavior under varied inputs and edge cases.
- Build maintain and enhance scalable Playwright automation frameworks for UI API and end-to-end testing while using AI tools to accelerate development.