How Remoteville checks and expires listings
Senior Quality Assurance Engineer
Skills
Artificial IntelligenceConnectorsQuality AssuranceRegression TestingSolutions EngineeringPlaywrightVitest
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 7+ years of QA engineering experience
- 3+ years in a senior or lead QA role
- Experience testing AI or LLM-powered applications
- Strong Python test automation skills
- Hands-on production experience with Playwright and Vitest
- Experience building automation frameworks from scratch
- Comfortable testing async streaming and multi-service workflows
- US-based and able to overlap with EDT for about 5 hours per day
- Available for full-time contract hours
Nice to have
- Ownership mindset
- Executive empathy
- Regulated industry experience
- Forward deployed experience
- Trust focused
Day to day
- Own the testing foundation for an AI systems and platform product in a hands-on contract role
- Design and maintain unit integration end-to-end and AI-specific evaluation pipelines using Playwright and Vitest
- Validate non-deterministic LLM outputs agent orchestration knowledge graph accuracy and platform reliability before client deployment