How Remoteville checks and expires listings

GenAI QA Engineer (Tester)

Skills
ASP.NETAgile MethodologiesC#JavascriptMicrosoft AzureSQLSQL Server Integration Services
Role

What the job involves

The main requirements, responsibilities and hiring steps.

Day to day

  • Develop comprehensive test plans and test cases based on requirements and specifications; create test strategy to validate prompt engineering and RAG outputs
  • Validate software against business and technical requirement throughout the SDLC stages and participate in Design review and Code review to provide testing perspective
  • Design and implement automated testing scripts and frameworks for GEN AI models
  • Execute tests on AI models to ensure accuracy, robustness, and performance
  • Identify, document, and track defects, and work with the development team to resolve them; report testing progress, issues, and risks to stakeholders in a clear and concise manner
  • Validate the functionality, performance, and reliability of AI models across various scenarios and datasets and ensure compliance with industry standards and best practices for AI development and testing
  • Collaborate with data scientists, machine learning engineers, and software developers to understand AI model requirements and constraints, provide feedback and suggestions for improvements in AI model development and deployment processes
  • Stay updated with the latest advancements in AI testing methodologies and tools and contribute to the continuous improvement of testing processes and practices within the organization