Generative AI Tester
Remote
Contracted
Audit
Experienced
- This is Remote Position
- Job Description: Tester for gen AI SDLC
Job Summary:
We are seeking skilled and detail-oriented GEN AI Testers to join our team. The candidate will be responsible for testing and validating our Generative AI SDLC model to ensure they meet the highest standards of quality, performance, and reliability. This role involves creating and executing test plans, identifying and documenting bugs, and working closely with developers and data scientists to improve our AI systems. Strong understand of GenAI solution and how the solutions are used in Professional Services environment. Ability to think as a business user while testing and validating GenAI outcomes.
Key Responsibilities:
1. Test Planning and Design:
- Develop comprehensive test plans and test cases based on requirements and specifications.
- Validate software against business and technical requirement throughout the SDLC stages
- Design and implement automated testing scripts and frameworks for GEN AI models
- Develop test strategy to validate prompt engineering and RAG outputs
- Participate in Design review, Code review to provide testing perspective
2. Execution and Reporting:
- Execute tests on AI models to ensure accuracy, robustness, and performance
- Identify, document, and track defects, and work with the development team to resolve them.
- Report testing progress, issues, and risks to stakeholders in a clear and concise manner.
3. Quality Assurance:
- Validate the functionality, performance, and reliability of AI models across various scenarios and datasets.
- Ensure compliance with industry standards and best practices for AI development and testing
4. Collaboration:
- Work closely with data scientists, machine learning engineers, and software developers to understand AI model requirements and constraints.
- Provide feedback and suggestions for improvements in AI model development and deployment processes.
5. Continuous Improvement:
- Stay updated with the latest advancements in AI testing methodologies and tools.
- Contribute to the continuous improvement of testing processes and practices within the organization.
Qualifications:
1. **Education:**
- Bachelor’s degree in Computer Science , Engineering, or a related field. Master’s degree is a plus.
2. Experience:
- At least 7-8 years of Testing and Test management experience
- Proven experience in software testing, preferably with AI or machine learning models.
- Familiarity with testing frameworks and tools such as PyTest, JUnit, Selenium, etc.
- Experience with scripting and programming languages like Python, Java, or similar.
3. Technical Skills:
- Understanding of AI/ML concepts, algorithms, and workflows.
- Proficiency in using tools and platforms for AI model development and testing
- Strong analytical and problem-solving skills.
4. Soft Skills:
- Excellent communication skills, both written and verbal.
- Detail-oriented with a strong focus on quality.
- Ability to work independently as well as part of a collaborative team.
Apply for this position
Required*