Gen AI QA Analyst
- Virtusa
- 6 - 10 years
- Hyderabad
- 20 hours ago
- Email to a friend
- Report this job
Job Description
Job Summary: The GenAI QA Analyst ensures the quality, reliability, and compliance of generative AI solutions deployed across enterprise environments. This role is critical in validating AI-driven outputs, monitoring system performance, and ensuring that solutions meet both technical and business expectations. Positioned at the intersection of technology and business, the analyst works closely with delivery leads, developers, and product owners to safeguard the accuracy, scalability, and ethical use of AI applications.
Responsibilities:
- Collaborate with delivery leads and product owners to define QA strategies for generative AI projects.
- Design and execute test plans that validate AI outputs for accuracy, consistency, and compliance.
- Conduct both automated and manual testing to evaluate AI models across diverse business scenarios.
- Monitor AI system performance using enterprise tools, ensuring proactive detection and resolution of issues.
- Validate integration of AI platforms into enterprise workflows, ensuring seamless adoption and reliability.
- Ensure GitHub Copilotdriven development aligns with QA standards and supports reproducible outcomes.
- Document QA findings in clear, business-readable formats for stakeholders.
- Advocate for continuous improvement in AI testing practices and promote a quality-first culture across teams.
Mandatory Skills:
- GitHub Copilot (Expert)
- Generative AI Testing Frameworks (Advanced)
- Automated QA Tools & Scripting (Advanced)
- AI Model Validation Techniques (Advanced)
- Performance Monitoring (Dynatrace Davis) (Intermediate)
Preferred Skills:
- AI Foundry
- Microsoft Copilot Studio
- Atlassian Rovo
- Claude Code
- Documentation & Reporting Tools
Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. Proven experience in Quality Assurance, particularly in AI/GenAI-focused projects.
Job Classification
Industry: Financial ServicesFunctional Area / Department: Engineering - Software & QARole Category: Quality Assurance and TestingRole: Quality Assurance and Testing - OtherEmployement Type: Full timeContact Details:
Company: VirtusaLocation(s): Hyderabad
Keyskills: Gen AI QA Analysis Github Copilot Test automtion
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in