AI Testing (Foundry) - Remote Contract Position
- Trigyn Technologies
- 5 - 10 years
- Mumbai
- 4 days ago
- Email to a friend
- Report this job
Job Description
Company: Trigyn Technologies
Position: AI Testing Consultant(Foundry)
Job Type: Contractual (6 Months Extendable)
Location: Remote
Shift: Until Noon EST
Job Overview
Trigyn is hiring an AI Testing Consultant with strong expertise in AI evaluation concepts, GenAI validation, and AI agent testing. The ideal candidate should possess a solid understanding of AI quality evaluation techniques including groundedness, hallucination detection, accuracy measurement, text similarity, correctness validation, and model drift analysis.
While exposure to Microsoft AI Foundry evaluators is preferred, deep tool-specific experience is not mandatory. Candidates with strong AI evaluation fundamentals and hands-on testing experience in GenAI or AI-driven applications will be highly preferred.
Key Responsibilities
- Perform testing and validation of AI agents, GenAI applications, and prompt-based systems.
- Execute functional, non-functional, and scenario-based testing for AI workflows.
- Evaluate AI responses using metrics such as:
- Groundedness
- Hallucination detection
- Accuracy
- Relevance
- Correctness
- Text similarity
- Completeness
- Model drift
- Analyze AI outputs and identify risks, gaps, inconsistencies, and improvement areas.
- Validate AI responses against business requirements and expected behaviors.
- Support testing of single-agent and multi-agent AI workflows.
- Collaborate with developers, architects, and business teams for defect analysis and resolution.
- Document evaluation findings, test scenarios, and AI performance observations.
Required Skills
- 5 years of experience in QA, AI testing, GenAI validation, or intelligent automation testing.
- Hands-on experience testing:
- AI Agents
- Chatbots
- LLM/GenAI applications
- Prompt-driven systems
- Strong understanding of AI evaluation metrics and validation methodologies.
- Knowledge of:
- Hallucination detection
- Groundedness validation
- AI response accuracy
- Semantic/text similarity
- AI correctness evaluation
- Model drift concepts
- Strong analytical and troubleshooting capabilities.
- Good communication and documentation skills.
Preferred Skills
- Exposure to Microsoft AI Foundry evaluators.
- Experience with Copilot Studio or agentic AI frameworks.
- Familiarity with multi-agent orchestration testing.
- Experience working in enterprise AI governance environments.
Interested candidates, please share your resume on go*********e@tr***n.com or Whatsapp on +91 9324972***.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Quality Assurance and TestingRole: Quality Assurance and Testing - OtherEmployement Type: ContractContact Details:
Company: Trigyn TechnologiesLocation(s): Mumbai
Keyskills: Foundry Test Engineering Artificial Intelligence Software Testing Aiml Machine Learning Python
Similar positions
Trigyn Technologies
Trigyn Technologies ltd Trigyn is an ISO 9001:2008 certified, and CMMI Level 5 assessed company. Trigyn Technologies is an IT Services Company that has been in business for more than 30 years. Trigyn provides IT Solutions, Consulting, Systems Integration, Managed Services, Software Development, ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in