Test Automation Architect (Gen AI, Playwright, Selenium)
- Happiest Minds
- 11 - 18 years
- Bengaluru
- 9 hours ago
- Email to a friend
- Report this job
Job Description
Automation Test Architect
Role Summary
We are seeking an experienced Automation Test Architect to lead the Quality Engineering (QE) strategy for GenAI-driven systems. The ideal candidate will have 14+ years of experience in testing and quality leadership, with strong expertise in defining test architectures, building scalable automation frameworks, and ensuring enterprise-grade quality for AI agents, LLM workflows, APIs, and data pipelines. This role requires a strategic leader who can drive shift-left quality practices, mentor teams, and align quality outcomes with business and regulatory expectations.
Key Responsibilities
Quality Engineering Strategy & Leadership
- Define and lead the QE strategy for GenAI initiatives, ensuring reliability, scalability, and regulatory compliance
- Establish quality standards, test governance, and quality gates across the SDLC
- Drive shift-left testing practices and continuous quality improvements
- Mentor and guide QA/QE teams, building strong automation and AI testing capabilities
Test Architecture & Automation
- Design and implement test architectures and automation frameworks for:
- AI agents and LLM workflows
- Prompt orchestration and grounding pipelines
- Data pipelines and API integrations
- Build and maintain scalable automation suites using:
- Selenium (mandatory)
- Python-based frameworks (PyTest optional)
- Postman, JMeter
- CI/CD tools for continuous testing
- Develop reusable test assets to improve efficiency and coverage
GenAI Validation & Quality Assurance
- Design and execute validation strategies for:
- Model outputs
- Prompt accuracy and consistency
- Grounding, reliability, and response quality
- Implement performance, security, resilience, and reliability testing to ensure production-grade GenAI solutions
- Promote AI-assisted testing, synthetic data generation, and observability-driven quality insights
Collaboration & Stakeholder Engagement
- Work closely with:
- Solution architects
- Product teams
- Engineering and platform teams
- Ensure high-quality releases through early risk identification and measurable quality KPIs
- Provide quality inputs during design, architecture reviews, and release planning
Governance, Compliance & Metrics
- Ensure compliance with regulatory and enterprise quality standards
- Maintain test documentation and support audit readiness
- Define, track, and report quality KPIs, ROI, and risk metrics
- Align testing strategies with:
- Business risk
- Regulatory expectations
- Customer impact
Required Experience & Skills
Experience
- 14+ years of experience in software testing and quality engineering
- Proven experience as a Test Architect / Automation Architect / QE Lead
- Strong background in enterprise-scale automation and test strategy
Technical Skills
- Mandatory: Selenium, Playwright, Automation
- Hands-on knowledge of:
- API and microservices architectures
- Data pipeline testing
- Cloud-based systems and enterprise platforms
GenAI & Advanced Testing (Highly Preferred)
- Experience testing GenAI systems, LLMs, or AI agents
- Understanding of:
- Prompt workflows
- Model validation techniques
- Grounding and hallucination risks
- Exposure to AI-assisted testing tools and synthetic data strategies
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Automation ArchitectEmployement Type: Full timeContact Details:
Company: Happiest MindsLocation(s): Bengaluru
Keyskills: Test Architecture Generative Ai Playwright Automation Testing Selenium
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in