QA Engineer (Immediate joiner )
- Hiring for Client
- 3 - 5 years
- Bengaluru
- 1 month ago
- Email to a friend
- Report this job
Job Description
As a QA Engineer, you will play a critical role in ensuring the quality, performance, and reliability of our AI-driven product built using Retrieval Augmented Generation (RAG) architecture. You will work closely with our engineering team to test APIs, evaluate end-to-end workflows involving local LLMs, and validate data retrieval accuracy. This role requires a strong foundation in automated testing and performance benchmarking, as well as a proactive mindset to identify potential issues before they reach production.
Responsibilities:
- Design and implement test plans for API endpoints, data retrieval workflows, and user interactions
- Conduct manual and automated testing to validate features and catch bugs early
- Evaluate LLM-integrated workflows for functional correctness and response quality
- Perform performance and scalability testing to assess system behaviour under different loads
- Conduct integration testing across components (e.g., FastAPI, vector DB, LLM, data sources)
- Report and track bugs with clear documentation and reproduction steps
- Collaborate closely with developers to suggest improvements and validate fixes
- Contribute to maintaining test coverage as the product evolves
Requirements:
- 34 years of experience in QA, with at least 1+ year in API/product testing
- Proficiency with Python and test automation tools like pytest, unittest, or similar
- Hands-on experience with API testing tools (Postman, Swagger, or similar)
- Experience with performance testing tools like Locust, JMeter, or custom scripts
- Familiarity with CI/CD pipelines and test reporting
- Strong understanding of SDLC and bug-tracking tools (e.g., Jira, Trello)
- Excellent communication skills and attention to detail
Good to Have:
- Exposure to LLMs, NLP models, or working with RAG architecture
- Knowledge of vector databases or embedding-based search
- Experience testing AI-driven products
- Understanding of security testing principles including prompt injection, data leakage, and API security vulnerabilities
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Quality Assurance and Testing
Role: Quality Assurance and Testing - Other
Employement Type: Full time
Contact Details:
Company: Hiring for ClientLocation(s): Bengaluru
Keyskills: API testing tools QA Engineer Swagger Retrieval Augmented Generation Python pytest Trello unittest JMeter Locust Jira SDLC custom scripts CI/CD pipelines performance testing tools Postman
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in