AI Architect
- Capco
- 10 - 15 years
- Bengaluru
- 4 months ago
- Email to a friend
- Report this job
Job Description
Solution Architect & deliver GenAI chat experiences
- Design scalable, low-latency and use your understanding of the structure of various backend systems, such as authentication, authorization, enterprise databases, enterprise APIs, knowledge bases etc, in the context of an end-to-end solution.
- Assess end-to-end bot design and performance.
- Choose and combine LLM access patterns (direct API, fine-tuned models, RAG) to meet accuracy, cost, and governance targets.
- Develop chatbot solutions by utilizing solid understanding of the architectural principles in chatbots for knowledge management, and self-service functionality by invoking APIs for validation, request completion, etc
- Translate business needs into working solutions aligned with enterprise architecture.
Embed Retrieval-Augmented Generation (RAG)
- Own schema design for vector stores (Pinecone, FAISS, pgvector, etc, OpenSearch), chunking strategies, and embedding selection.
Drive LLMOps / MLOps
- Define CI/CD pipelines for prompts, models, and evaluation using MLflow, SageMaker Pipelines, Kubeflow, or equivalent.
- Instrument solutions with OpenTelemetry and automated eval suites for hallucination, toxicity, bias, and drift.
Fine-tune & align models
- Apply parameter-efficient tuning (LoRA, QLoRA, Adapters) or RLHF where prompt-only falls short, perform offline & online A/B tests.
Ensure privacy, security & compliance
- Embed DPDPA, GDPR, SOC 2 controls: PII redaction, encryption in transit/rest, RBAC, secure prompt logging.
- Champion Responsible-AI principles fairness, explainability, auditability.
Optimize performance & cost
- Profile and tune concurrency, GPU/CPU utilization, response-time budgets; recommend caching, quantization, batching while maintaining high accuracy and high security.
Lead & mentor
- Run architecture reviews, code walkthroughs, and knowledge-sharing for engineers across India and global locations.
- Liaise with product owners and stakeholders to translate business goals into actionable architecture roadmaps.
- 10+ years building distributed/cloud systems, 3+ years in conversational AI or GenAI.
- Deep expertise with Python , Node.js and Java. including strong API-first design mindset (REST/gRPC/GraphQL).
- Hands-on with any two AWS Azure or GCP , plus Docker, Kubernetes, and IaC (Terraform, AWS CDK).
- Proven delivery using LangChain, LlamaIndex, Hugging Face Transformers , and at least one vector store (Pinecone, FAISS, pgvector, OpenSearch, etc).
- Demonstrated MLOps / LLMOps practice: CI/CD for models/prompts, automated testing, canary & rollback, lineage tracking.
- Experience fine-tuning or aligning large models (LoRA, QLoRA, PEFT, RLHF) and benchmarking them.
- Track record implementing observability, cost-guardrails, and guardrails for toxicity/hallucination.
- Understanding of end-to-end solution patterns of chatbot solutions and related trade-offs.
- Familiarity with enterprise compliance frameworks (DPDPA, GDPR) and security architecture.
- Strong communication & leadership skills, able to influence across functions and mentor engineers.
- Implement current trends and best practices in AI/ML.
- Bachelors degree in computer science, engineering, information technology, artificial intelligence, or a related field. (or equivalent professional experience)
Job Classification
Industry: BankingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Solution ArchitectEmployement Type: Full timeContact Details:
Company: CapcoLocation(s): Bengaluru
Keyskills: Backend Front end Enterprise architecture SOC Schema Information technology Analytics Financial services Python
Similar positions
Capco
Capco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business and technology by c...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in