AI- LLMOps Engineer
- Concentrix
- 5 - 10 years
- Kolkata
- 2 months ago
- Email to a friend
- Report this job
Job Description
We are seeking a skilled LLMOps Engineer with expertise in operationalizing Generative AI solutions to join our AI Engineering Center of Excellence. This role will focus on establishing robust infrastructure, deployment pipelines, and monitoring systems to ensure the reliable, secure, and scalable delivery of LLM-based applications in production environments. The LLMOps Engineer will work closely with AI Tech Leads and Senior Engineers to bridge the gap between development and production deployment of GenAI solutions.
Primary Responsibilities
- Design and implement infrastructure and deployment pipelines for large language model (LLM) applications in production environments
- Establish monitoring, observability, and logging systems for GenAI applications to ensure performance, reliability, and data quality
- Develop automated testing frameworks specific to LLM applications, including evaluation of model outputs and prompt effectiveness
- Implement version control systems for models, prompts, and configurations to ensure reproducibility and traceability
- Create and maintain CI/CD pipelines for seamless deployment of GenAI solutions
- Optimize infrastructure and implementations for cost efficiency, considering compute resources and API usage
- Implement security controls and compliance measures specific to GenAI applications
- Collaborate with development teams to establish best practices for transitioning GenAI solutions from prototype to production
- Automate feedback loops for continuous improvement of deployed models
- Document operational procedures, architecture decisions, and maintenance protocols
Required Qualifications
- 5+ years of experience in DevOps, platform engineering, or related roles with at least 2+ years focused on ML/AI systems
- Hands-on experience with cloud infrastructure and services for AI workloads (AWS, Azure, GCP)
- Strong programming skills in languages commonly used for infrastructure and automation (Bash, YAML)
- Experience with containerization and orchestration technologies (Docker, Kubernetes) for AI workloads
- Knowledge of LLM deployment patterns and associated infrastructure requirements
- Familiarity with monitoring tools and techniques for AI systems (e.g., model performance, drift detection, cost tracking)
- Understanding of CI/CD principles and experience implementing automated pipelines
- Experience with infrastructure-as-code tools (Terraform, CloudFormation, etc.)
- Basic understanding of LLM architectures and their operational requirements
- Bachelors degree in Computer Science, Engineering, or related technical fieldd
Preferred Skills
- Experience deploying and managing production LLM applications at scale
- Knowledge of vector database operations and optimization for RAG implementations
- Familiarity with API gateway management and rate limiting strategies
- Experience with distributed tracing and debugging complex AI systems
- Understanding of data privacy, security, and compliance considerations for GenAI applications
- Knowledge of cost optimization techniques for LLM inference and embedding generation
- Experience with feature flagging and A/B testing frameworks for AI applications
- Familiarity with LLM evaluation metrics and automated testing approaches
- Experience with GPU resource management and optimization
Success Factors
- Strong technical curiosity and willingness to explore new GenAI capabilities
- Balance between operational excellence and enabling rapid innovation
- Strong problem-solving skills for troubleshooting complex production issues
- Effective communication across technical and non-technical stakeholders
- Proactive approach to identifying and mitigating operational risks
- Ability to translate business requirements into operational specifications
- Commitment to continuous improvement of operational processes
- Adaptability to rapidly evolving GenAI technologies and deployment patterns
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Hardware & Networks,
Role Category: IT Network
Role: Network (Support) Engineer
Employement Type: Full time
Contact Details:
Company: ConcentrixLocation(s): Kolkata
+ View Contact
Keyskills: Computer science Automation Operational excellence Market research Data quality Troubleshooting Resource management Continuous improvement Operations Analytics
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Concentrix
A wholly owned subsidiary of SYNNEX Corporation (NYSE: SNX), Concentrix is a leader in high-value global business services. It partners with its clients to deliver end-to-end customer engagement services, technology innovations, analytics, process optimization, and business improvements. The global ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in