MLOPs and LLMOps Engineer
- Cirruslabs
- 8 - 12 years
- Bengaluru
- 12 days ago
- Email to a friend
- Report this job
Job Description
Experience - 8 - 10 years
Location - Bengaluru
Key Responsibilities
Design, implement, and maintain end-to-end MLOps pipelines for model training, validation, deployment, and monitoring.
Build and manage LLMOps pipelines for fine-tuning, evaluating, and deploying large language models (e.g., OpenAI, HuggingFace Transformers, custom LLMs).
Use Kubeflow and Kubernetes to orchestrate reproducible, scalable ML/LLM workflows.
Implement CI/CD pipelines for ML projects using GitHub Actions , Argo Workflows , or Jenkins .
Automate infrastructure provisioning using Terraform , Helm , or similar IaC tools.
Integrate model registry and artifact management with tools like MLflow , Weights & Biases , or DVC .
Manage containerization with Docker and container orchestration via Kubernetes .
Set up monitoring , logging , and alerting for production models using tools like Prometheus , Grafana , and ELK Stack .
Collaborate closely with Data Scientists and DevOps engineers to ensure seamless integration of models into production systems.
Ensure model governance, reproducibility, auditability, and compliance with enterprise and legal standards.
Conduct performance profiling, load testing, and cost optimization for LLM inference endpoints.
Required Skills and Experience
Core MLOps/LLMOps Expertise
5+ years of hands-on experience in MLOps/DevOps for AI/ML.
2+ years working with LLMs in production (e.g., fine-tuning, inference optimization, safety evaluations).
Strong experience with Kubeflow Pipelines , KServe , and MLflow .
Deep knowledge of CI/CD pipelines with GitHub Actions , GitLab CI , or CircleCI .
Expert in Kubernetes , Helm , and Terraform for container orchestration and infrastructure as code.
Programming & Frameworks
Proficient in Python , with experience in ML libraries such as scikit-learn , TensorFlow , PyTorch , Hugging Face Transformers .
Familiarity with FastAPI , Flask , or gRPC for building ML model APIs.
Cloud & DevOps
Hands-on with AWS , Azure , or GCP (preferred: EKS, S3, SageMaker, Vertex AI, Azure ML).
Knowledge of model serving using Triton Inference Server , TorchServe , or ONNX Runtime .
Monitoring & Logging
Tools: Prometheus , Grafana , ELK , OpenTelemetry , Sentry .
Model drift detection and A/B testing in production environments.
Soft Skills
Strong problem-solving and debugging skills.
Ability to mentor junior engineers and collaborate with cross-functional teams.
Clear communication, documentation, and Agile/Scrum proficiency.
Preferred Qualifications
Experience with LLMOps platforms like Weights & Biases , TruEra , PromptLayer , LangSmith .
Experience with multi-tenant LLM serving or agentic systems (LangChain, Semantic Kernel).
Prior exposure to Responsible AI practices (bias detection, explainability, fairness).
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Other
Role Category: Other
Role: Other
Employement Type: Full time
Contact Details:
Company: CirruslabsLocation(s): Bengaluru
Keyskills: MLOps LLM Kubernetes
Similar positions
Cirruslabs
We are CirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in