MLOps Engineer - Kubernetes/Spark
- TensorGo
- 3 - 5 years
- Hyderabad
- 1 month ago
- Email to a friend
- Report this job
Job Description
Skill Set : Seldon Core, Cubeflow, CI/CD, Kubernetes, Prometheus, Grafana, ISTIO
Looking for an experienced and high-energy ML Ops Engineer. The primary function of this role is to design enterprise architecture. Envision and drive solution architecture after hearing the product s vision and user stories with ability to envision and drive a proactive architectural roadmap for an existing product keeping in mind the future requirements
Requirements :- Holds experience in migration on spark jobs to Kubernetes.- Excellent understanding of Open Source software and the Open Source Software community and the ability to collaborate- Experience with containerizing and deploying ML models- Sound knowledge and experience with at least one DL frameworks such as PyTorch, TensorFlow, Keras- Experience using Python,TensorFlow, PyTorch and other Computer Vision frameworks- Excellent understanding and experience with Kubernetes in deploying Cloud Native configured Applications, AWS EKS, Dockers and MLOps and DevOps pipeline- Strong in providing solutions in data engineering and cloud migration projects, experienced as Architect for data governance, integration, modeling and quality management.- Experience in enterprise data warehouse setup, Hadoop cluster installation, pre-sales and solution engineering recommendations.
Responsibilities :
- Seldon Core Setup and Installation in Kubernetes- Seldon Core Usage for Alibi- Seldon Core Ingress Setup with Istio- Custom Kuberenetes version 1.17 (MicroK8S) installation procedure for supporting the deployment of Seldon Core- Installation and access of OpenDistro ElasticSearch/Kibana with Kibana Dashboard Access - Enterprise Version including Multi-Tenancy and Security- Integration and Networking of Kafka Cluster for Remote Access for the DeepStream Server.- Reading Custom Indexes from ElasticSearch Dashboard.- Setup of Monitoring Dashboards for Grafana/Prometheus for CV layer.- Setup of Monitoring Dashboards for Grafana/Prometheus for Data layer.- Setup of Monitoring of Infrastructure and logs using Logstash from ElasticSearch Dashboard.- Pyspark Code integration into adding ETL data from Kafka topic into Cassandra tables- Jenkins-X CI-CD installation and setup for Kubernetes Cluster for running CI-CD pipelines.- Data layer setup using latest versions for Kafka, Apache Spark, Cassandra including any pre-packaged dashboards built-in.- Istio Monitoring and Istio Dashboards for Service Mesh Topology.- Dockerize and Kubernetes versions of React (Frontend) and NodeJS (Microservice) applications for Microservices architecture.- Installation of Apache Pinot for Fast Indexing of Data in the Kafka Data Layer along with Dashboard access.- Data Management and Data Lineage for Data layer and or CV layer using Pachyderm or Apache Atlas- WSO2 API Manager Install/Setup configuration in Kubernetes
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Full Stack Developer
Employement Type: Full time
Contact Details:
Company: TensorGoLocation(s): Hyderabad
Keyskills: Kubernetes Data Science MLOps CI/CD Pipeline Artificial Intelligence Kafka Prometheus Spark Machine Learning Grafana
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in