Machine Learning Engineer - Inference & Fine-Tuning
- Insaito Software
- 1 - 3 years
- Delhi, NCR
- 1 month ago
- Email to a friend
- Report this job
Job Description
Get hired by a US-based company focused on the US, UK, and European markets. This would include travel to the US office located in California.
What we're looking for
We are looking for a talented Machine Learning Engineer to lead the development of an Inference Service built on open-source technologies. You will design, deploy, and fine-tune machine learning models in the cloud using frameworks like Hugging Face, TensorRT, PyTorch, and other open-source tools. The ideal candidate has hands-on experience building scalable inference services, fine-tuning pre-trained models, and working with cloud-native infrastructure.
In this role, you'll work on exciting machine learning applications spanning NLP, computer vision, and custom tasks all with a focus on efficient deployment and real-time inference. If you're passionate about open-source technologies and cloud-based ML infrastructure, this is the perfect role for you!
Responsibilities
- Build and optimize a scalable inference pipeline using popular open-source frameworks (e.g., TensorRT).
- Design real-time API endpoints for model serving and integration using frameworks like Flask.
- Implement and optimize batch processing and streaming data pipelines to handle large-scale workloads.
- Fine-tune pre-trained models (e.g., Llama, GPT, YOLO).
- Deploy inference services on cloud platforms (GCP, AWS, Azure) using a containerized environment with Docker and Kubernetes.
- Continuously optimize models for latency and throughput, troubleshooting bottlenecks.
Qualifications/ Required Skills and Experiences
- Educational Background:
- Bachelor's or Masters degree in Computer Science, Engineering, Data Science, or a related field, or equivalent practical experience.
- Experience:
- 3+ years of hands-on experience deploying machine learning models into production, focusing on inference services and fine-tuning.
- Proficiency in Python or C/CC+.
- Proven track record in creating high-performance libraries and tools.
- Proficiency in model serving frameworks such as TensorRT.
- Strong grasp of low-level OS concepts, including multi-threading, memory management, networking, storage, performance, and scalability.
- Soft Skills:
- Excellent communication skills with the ability to explain complex ML concepts to both technical and non-technical stakeholders.
- Strong problem-solving and debugging skills, with the ability to analyze and resolve performance issues in production environments.
- Comfortable working in an Agile environment and collaborating across teams to deliver results.
Job Classification
Industry: Software ProductFunctional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Machine Learning Engineer
Employement Type: Full time
Contact Details:
Company: Insaito SoftwareLocation(s): Delhi, NCR
Keyskills: Artificial Intelligence Computer Science Machine Learning
Similar positions
Insaito Software
Insaito, based in Silicon Valley, California, combines deep domain expertise with proven experience to deliver cutting-edge silicon solutions. We are driven by the passion for building silicon, software, and platform solutions for Next-Gen technologies such as advanced AI, 5G/6G, and autonomous sys...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in