Microsoft's bold vision of Azure Machine Learning (ML) is to democratize ML and make it available to every enterprise,developer,and data scientist. Do you want to join a team entrusted with serving all internal and external ML workloads We are already serving billions of requests per day on the most cutting-edge scenarios and models across the company. You will be joining the Inference team that is working on the next generation of model serving that includes model ensembles, FPGA/GPU/ASIC support, hosting millions of models/machinesto save on COGS, and many exciting problems on the intersection of AI and Cloud. We are looking for a strong Software Engineer who is passionate about designing and building highly reliable, available platform to support model inferencing at scale. You will also be expected to work on high throughput/low latency scenarios and drive performance optimization capabilities.
Engage directly with key partners to understand and implement complex inferencing capabilities including managing large scale multi-tenant inferencing platform.
Anticipate, identify, assess,track,and mitigate project risks and issues in a fast-paced start up like environment.
Drive thought leadership, architecture and high scale, complex graph topologies, high throughput, low latency inferencing.
required:
a bachelors or master's degree in computer science, or a related field, or equivalent alternative education, skills, and/or practical it work experience is required.
3+ years of hands-on engineering experienceas engineerworking through the full product cycle from initial architecture design to final product delivery and support.
preferred:
platform and capability development experience in azure/cloud strong plus.
experience in developing low latency systems.
experience in developing and operating high scale, reliable online services.
knowledge and experience in oss, docker, kubernetes, .net, c#, java, python or equivalent programming languages
experience with ml platforms and frameworks
experience in distributed computing
good communication, collaboration skills and a great team player #aiplatform #op***i@***