About this role
Microsoft is hiring for Senior/Principal AI Optimization Software Engineer (multiple roles) on the AI Frameworks Group, based in Israel (multiple locations), working 3 days/week in-office with 25-50% travel. The AI Frameworks Group builds the software foundation that lets Microsoft deploy and run AI models efficiently across a rapidly evolving set of hardware platforms, aiming to make every relevant AI model run as efficiently as possible on every Microsoft AI accelerator.
This role focuses on pushing the limits of AI performance through ML algorithm innovation, advanced AI compilation and hardware optimization, runtime and serving optimizations, and innovations in distributed execution, working across the AI software stack with model, systems, compiler, and hardware teams. Responsibilities include leading by example and mentoring others on producing extensible, well-tested, performant code; conducting and leading code reviews for quality, security, and best practices; owning architecture and design discussions for complex product/solution areas, including evaluating design options and creating design documents; identifying and incorporating dependencies across teams; driving engineering excellence through tooling, automation, and staying current with industry trends; and collaborating with partner teams on end-to-end testing, scalability, and DRI escalation.
Required qualifications: Bachelor's degree in Computer Science or related technical field, 6+ years of technical engineering experience coding in C++ and Python, and at least 2 years of experience designing and implementing AI kernels, AI optimization algorithms, or AI compilation techniques. Preferred: Master's degree in Computer Science or related field, and deep expertise in areas such as quantization, sparsity, speculative decoding, graph optimization, operator fusion, code generation, inference serving, batching and scheduling, or caching.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until filled.