Senior Software Engineer, Foundry IQ - CoreAI

Senior Software Engineer, Foundry IQ - CoreAI

United States, Washington, Redmond

Job description

Company and benefits

Job number

Date posted

Work site 3 days / week in-office

Travel Less than 25%

Profession Software Engineering

Discipline Software Engineering

Role type Individual Contributor

Employment type Full-Time

Overview

The Foundry IQ team is building the next generation of agentic knowledge retrieval combining enterprise knowledge with AI agents at scale.

We are expanding Azure AI Search to address complex queries that require refinement, reasoning, and reflection, delivering high-quality, grounded results for both people and large language models. Our customers span a wide range of industries, data volumes, and mission-critical scenarios.

In this role, you will:

• Design, build, and operate scalable backend services that integrate with internal and external language models.
• Partner closely with Applied Science to turn research advances into reliable production capabilities.
• Develop GPU-backed integrations that support large-scale production machine learning workloads.
• Evaluate end-to-end production systems to ensure the quality, reliability, and performance of AI-powered experiences.
• Advance knowledge retrieval and data-layer AI integration, including RAG, agentic retrieval, and LLM context engineering.
• Determine where advanced reasoning models provide the most value and integrate low-latency models where speed is critical.
• Work directly with customers and partner teams to solve challenging retrieval and AI problems.

You will collaborate with a multidisciplinary team of engineers, applied scientists, and product leaders, as well as teams across Microsoft—including Bing, Fabric, Work IQ, and Microsoft Research. We value diverse perspectives, customer obsession, technical excellence, trust, and close collaboration.

The ideal candidate combines strong distributed-systems experience with practical expertise in machine learning infrastructure, GPU-hosted model integration, and LLM context engineering. You should be comfortable partnering with Applied Science, navigating ambiguous technical challenges, and translating emerging AI capabilities into secure, dependable, and low-latency services at cloud scale.

If you are excited to work at the forefront of AI, improve how customers discover and use knowledge, and build globally distributed experiences on one of the world’s largest cloud platforms, the Foundry IQ team may be the right place for you.

Responsibilities

• Design, build, and maintain Azure backend services and associated APIs.
• Partner with Applied Science to bring high quality prompts, ML models and pre and post processing components into production in a secure, reliable, and scalable way.
• Work directly with GPUs to support production ML workloads at scale.
• Providing evaluation tooling and support of production integrations to ensure end-to-end AI quality of Applied Science deliverables.
• Contribute to team plans, documents, and communication in a clear and efficient way.

Qualifications

• Required Qualifications
• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Other Requirements:

• Ability to meet Microsoft, customer and government security screening requirements are required for this role.