About this role
About the Role
As an AI Infrastructure / Product Engineer, you will work at the intersection of AI research and product development at a healthtech company building AI products. You will help turn experiments into dependable systems and features, and build ways to measure and improve their quality.
What You'll Do
-
Build repeatable benchmarks and evaluation pipelines to measure model accuracy, hallucinations, retrieval quality, latency, and cost.
-
Create dashboards that make changes in system performance visible to the team.
-
Develop production retrieval, drafting, document, and agent workflows from research prototypes.
-
Build backend services, APIs, and internal tools to help test and release improvements.
-
Deploy and operate cloud infrastructure, including monitoring, databases, delivery pipelines, and reliable operations.
-
Collaborate with AI research while staying connected to product and user needs.
What We're Looking For
-
At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.
-
Strong Python skills and hands-on cloud deployment experience.
-
Experience with APIs, databases, backend services, deployment pipelines, and production monitoring.
-
Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.
-
Ability to turn ambiguous ideas and experimental code into usable, maintainable products.
-
Interest or experience in LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation.
-
Full-stack experience is helpful. Familiarity with FastAPI, Docker, React, Next.js, Postgres, or vector databases is a plus.
Compensation & Benefits
Annual base salary is $180,000 to $260,000 USD, depending on skills, experience, and role scope. Visa sponsorship is not available.
Location
Remote within the United States.