About this role
About the Role LiteLLM is building the next generation of infrastructure for AI applications, and this role focuses on product engineering to ship features developers actually use. You will work directly with the founders to understand developer needs and shape the product roadmap.
What You'll Do
- Build new product features from concept to production.
- Work directly with customers to understand pain points and validate solutions.
- Ship quickly while maintaining a high quality bar.
- Prototype new ideas and iterate based on user feedback.
- Own major product areas and continuously improve them over time.
- Design backend APIs and services using Python and FastAPI.
- Build intuitive developer experiences across our API, dashboard, and CLI.
- Collaborate directly with the founders on product direction and technical decisions.
- Help define and build LiteLLM's second major product.
What We're Looking For
- Bachelor's or Master's degree in Computer Science or a related field.
- Strong software engineering fundamentals.
- Experience building production software, preferably with Python.
- Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
- Strong product intuition and curiosity about how customers use software.
- Excellent written and verbal communication.
- High ownership—you naturally identify problems and solve them without waiting to be asked.
- Comfortable operating in ambiguity and making decisions with incomplete information.
- Excited by shipping quickly and learning from real users.
Nice to Have
- Experience at an early-stage startup.
- Experience building developer tools or infrastructure products.
- Open source contributions.
- You've built and launched your own product.
- Familiarity with AI infrastructure, LLMs, or developer platforms.
Compensation & Benefits
- Salary: $170,000-$230,000 per year.
- Benefits include health, dental, and vision; equity; and more.
- Work directly with the founders; see impact in production.