Senior AI/ML Engineer

Senior AI/ML Engineer

Role overview

Svitla Systems Inc. is looking for a Senior AI/ML Engineer for a full-time position (40 hours per week) in Ukraine. Our client develops comprehensive solutions in such services as enterprise software implementation, custom software development, data automation, security and compliance, cloud migration, and business strategy. You'll own the framework layer for our AI platform, including LLM observability, prompt versioning, A/B testing, evaluation frameworks, model/data drift monitoring, and production AI operations. The perfect candidate will also bring experience building agentic or copilot-style applications that generate emails, texts, call scripts, and other AI-assisted content grounded in enterprise knowledge and controlled for tone and accuracy. This is a 18 weeks contract engagement — a focused, fixed-term project, with a possibility of extension based on performance and business needs. Role requires a daily working-hours overlap with the client's team until 8:00 PM (Kyiv time).

Responsibilities

• Build and maintain LLM observability and monitoring infrastructure.
• Implement prompt versioning, testing, and A/B experimentation.
• Develop evaluation frameworks for LLM and RAG performance.
• Monitor model drift, data drift, hallucination risk, and output quality.
• Establish LLMOps/MLOps best practices and production workflows.
• Support integrations with APIs, databases, vector stores, and enterprise applications.
• Build or enhance agentic/copilot experiences using modern agent frameworks.
• Ground AI outputs in knowledge-base content and structured data.
• Implement tone, voice, personalization, and guardrail controls.

Requirements

• Strong experience with Python.

• Experience with LLM and/or RAG systems in production.

• Knowledge of Langfuse, LangSmith, or similar LLM observability platforms.

• Understanding of prompt versioning and prompt management.

• Experience with A/B for prompts, models, retrieval strategies, or AI workflows.

• Understanding of model monitoring, data drift, or model drift monitoring.

• Experience with MLOps, LLMOps, or AI observability.

• Production engineering mindset.

• Nice to have

• Experience with agent frameworks such as LangGraph, CrewAI, AutoGen, or LangChain Agents.

• Experience developing agentic AI or copilot-style experiences.

• Familiarity with vector databases (Pinecone or similar).

• Experience with Grafana, Prometheus, or other monitoring tools.

• Experience with Dagster or comparable orchestration tools.

• Hands-on use of the OpenAI API, Anthropic API, or comparable LLM APIs.

• Experience with knowledge-base grounding and hallucination-reduction techniques.

• Experience implementing tone and voice control in generated outputs.

• Familiarity with MySQL, S3, and Parquet.

• Experience with PHP integrations

Responsibilities

• Build and maintain LLM observability and monitoring infrastructure.

• Implement prompt versioning, testing, and A/B experimentation.

• Develop evaluation frameworks for LLM and RAG performance.

• Monitor model drift, data drift, hallucination risk, and output quality.

• Establish LLMOps/MLOps best practices and production workflows.

• Support integrations with APIs, databases, vector stores, and enterprise applications.

• Build or enhance agentic/copilot experiences using modern agent frameworks.

• Ground AI outputs in knowledge-base content and structured data.

• Implement tone, voice, personalization, and guardrail controls.

• Why join Svitla

• Svitla Systems is a global digital solutions company headquartered in the U.S. and operating across the Americas, Europe, Asia, and APAC. Since 2003, we have served a wide range of clients - from innovative start-ups to Fortune 500 companies. Our success is built on partnership. By integrating seamlessly with clients' teams, we create lasting collaborations that drive real results. We are strong advocates of workplace flexibility, remote culture, individual approach to professional and personal growth.

• Our global mission is to build a business that contributes to wellbeing of our partners, personnel, and their families, improves our communities, and makes a lasting difference in the world. Together, we are coding a brighter tomorrow - and living it.

• Join us!

• Similar Jobs

• SENIOR MACHINE LEARNING ENGINEER

• UkraineUkraine

• RemoteRemote

• Staff Software Engineer (AI Analytics)

• UkraineUkraine

• RemoteRemote

• Staff Software Engineer (AI Analytics)

• EuropeEurope

• RemoteRemote

• Senior MLOps Engineer with ML/AI

• PolandPoland

• RemoteRemote

• Senior DevOps Engineer with ML/AI

• PolandPoland

• RemoteRemote

• Senior DevOps Engineer with ML/AI

• RomaniaRomania

• RemoteRemote

• ML DATA SCIENTIST

• ArgentinaArgentina

• RemoteRemote

• ML DATA SCIENTIST

• Costa Rica | ColombiaCosta Rica|Colombia

• RemoteRemote

• SENIOR AI ENGINEER

• Argentina | Colombia | Costa RicaArgentina|Colombia|Costa Rica

• RemoteRemote