Senior Software Engineer (AI Systems Performance)

Senior Software Engineer (AI Systems Performance)

Project description

A leading semiconductor and high-performance computing company is looking for a software engineer who is passionate about Distributed Inferencing on GPUs and improving the performance of key applications and benchmarks. You will be a member of a core team of incredibly talented industry specialists and will work with the very latest hardware and software technology

Responsibilities

• We are seeking a software engineer with strong technical expertise in C++/ Python development, solving performance and investigating scalability on multi-GPU, multi-node clusters. He is also passionate about quality assurance, benchmarking, and automation in the AI/ML space. The ideal candidate thrives in both collaborative and independent environments, demonstrates excellent problem-solving skills, and takes ownership in defining goals and delivering impactful solutions.

KEY RESPONSIBILITIES

• Distributed AI Enablement and Benchmarking: Enable and benchmark AI models on large-scale distributed systems to evaluate performance, accuracy, and scalability.

• Scalable Systems Optimization: Optimize AI workloads across scale-up (multi-GPU), scale-out (multi-node), and scale-across distributed system configurations.

• Cross-Team Collaboration: Collaborate closely with internal GPU library teams to analyze and optimize distributed workloads for high throughput and low latency.

• Parallelization Strategies: Develop and apply optimal parallelization strategies for AI workloads to achieve best-in-class performance across diverse system configurations.

• Model Infrastructure and Management: Contribute to distributed model management systems, model zoos, monitoring frameworks, benchmarking pipelines, and technical documentation.

• Performance Monitoring and Visualization: Build and maintain real-time dashboards reporting performance, accuracy, and reliability metrics for internal stakeholders and external users.

Skills

• Must have

PREFERRED EXPERIENCE:

• AI Framework Engineering: Hands-on experience with AI inference or serving frameworks such as vLLM, SGLang, and Llama.cpp.

• KV Cache and Expert Parallelization: Understanding KV cache transfer mechanisms and technologies (e.g., Mooncake, NIXL/RIXL) and expert parallelization approaches (e.g., DeepEP, MORI, PPLX-Garden).

• Programming and Software Design: Strong C/C++ and Python skills, with experience in software design, debugging, performance analysis, and test development.

• Large-Scale Distributed Systems: Experience running AI workloads on large-scale, heterogeneous compute clusters.

• Cluster and Orchestration Systems: Familiarity with cluster management and orchestration platforms such as SLURM and Kubernetes (K8s).

• Development Tools and Workflows: Experience with GitHub, Jenkins, or similar CI/CD tools and modern development workflows.

• Nice to have

ACADEMIC CREDENTIALS:

• Master’s or PhD degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.

• Other

• Languages

• English: C1 Advanced

• Seniority

• Senior

• Luxoft Benefits*

• Relocation options

• Experience in an international environment

• Cross-cultural experience

• Feedback culture

• Regular appraisals

• Annual holiday - 20 or 26 days. The duration of the leave depends on the overall seniority

• Occasional leave - 1 or 2 days/ depending on the circumstances

• Child care leave - 2 days or 16 hours per year

• Absence due to force majeure - 2 days or 16 hours per year

• Maternity Leave - 20 weeks

• Parental Leave - 41 weeks

• Paternity Leave - 14 days

• Expert-led tech courses covering basic to advanced topics

• Internal instructor-led soft skills courses

• Comprehensive in-house self-learning resources for both soft and hard skills

• Access to external self-learning libraries like ProQuest eBook and Udemy for Business

• Cloud Programs: MS Cloud Academy, AWS Partner Academy, Google Cloud Academy

• Custom Learning Programs: upskilling, reskilling, technical mentorship

• Leadership Programs for Managers

• Multisport card

• Possibility to order Multisport card at the corporate rate for family members

• LuxGood Program: wellbeing seminars, contests, relaxation sessions, yoga sessions, etc.

• One Team Program: Buddy for each New Joiner; seminars, meeting and workplace space to support integration with local community and culture; “Hire me” workshops for partners

• Preferential banking offer

• Preferential car leasing offer

• Cafeteria program discounts for shops, cinema tickets, holiday offers

• Luxoft Social Benefit Fund: sport and recreation benefits, the possibility to receive financial support

• Private Healthcare Insurance with unlimited access to specialists

• Full dental support

• Travel Insurance

• Possibility to add private healthcare coverage for family members at the corporate rate

• Life insurance at the corporate rate for employees and family members, including payment of the basic package for the employee by the employer

• Reimbursement for corrective glasses

• Many fun social activities organized by the Luxoft team offline in your city

• Online entertainment events for whole company and local team events

• A workplace where you’re treated with respect within a multicultural team

• Rotation between projects and accounts

• New career opportunities

• The acquisition of rights to the above benefits depends on the form of cooperation. Benefits apply to those employed under a contract of employment.

• Please note that relocation is not available for all open positions. At Luxoft Poland it is possible to work remotely only from the territory of Poland.

• Options offered by the Polish government.

• Remote Poland, Poland

• Req. VR-125691

• C/C++

• Automotive Industry

• 26/10/2026

• Req. VR-125691

• Apply for Senior Software Engineer (AI Systems Performance) in Remote Poland

• Indicates a required field

• First name

• Last name

• Email

• Your country

• Your City

• Phone

• Specialization

• Attach your resume (max file size 1MB; allowed extensions: doc, txt, pdf, docx)

• Upload resume

• Number of years of experience in the specialization you are applying for

• What are your monthly gross salary expectations?

• Read Explanatory Notes

• Under the terms of your specific consent or to perform our obligations under a contract with you, as applicable, we, Luxoft Holding Inc. will manually and electronically process your personal data, specifically your first name, last name, phone number, e-mail address and other data you provide us through this form.

• Within this context, we process personal data only for the specific purpose(s) indicated in the individual consent language or other notices provided below.

• We will – insofar as reasonably necessary for the purpose you have agreed to and within the scope of applicable laws – transfer your personal data to other entities within the Luxoft Group and to the group of third party recipients listed in our Privacy Notice. Such Recipients can be located outside the European Union (EU) and/or the European Economic Area (EEA) (“Third Countries”). The Third Countries concerned, e.g. the USA, may not have the level of data protection that you enjoy e.g. under the GDPR. This can result in disadvantages such as an impeded enforcement of data subjects’ rights, a lack of control over further processing and access by state authorities. You may only have limited legal remedies against this. Insofar our transfer of your personal data to recipients in Third Countries is not covered by an adequacy decision of the EU Commission, we achieve an adequate level of data protection as further detailed out in our Privacy Notice.

• With your consent, we personalise marketing communications to you by way of carrying out marketing research analysis, analysing the surfing-behaviour of our website visitors and to adjust it to their detected tendencies, as well as to plan more efficient future marketing activities. This personalised marketing does not include any automated decision-making activities.

• Further information on how we process personal data in general is available in our Privacy Notice. You may withdraw any given consent at any time. The withdrawal of your consent(s) will not affect the lawfulness of processing before its withdrawal. For any request in this context, please e-mail us at: [email protected].

• Before uploading CV or any other information to this website, to learn more about your obligations and restrictions arising from the use of this website, please read our Terms of Use.

• By clicking the Agree and Send button, you consent that Luxoft Holding Inc. can process your provided personal data for the purpose of processing your application to establish a potential employment, internship or relocation with Luxoft Holding Inc., a relevant affiliate of the Luxoft Group or Luxoft Group’s clients, as applicable. You consent to the retention of your personal data, with the purpose of contacting you for potential future employment opportunities. If you ref