About this role
Responsibilities
-
-
Develop and maintain automation frameworks for UI, API, integration and Model Context Protocol (MCP) testing.
-
-
Embed automated test suites into CI/CD pipelines, incorporating quality gates, parallel execution, clear reporting and monitoring for unreliable tests.
-
-
Automate key user journeys, including registration, identity verification, consent management, health record retrieval and data delivery.
-
-
Maintain regression suites, release smoke tests and automated checks of critical production workflows.
-
-
Create synthetic patient data, sample healthcare records and mock external services to support reliable testing.
-
-
Work closely with Product and Engineering to define requirements, refine acceptance criteria and ensure features can be tested effectively.
-
-
Validate authentication, authorisation, consent revocation, access controls and audit trail accuracy.
-
-
Build automated evaluations for AI features, checking accuracy against source records, identifying hallucinations and detecting regressions following model or prompt changes.
-
-
Investigate test failures, document reproducible defects and report quality metrics to inform release decisions.
-
-
Maintain traceable testing evidence to support HIPAA and SOC 2 compliance.
Skillset
Minimum of 4 years’ experience in software testing and automation, including at least 2 years building or significantly extending automation frameworks.
Strong coding skills in TypeScript/JavaScript or Python.
Hands-on UI and API testing experience using tools such as Playwright, Cypress, Selenium, Pytest, Postman/Newman or REST Assured.
A solid understanding of REST APIs, JSON, HTTP and OAuth 2.0/OIDC.
Experience with Git and CI/CD pipelines, using GitHub Actions, Jenkins, GitLab CI or similar tools.
Familiarity with cloud environments, preferably AWS, alongside Docker and containerised services.
Strong attention to privacy, security, data integrity and edge cases, with clear communication skills and a collaborative approach.
Experience with healthcare interoperability standards, health information exchanges or EHR integrations would be an advantage.
Experience testing LLM-powered applications, AI agents or MCP servers would be beneficial.
Exposure to performance testing, observability tools or HIPAA-regulated/SOC 2-audited environments would be a plus.
Benefits
-
- Salary: $140k – $180k.