Test Engineering Leader - Evinova

About the role

Evinova is building AI-native products that are reshaping how clinical trials are designed, documented, and delivered. Our AI-native product suite include Study Designer, Study Document Assistant, AI Document Authoring, and Pipeline Management and put large language models, intelligent automation, and human-centered design directly into the hands of clinical researchers and life-sciences professionals.

Responsibilities

• Shape Testing Strategy for AI-Native Products
  • Design and own end-to-end test strategies—automated and manual—for products that integrate LLMs, generative AI, and complex data pipelines.
  • Develop novel evaluation frameworks for LLM output quality, prompt regression testing, and RAG retrieval accuracy.
  • Select, implement, and continuously improve testing tools and frameworks in collaboration with engineering leadership and platform excellence teams.
  • Drive a measurable shift from manual to automated testing, with clear metrics to track progress.
• Own Quality and Release Readiness
  • Be the single point of accountability for testing across all releases of your two products.
  • Build and maintain automation frameworks and scripts that keep pace with rapid release cycles.
  • Analyse test results, spot trends, and turn data into actionable improvements—not just reports.
  • Prepare release-readiness documentation and quality artifacts that satisfy both internal stakeholders and GxP compliance requirements.
• Lead, Coach, and Build Culture
  • Partner with engineering managers, scrum masters, and delivery leads across squads and geographies to establish a shared quality vision.
  • Lead external contract test engineering squads by influence—setting standards, mentoring team members, and modelling engineering excellence.
  • Champion a quality-engineering mindset: everyone ships quality, not just the test team.
  • Stay hands-on—write test cases, debug failures, and pair with engineers when the situation calls for it.

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Information Science, or a related field (or equivalent practical experience).
• 10+ years of hands-on software test engineering experience across the full stack (UI, API, data).
• Proven ability to lead test strategy and mentor other test engineers—whether through formal management or technical leadership.
• Strong automation skills with modern frameworks such as Playwright, Selenium, or Cypress, plus scripting fluency in Python or a comparable language.
• Solid experience with REST API testing, database validation (PostgreSQL, MongoDB, or similar), and CI/CD-integrated test pipelines.
• A data-driven approach to quality: you define metrics, instrument dashboards, and use evidence to drive decisions.

Preferred

• Experience testing AI/ML-powered products—especially LLM evaluation, prompt testing, RAG validation, or output-quality benchmarking.
• Familiarity with GxP software validation, computerised system validation (CSV), or regulated-industry quality practices.
• Background in life sciences, health-tech, or clinical-trial technology.
• Experience working with geographically distributed teams and external vendor squads.