Senior Quality & Automation Engineer
Kira · New York, NY · Yesterday
HybridEngineering$150k–$190k/yrFull-time
What You’ll Do
- Ensure a high-quality, reliable experience for teachers and students across web, API, and AI-driven workflows
- Define and evolve our quality strategy across frontend, backend, and AI services
- Design and implement scalable automated testing across end-to-end, integration, regression, and performance layers
- Own performance and load testing for critical workflows, including login surges, classroom activity, assignment submissions, real-time features, and AI services
- Build realistic workload models from production usage patterns, establish performance baselines and capacity targets, and validate that the platform can handle expected traffic before critical launches and peak usage periods
- Diagnose performance bottlenecks across test infrastructure, networks, application services, caches, databases, and third-party dependencies, then partner with engineering teams on remediation
- Evaluate and adopt modern AI-powered tools to accelerate test generation, maintenance, debugging, and coverage
- Partner closely with product and engineering to define clear acceptance criteria and prevent defects early in the development process
- Improve release confidence through stronger CI/CD integration, test observability, and failure diagnostics
- Establish pragmatic quality gates that improve reliability without unnecessarily slowing product velocity
- Lead post-incident quality improvements and help prevent regressions
- Mentor engineers on writing effective, maintainable tests and building testable systems
What We’re Looking For
- 6+ years of experience in quality engineering, test automation, or SDET roles
- Strong experience with modern testing frameworks such as Playwright, Cypress, Jest, JUnit, or PyTest
- Hands-on experience with performance and load testing tools such as k6, Artillery, Gatling, JMeter, or Locust
- Experience designing representative workload models and interpreting latency percentiles, throughput, concurrency, error rates, and resource saturation
- Ability to distinguish genuine application bottlenecks from limitations or unrealistic behavior in the test harness, test data, or load-generation infrastructure
- Familiarity with testing distributed systems, APIs, and database-backed applications
- Experience working in cloud environments, ideally AWS
- Strong debugging skills and the ability to trace issues across multiple layers of a system
- Experience with our stack including Next.js and React frontends, Kotlin and Java Spring Boot backends, Python FastAPI AI services, and LangSmith agent workflows
- Experience defining or improving QA processes in a fast-paced startup environment
- Practical judgment about when to automate, when to test manually, and when to push back
- Clear communication skills across technical and non-technical audiences
- Comfort operating in a fast-moving, high-ownership environment with changing priorities
- High attention to detail and strong product intuition
Nice to Have
- Experience testing AI- or LLM-backed features, including evaluating nondeterministic outputs, prompt regression testing, latency budgets, and graceful degradation when model providers experience issues
- Experience using application performance monitoring, distributed tracing, logs, and cloud infrastructure metrics to identify system bottlenecks
- Experience building internal tooling that improves developer velocity
What Success Looks Like
- Fewer high-severity bugs reaching production
- Greater automated coverage of critical product workflows
- Repeatable performance tests that identify scaling risks before they affect teachers and students
- Clear performance baselines and capacity expectations for peak usage periods
- Faster, more confident releases
- Quality standards that engineers respect rather than bypass
- AI-assisted QA processes that meaningfully reduce manual effort