QA, SDET & Test Automation Engineer | $60/hr | Remote

QA, SDET & Test Automation Engineers. Remote AI Evaluation Project We are seeking experienced Software Engineers, QA Engineers, SDETs, Test Automation Engineers, and Web Testing Professionals to review browser-based testing workflows for AI-generated web applications. You will determine whether automated browser tests are technically correct, reliable, reproducible, and capable of producing clear pass or fail results. What You’ll Do Review automated browser tests for AI-generated web applicationsValidate whether browser actions and test workflows are technically feasibleAssess test setup, fixtures, isolation, execution order, and cleanupConfirm that assertions produce deterministic and unambiguous resultsIdentify flaky tests, race conditions, timing issues, hidden dependencies, and weak validation logicDebug failing or unreliable browser automation workflowsProvide structured technical feedback using project review criteria Who Can Apply Relevant backgrounds include: QA Engineers, Senior QA Engineers, Quality Assurance Engineers, Software Development Engineers in Test, SDETs, Test Automation Engineers, Automation QA Engineers, Software Test Engineers, Web Test Engineers, UI Automation Engineers, End-to-End Test Engineers, E2E Test Engineers, Browser Automation Engineers, Quality Engineers, Software Quality Engineers, and Technical QA Analysts. We also welcome: Software Engineers, Full-Stack Engineers, Frontend Engineers, Backend Engineers, Web Developers, Application Engineers, Developer Productivity Engineers, DevOps Engineers, Release Engineers, Build Engineers, Continuous Integration Engineers, Test Infrastructure Engineers, Test Framework Engineers, Reliability Engineers, Platform Engineers, and Developer Tools Engineers with strong automated testing experience. Additional relevant roles include: QA Leads, Test Leads, Automation Leads, QA Architects, Test Architects, Quality Engineering Managers, Software Testing Consultants, Performance Test Engineers, Regression Test Engineers, Integration Test Engineers, API Test Engineers, Acceptance Test Engineers, Validation Engineers, and Verification Engineers. Relevant Tools and Technologies Experience with one or more of the following is valuable: Playwright, Cypress, Selenium WebDriver, Puppeteer, WebdriverIO, TestCafe, Appium, Jest, Mocha, Vitest, Jasmine, Cucumber, Robot Framework, PyTest, JUnit, NUnit, TestNG, BrowserStack, Sauce Labs, LambdaTest, GitHub Actions, Jenkins, CircleCI, GitLab CI, Docker, JavaScript, TypeScript, Python, Java, C#, or similar testing technologies. Relevant Experience Browser automation and modern web application testingAutomated UI, functional, integration, regression, and end-to-end testingTest fixtures, mocks, test data, environment setup, and teardownTest isolation, reproducibility, idempotency, and deterministic executionDebugging flaky tests, asynchronous behavior, race conditions, and timing failuresValidating DOM elements, navigation, forms, authentication, APIs, and application stateCross-browser and cross-platform testingContinuous integration and automated test executionWriting clear assertions and reliable pass or fail conditions Requirements 3+ years of professional experience in software engineering, QA engineering, SDET, software testing, or test automationStrong experience testing modern web applicationsHands-on experience with Playwright, Cypress, Selenium, Puppeteer, or a similar browser automation frameworkExperience writing automated UI or end-to-end testsStrong understanding of fixtures, test isolation, reproducibility, assertions, and reliable browser automationExcellent debugging, technical reasoning, and attention to detailAbility to provide clear and structured written feedback Preferred Experience Designing or maintaining test automation frameworksReviewing test code written by other engineersTesting AI-generated applications or dynamically generated user interfacesExperience with CI/CD pipelines and cloud-based testing platformsExperience evaluating benchmark tasks, technical rubrics, or software quality standardsPrior experience with AI evaluation, data annotation, human feedback, or model testing projects This opportunity is ideal for professionals who can quickly identify whether a browser test is reliable, technically valid, and suitable for use in a high-quality software benchmark. We are a referral partner of the client