Software Engineer in Test

About the role

Roadie, a UPS company, is a leading logistics and delivery platform that helps businesses tackle the complexities of modern retail with unmatched delivery coverage, flexibility, and visibility. Reaching 97% of U.S. households across more than 30,000 zip codes—from urban hubs to rural communities—Roadie provides seamless, scalable solutions that meet a variety of delivery needs. With a network of more than 310,000 independent drivers nationwide, Roadie offers flexible delivery solutions for local same-day delivery, big and bulky items, ship-from-store, and DC-to-door.

Responsibilities

• Build robust test infrastructure that powers automated regression testing for data science microservices
• Troubleshoot and resolve automation issues across multiple environments
• Improve the performance, reliability, and stability of automated test suites
• Develop and execute comprehensive test strategies and high-impact test cases
• Review product requirements to ensure alignment with established design and quality guidelines
• Partner with software engineers and fellow test engineers to conduct end-to-end system testing and post-deployment validation
• Identify, isolate, and clearly document product defects, then verify fixes through resolution
• Champion quality at every stage of the software development lifecycle

Requirements

• 3+ years experience in a developer, SDET, or QA automation role
• 3+ years coding experience in Python preferred; coding/scripting in other languages such as Ruby, Bash, or JavaScript, a plus
• Experience with testing APIs and databases
• Experience in testing frameworks (Pytest preferred)
• Experience with monitoring tools like Grafana, New Relic, or similar
• Experience in CI/CD tools such as CircleCI, GitHub Actions, or similar
• Ability to write and analyze SQL queries
• Experience with cloud solutions such as AWS
• Experience with tools such as GitHub, JIRA, Postman
• Demonstrated background of writing clean, stable, maintainable code
• Strong understanding of testing methodologies and automated testing approaches
• Excellent troubleshooting and communication skills
• Thrives in a fast-paced environment, with ability to operate within short release cycles

Bonus

• Familiarity with performance testing and related tools
• Familiarity with Data Science concepts
• Experience with testing ML models
• Experience with Kafka, Groundcover, Sentry, MLFlow
• Understanding of the full application development lifecycle

Benefits

• Competitive total rewards package
• 100% company-paid health insurance for yourself
• 401(k) with company match
• Tuition & student loan repayment assistance (direct contributions to student loans)
• Remote-first environment
• Unlimited PTO
• Inclusive family leave policy that supports all new parents
• Paid Wellness Days in addition to Company holidays
• Monthly WFH stipend
• Paid sabbatical leave (tenured Roadies are given extra time to unplug, rest, and explore)
• The technology you need to get the job done

This role is not eligible for Visa sponsorship. Applicants must be authorized to work for any employer in the U.S.