QA Engineer

Responsibilities

• Design and execute comprehensive adversarial testing campaigns against AI models, including but not limited to large language models, multimodal systems, and autonomous agents.
• Research attack vectors and prompt injection techniques to identify model vulnerabilities, jailbreaks, and unintended behaviors.
• Evaluate and introduce AI Security tools that decrease mean time to detect and respond to AI-specific threats.
• Collaborate with security teams (e.g., GSOC, member firm security teams, developers) to perform red teaming activities, and document and present findings, vulnerabilities, and remediation recommendations to drive the mitigation of identified risks.
• Create adversarial datasets and benchmarks to evaluate model robustness under various attack conditions.
• Develop and maintain process documentation, create reports on testing activities, track operational metrics, and perform other programmatic tasks as required to support the AI Red Team's function.

Requirements

• Minimum 5 years of penetration testing, red team operations, or AI Red Team experience.
• Computer science, information technology, programming, development, Artificial Intelligence, or cybersecurity degree (Bachelor's or higher preferred) from an accredited college or university or equivalent work experience.
• Background in AI red teaming, red teaming, or offensive cyber operations.
• Understanding of Artificial Intelligence, Machine Learning, software applications, cloud computing, and networking.
• Excellent communication and stakeholder management skills.
• Ability to work effectively across geographies.

Qualifications

Minimum 5 years of penetration testing, red team operations, or AI Red Team experience.

Computer science, information technology, programming, development, Artificial Intelligence, or cybersecurity degree (Bachelor's or higher preferred) from an accredited college or university or equivalent work experience.

Background in AI red teaming, red teaming, or offensive cyber operations.

Understanding of Artificial Intelligence, Machine Learning, software applications, cloud computing, and networking.

Excellent communication and stakeholder management skills.

Ability to work effectively across geographies.

Skills

Minimum 5 years of penetration testing, red team operations, or AI Red Team experience.

Computer science, information technology, programming, development, Artificial Intelligence, or cybersecurity degree (Bachelor's or higher preferred) from an accredited college or university or equivalent work experience.

Background in AI redteaming, red teaming, or offensive cyber operations.

Understanding of Artificial Intelligence, Machine Learning, software applications, cloud computing, and networking.

Excellent communication and stakeholder management skills.

Ability to work effectively across geographies.

Benefits

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy Orion Systems Integrators, LLC And Its Subsidiaries And Its Affiliates (collectively, “Orion,” “we” Or “us”) Are Committed To Protecting Your Privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) Explains What information we collect during our application and recruitment process and why we collect it;How we handle that information; andHow to access and update that information. Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.