LLM Security Evaluation Expert

About the role

SilverEdge Government Solutions is seeking a highly skilled LLM Security Evaluation Expert to join our team. The primary focus of this role is to rigorously test the security and integrity of Large Language Models (LLMs).

Responsibilities

• Design and execute sophisticated adversarial prompt attacks to identify potential vulnerabilities.
• Assess the model's resistance to exploitation and ensure consistent, secure behavior.
• Ensure the AI systems operate responsibly by safeguarding against threats.

Requirements

• TS/SCI with Polygraph level clearance.
• Strong knowledge of LLMs, including their architecture, training processes, capabilities, and limitations.
• Familiarity with prominent LLM families and their common characteristics.
• Proven experience in crafting and refining prompts to elicit specific behaviors or bypass restrictions.
• Demonstrable understanding of techniques such as jailbreaking, prompt injection, role-playing attacks, and exploiting model biases.
• Strong understanding of cybersecurity principles and common attack vectors, especially as they apply to AI/ML systems.
• Ability to think like an attacker and anticipate potential exploits.
• Excellent analytical skills, able to identify subtle vulnerabilities and test hypotheses systematically.
• Clear and concise communication skills, with the ability to document technical findings thoroughly.
• Understanding of the ethical implications of AI security and commitment to responsible testing practices.

Qualifications

Required qualifications include a TS/SCI with Polygraph clearance, strong knowledge of LLMs, familiarity with prominent LLM families, proven experience in crafting and refining prompts, and a demonstrable understanding of various attack techniques and cybersecurity principles.

Skills

• Advanced knowledge of LLMs and their security.
• Experience in adversarial prompt design and execution.
• Strong analytical and problem-solving skills.
• Effective communication and documentation skills.

Benefits

Not specified at this time.

Pay

Not specified at this time.

Schedule

Not specified at this time.

Benefits

Not specified at this time.

Equal Opportunity Employer

SilverEdge Government Solutions, LLC is an Equal Opportunity Employer and applicants receive lawful consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.