Agentforce Salesforce Quality Assurance Tester
Cherokee Federal · Almont, CO · 2 mo ago
RemoteRemoteQuality Assurance$100k–$120k/yrFull-time
Responsibilities
- Develop, maintain, and execute comprehensive test plans, test cases, and test scripts across Salesforce configuration, customization, and integration work throughout the release lifecycle.
- Work with government leads and Product Owners to understand acceptance criteria, clarify testing scope, and confirm release timing for new enhancement requests.
- Perform functional, regression, integration, end-to-end, and user acceptance testing (UAT) support across sprints and Salesforce releases.
- Validate declarative configuration and automation, including Flow (record-triggered, screen flows, scheduled flows), approvals, validation rules, page layouts, and Lightning App Builder, ensuring intended behavior and operational accuracy.
- Test custom development, including Apex, Lightning Web Components, and triggers, and perform backend validation using SOQL as needed.
- Validate integrations between Salesforce and external systems (e.g., MuleSoft, REST/SOAP APIs, middleware), confirming data integrity across systems.
- Test Agentforce agents, validating that natural-language utterances select the correct topic and invoke the correct action (Apex action, Flow, or prompt template), including near-miss utterances that should not trigger an action.
- Validate prompt templates built in Prompt Builder for accuracy and proper grounding in source data (e.g., Data Cloud); test for hallucinated, incomplete, or off-topic responses.
- Test agent guardrails and scope adherence, confirming agents decline out-of-scope requests and do not surface data outside authorized boundaries.
- Design and execute agent test cases using Agentforce Testing Center, including batch evaluation against expected outcomes and multi-turn conversation flows.
- Establish evaluation criteria for non-deterministic outputs (grounding, accuracy, completeness) rather than relying solely on exact-match assertions.
- Log, track, and manage defects through resolution using tools such as Jira or Azure DevOps; clearly document reproduction steps, severity, and expected versus actual results.
- Verify data integrity and reporting/dashboard accuracy, including exception paths and operational reporting needs.
- Support Salesforce Public Sector Solutions activities, including release readiness, deployment validation across sandboxes and production, and post-release stabilization.
- Ensure test coverage and QA practices are scalable, maintainable, and aligned with governance, auditability, and compliance expectations in a regulated environment.
- Present formal and informal oral and written briefings to government managers; produce executive-ready test summaries, defect reports, and quality status updates.
- Perform other job-related duties as assigned.
Qualifications
- Bachelor's degree with preferred study in Computer Science, Information Science, Information Systems Management, Math, Statistics, Operations Research, or Engineering and a minimum of four (4) years of experience.
- Six (6) years of work experience in a related field may be substituted for education.
- Demonstrated experience performing QA and testing in an Agile delivery environment, including test planning, test case development, and defect management.
- Proven ability to design and execute test cases from user stories and acceptance criteria, including exception paths.
- Hands-on experience testing Salesforce applications, including declarative configuration and automation such as Salesforce Flow.
- Experience validating custom development (Apex, Lightning Web Components, triggers) and performing backend validation using SOQL.
- Experience testing Salesforce integrations with external systems (e.g., MuleSoft, REST/SOAP APIs).
- Experience with defect-tracking and test-management tools (e.g., Jira, Azure DevOps, TestRail).
- U.S. Citizenship is required.
- Must pass pre-employment qualifications of Cherokee Federal.