Jobs · Quality Assurance · California

Staff Engineer, Test Automation (R5792)

Shield AI · San Diego, CA · 3 wk ago
On-siteQuality Assurance$150k–$230k/yrFull-time
We need to output HTML fragment with sections:

for headings like About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. We must not repeat job title. We need to preserve all substantive information, remove boilerplate (cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, application instructions). Also remove duplicated lines like the repeated company description at start and later. Also remove social media follow lines, etc. Also remove "Job Description:" line? It's a heading but we can treat as part of content? Probably remove as it's boilerplate. Also remove "Please speak to your talent acquisition representative for more information." etc. Also remove EEO statement. Also remove "If you would like more information about how your data is processed..." etc. Also remove "Temporary employee offer package:" maybe keep? It's about benefits? It mentions temporary benefits package after 60 days. Could be considered benefits info. But we need to include Benefits section only if posting actually states them. The posting mentions "Full-time regular employee offer package: Pay within range listed + Bonus + Benefits + Equity Temporary employee offer package: Pay within range listed above + temporary benefits package (applicable after 60 days of employment)". So there is mention of Benefits and Equity. Also "Military fellows and part-time employees are not eligible for benefits." That's benefits info. So we can include a Benefits section summarizing: Bonus, Benefits, Equity, temporary benefits after 60 days, etc. Also Pay: salary range $150,000 - $230,000 a year. Also Schedule: Full-time regular employee. Also maybe mention "Full-time regular employee offer package". So we can have Pay and Schedule sections. We need sections only when posting has real specific content. We have About the role (maybe from description). Responsibilities (the "What you'll do:" list). Requirements (the "Required qualifications:" list). Qualifications? Could combine Requirements and Qualifications? The posting has "Required qualifications:" and "Preferred qualifications:" So we can have Requirements (required) and maybe Skills? But we could put Preferred qualifications under Skills or Qualifications. The instruction: Use headings for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule). So we can have About the role (summary), Responsibilities, Requirements, Qualifications (maybe preferred), Skills (maybe technical skills?), Benefits, Pay, Schedule. But we need to avoid thin sections. We can combine some. Better: About the role (brief description of team and mission). Responsibilities (the "What you'll do:" bullet list). Requirements (the "Required qualifications:" list). Qualifications (the "Preferred qualifications:" list). Benefits (mention of bonus, benefits, equity, temporary benefits). Pay (salary range). Schedule (Full-time regular employee). That seems reasonable. We must not invent or summarize away detail. Must preserve all substantive information. So we need to include all bullet points from responsibilities and qualifications. Must not omit any. Must not add extra. We need to format lists with
  • . For prose, use

    . For headings,

    . We must not include duplicated lines like the repeated company description. We'll include a short About the role paragraph summarizing the team and mission but must not invent. We can take from the description: "The Hivemind Software Engineering Integration and Test team is seeking a Staff Automated Test Engineer to provide technical leadership for automated verification across our next-generation autonomy platform." That's substantive. Also mention Shield AI mission etc. But we should avoid repeating the earlier duplicated company description. We can include a concise About the role: maybe combine the mission description and team seeking. But we must not invent; we can use the sentences that are present. Let's extract: - "Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide." That's duplicated earlier but it's substantive. We can include it once in About the role. - "The Hivemind Software Engineering Integration and Test team is seeking a Staff Automated Test Engineer to provide technical leadership for automated verification across our next-generation autonomy platform." That's also substantive. We can combine into a paragraph. Now Responsibilities: The "What you'll do:" list includes many items each starting with a verb. We need to preserve each as separate
  • . Let's list them: 1. Own the technical strategy, architecture, and roadmap for automated testing, verification, and MLOps quality across the Hivemind ecosystem. 2. Design and maintain scalable test frameworks for autonomy software, backend services, APIs, operator-facing applications, and distributed hardware environments. 3. Lead functional, integration, regression, system, performance, reliability, and end-to-end testing across simulation, edge-compute, software-in-the-loop, and hardware-in-the-loop environments. 4. Build automated ML validation pipelines covering data quality, training reproducibility, model accuracy, robustness, regression, latency, resource utilization, and system integration. 5. Establish CI/CD and continuous training workflows that provide versioning and traceability for datasets, models, configurations, evaluation results, and deployment artifacts. 6. Develop scenario-based validation for autonomy models, including edge cases, degraded sensing or communications, distribution shifts, and representative mission conditions. 7. Create observability, analytics, and failure-triage capabilities for software behavior, model and data drift, inference health, test results, and production performance. 8. Build Python automation that improves test execution, parallelization, reporting, environment setup, experiment comparison, and developer productivity. 9. Create test harnesses, simulators, stubs, mocks, and synthetic data capabilities that improve system testability and coverage. 10. Collaborate with software, autonomy, machine learning, data, simulation, and systems engineers to define verification strategies and improve designs before implementation. 11. Develop and govern AI-assisted engineering workflows using coding agents and LLM-based tools for test generation, log analysis, debugging, and failure triage while maintaining security, reproducibility, and traceability. That's 11 items. Now Required qualifications: list each bullet. Let's extract: - Typically 8+ years of relevant experience in software engineering, test infrastructure, developer tooling, MLOps, systems integration, or systems verification, or an equivalent combination of experience and demonstrated impact. - 5+ years of experience building scalable automation frameworks or developer tooling in Python. - Demonstrated success designing test, CI/CD, or MLOps infrastructure used across multiple engineering teams. - Experience validating machine learning systems across the data, training, evaluation, packaging, deployment, and monitoring lifecycle. - Understanding of ML quality risks such as data leakage, training-serving skew, nondeterminism, distribution shift, drift, model regression, and statistical acceptance criteria. - Experience defining model-performance baselines, automated evaluation suites, release thresholds, and candidate-to-production comparison workflows. - Experience testing GPU-accelerated infrastructure and workloads, including GPU scheduling, allocation, utilization, and resource contention in Kubernetes environments. - Experience with performance benchmarking, profiling, and observability for GPU workloads, including identifying compute, memory, storage, networking, and data-loading bottlenecks. - Experience validating multi-tenant Kubernetes environments, including RBAC, resource quotas, workload isolation, and scheduling behavior. - Experience qualifying integrated hardware and software systems, including automated validation of compute, GPU, storage, networking, drivers, firmware, and deployed software configurations. - Strong system-design skills and experience testing distributed systems, backend services, APIs, and integrated hardware and software environments. - Experience developing integration and regression strategies for internally developed, third-party, open-source, and partner software, including dependency management, compatibility testing, and upgrades. - Strong understanding of asynchronous and concurrent Python programming for scalable automation and parallel test execution. - Experience with package and dependency management, reproducible environments, and build systems such as Conan, pip, setuptools, Poetry, Nix, or similar. - Experience with automated observability, log collection, analytics, reporting, and root-cause analysis in complex software, data, and infrastructure systems. - Experience working in Linux-based development environments. That's many. Now Preferred qualifications: list each bullet: - Experience with model registries, experiment tracking, dataset or feature versioning, model serving, and automated artifact promotion using MLflow, Kubeflow, Weights & Biases, SageMaker, Vertex AI, or similar platforms. - Experience with GPU scheduling and orchestration platforms such as Run:ai, NVIDIA GPU Operator, KAI Scheduler, Kueue, Volcano, or similar technologies. - Experience with NVIDIA GPU infrastructure, including CUDA, drivers, container runtimes, Multi-Instance GPU, GPU fractionalization, and hardware/software compatibility testing. - Experience with GPU profiling and performance-analysis tools such as NVIDIA Nsight, PyTorch Profiler, or similar technologies. - Experience validating perception, planning, decision-making, reinforcement learning, or other autonomy models in simulation and on deployed systems. - Experience testing models on embedded or edge-compute platforms, including latency, memory, power, accelerator compatibility, quantization, and hardware-specific behavior. - Experience qualifying production servers or appliances, including hardware validation, burn-in, provisioning, firmware, networking, storage, and software-stack validation before deployment. - Experience with reliability, fault-injection, and recovery testing across distributed compute, storage, networking, and GPU infrastructure. - Experience validating reproducible installation, operation, upgrades, and rollback in cloud, on-premises, disconnected, or air-gapped environments. - Experience with containers, Kubernetes, cloud infrastructure, infrastructure as code, and reproducible test environments. - Proficiency with Go or TypeScript for automation tooling or UI test development. - Experience integrating Python with native C or C++ applications through bindings, wrappers, subprocess interfaces, or similar interoperability tooling. - Aerospace, robotics, autonomy, embedded systems, or safety-critical software experience. - Familiarity with software-in-the-loop, hardware-in-the-loop, requirements-based verification, configuration management, artifact traceability, or standards such as DO-178C and MIL-STD-882. Now Benefits: The posting says: "Full-time regular employee offer package: Pay within range listed + Bonus + Benefits + Equity Temporary employee offer package: Pay within range listed above + temporary benefits package (applicable after 60 days of employment) Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits." We can summarize Benefits: Bonus, Benefits (health etc unspecified), Equity, temporary benefits after 60 days, military fellows and part-time not eligible. We must not invent details beyond what's given. So we can list: Bonus, Equity, Benefits (unspecified), temporary benefits package after 60 days, note that military fellows and part-time employees are not eligible for benefits. Pay: "$150,000 - $230,000 a year". Also mention that pay within range listed + bonus etc. But Pay section should contain the salary range. We can also mention that compensation influenced by factors etc. That's substantive. We'll include that as prose. Schedule: "Full-time regular employee offer package". Also mention temporary employee offer package? That's about employment type. We can say Schedule: Full-time regular (with temporary option after 60 days). But we should not invent. The posting says "Full-time regular employee offer package:" and "Temporary employee offer package:" So we can say Schedule: Full-time regular (with temporary employee option). Might be okay. Now we need to output only HTML fragment, no markdown fences. Let's craft:

    About the role

    Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-B

Similar jobs

Test & Automation Engineer

SLAS (Society for Laboratory Automation and Screening)Sunnyvale, CA· 2 mo ago
Quality Assurance$120k–$140k/yrapply on careers.slas.org