System Engineer

About the role

Join a high-impact, mission-driven team as Lead Systems Engineer, where you will help manage the stability, security, and scalability of systems powering complex data transformation workflows and a widely used web-based user interface. Embedded within a broader engineering organization of 25+ developers, you will lead a small, agile DevOps/SysAdmin team responsible for end-to-end infrastructure, from bare-metal and AWS environments to Kubernetes deployments. This mature project is known for its technical stability, team cohesion, and deep integration into mission-critical systems, offering you the opportunity to make meaningful contributions in a fast-paced, collaborative environment.

Responsibilities

• Lead, mentor, and direct the daily tasks of two system administrators
• Collaborate with and support the larger team of 25+ software engineers
• Provide guidance, advice, and assistance for overall system design and setup, in conjunction with software engineering teams
• Maintain system platforms and health of all servers (EC2, MASH, bare metal), production systems, development environments
• Oversee system maintenance, security, and SSP accreditations
• Observability of the system, e.g. automation, monitoring, alerting, backup, and disaster recovery strategies for all development, staging, and production environments
• Maintain deployment automation process (e.g. CI/CD in GitLab)
• Ensure system documentation is up to date and conduct regular technical reviews and post-mortems to drive continuous improvement in team operations
• Maintain base Linux kickstart images (RHEL9)

Requirements

• TS/SCI Clearance with polygraph
• 12 years of experience with a B.S. in a technical discipline or 4 additional years in place of B.S.

Skills

• Strong Linux system administration experience (e.g., RHEL9)
• Proficient in system automation and scripting tools such as Ansible (including Semaphore), Terraform, Packer, Bash, and Python
• Knowledge of SSP compliance and processes, including STE/STN
• Experience with containerization such as Podman and Kubernetes
• Amazon AWS experience (setting up EC2 instances, S3 buckets, VPCs, IAM)
• Metrics and observability with Kibana, Grafana, and Prometheus
• Familiarity with database administration with databases such as Elasticsearch, MongoDB, Redis, or graph databases (e.g. DGraph)

Nice to Haves

• Nifi dataflow experience
• Elastic stack experience (logstash, filebeat, etc.)
• Graph database experience
• Experience with other AWS tools such as EKS, ECS, Lambdas, and Secrets Manager
• CI/CD in GitLab
• CNO experience
• Experience facilitating low-to-high development
• Cisco networking experience

Benefits

• 8 weeks paid leave: 4 weeks of personal leave, 3 Yay! days, take off on your birthday, 11 paid holidays, and optional leave up to 6 days through Belay's volunteer program
• 10% matching in 401(k) contributions vested on day one
• $5,000 annual training/tuition
• Student Loan Repayment Program
• 100% company-funded HSA
• Rich medical coverage (100% coinsurance)
• Dental coverage including orthodontia
• Up to $420,000 in life insurance, premiums 100% company funded
• Amazon Prime, gym reimbursement, monthly lunches, games and prizes
• Pet adoption program, generous referral bonus program, fun events, and more

Pay

Salary Range: $168,000 to $240,000