Engineering - DXR Engineering - Senior Scheduling Platform Production Engineer - Dallas - Vice President

Responsibilities

• Proactively identify operational risks, capacity concerns and reliability gaps; propose and implement remediation without requiring close supervision.
• Continuously refine runbooks, tooling and automation to reduce manual toil and improve platform reliability.
• Build observability for new deployments to ensure robustness.
• Work closely with development team to ensure observability is built in from the start.
• Lead real-time outage investigations, write and present postmortems to senior management.
• Define SLIs and SLOs and partner with development teams to ensure system are well designed and live up to our SLAs.
• Communicate well and work efficiently with remote colleagues in other regions.
• Provide regional coverage for the Procmon platform, including participation in an on-call rotation and acting as the escalation point for user queries and L3 escalations.

Requirements

• Extensive experience (8+ years) in DevOps or Production Engineering, with expertise in architecting, deploying, and scaling distributed computing systems.
• Excellent problem-solving and automation skills, leveraging real-time monitoring and alerting tools like Prometheus for proactive incident detection and automated response, and utilizing data analysis and Grafana for historical data visualization, deep-dive root cause analysis, and automated operational reporting.
• Deep knowledge of Linux operating systems and system administration.
• Good networking fundamentals (familiarity with TCP/IP, IP routing, firewalls, secure tunneling protocols).
• Experience working with distributed computing systems and Cloud computing within enterprise environments.
• Proficiency in at least one programming language; the team uses a mix of Go, Shell, Python and Erlang.
• Able to operate effectively in a mission critical, highly regulated financial services environment.
• Strong communication skills, able to explain complex technical issues clearly to both technical and non-technical users.
• Previous experience with supporting and mentoring junior team members and interns is a plus.