Senior DevOps Engineer

About the role

Design, build, deploy and optimize infrastructure of big data tools like streaming platform clusters (e.g., Kafka, Redpanda) and orchestration tools like Airflow, temporal on Kubernetes and cloud. Implement and harden operational tooling for observability (metrics, logs, traces), incident detection, and automated remediation to reduce MTTR and improve system resilience. Maintain and enhance CI/CD tooling and Terraform scripts to improve the efficiency of deployments and infra automation. Automate infrastructure provisioning using Infrastructure as Code (IaC) to enable repeatable, self-service environment creation for engineering teams. Lead and collaborate with technical, application, and security stakeholders to deliver reliable, secure Big Data infrastructure leveraging tools and platforms. Own and participate in on-call responsibilities for Big Data infrastructure, triaging and resolving incidents, responding to tickets, and ensuring systems consistently meet defined SLAs for availability, performance, and data quality. Mentor engineers on DevOps best practices, helping teams adopt platform capabilities, automation patterns, and operational standards. Define and implement monitoring, alerting, and runbooks to provide end-to-end observability and drive continuous improvement in reliability and operational excellence using tools like Grafana.

Responsibilities

• Own and participate in on-call responsibilities for Big Data infrastructure, triaging and resolving incidents, responding to tickets, and ensuring systems consistently meet defined SLAs for availability, performance, and data quality.
• Mentor engineers on DevOps best practices, helping teams adopt platform capabilities, automation patterns, and operational standards.
• Define and implement monitoring, alerting, and runbooks to provide end-to-end observability and drive continuous improvement in reliability and operational excellence using tools like Grafana.
• Onboard, train, and set up infra for tools by working with vendor teams and external partners so they can effectively support, operate, and extend the solutions owned by the Big Data Infrastructure (BDI) team.
• Drive the technical roadmap for emerging data and infrastructure technologies by evaluating options, building proofs of concept (POCs), and authoring solution selection and design documents.
• Build infra for large-scale data processing tools, analytics, and AI/ML workloads across LiveRamp using tools like Dataproc, Redpanda, Airflow and Temporal.
• Provide secure, self-service, and cost-efficient data environments that enable product and data teams to experiment, ship, and scale data collaboration applications quickly.
• Partner closely with application, security, SRE, and platform teams to ensure data systems meet LiveRamp’s standards for privacy, compliance, reliability, and performance.

Requirements

7+ years of experience in DevOps, Site Reliability Engineering (SRE), or infrastructure-focused software engineering roles supporting production systems.

Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related technical field, or equivalent practical experience.

Significant hands-on experience with at least one major cloud provider (such as AWS, GCP, or Azure) and the associated networking, security, and managed services.

Strong proficiency with Infrastructure as Code tooling (for example, Terraform, CloudFormation, or similar) and configuration management frameworks.

Proven experience designing and operating CI/CD pipelines (for example, GitHub Actions, Jenkins, GitLab CI, or similar) for large-scale, multi-service environments.

Solid background in Linux systems, containers, and orchestration platforms (for example, Kubernetes, ECS, or similar).

Experience implementing observability stacks (metrics, logs, tracing) and using them to improve system reliability and performance.

Proficiency in at least one scripting or programming language commonly used for automation (such as Python, Go, or Bash).

Demonstrated success collaborating with cross-functional engineering teams, with clear written and verbal communication and a focus on practical outcomes.

Ability to participate in an on-call rotation and lead incident response in high-availability, production environments.

Experience in doing POCs by building infra for new tools.

Strong collaboration and communication skills, including working with cross-functional partners (security, application owners, vendors) and documenting designs and decisions clearly.

Qualifications

Experience in working in a DevOps/SRE/Platform team.

3 years of Software Development experience in one of the languages - Python, Go, Java or Scala.

3 years of experience with Linux Operating Systems.

Experience with deployment and monitoring of highly scalable products.

Experience in Infrastructure as code (IaC) using Terraform.

3 years of experience in setting up, managing and optimizing infra tools such as Kubernetes, Jenkins, Spinnaker, Kafka, Airflow, Redpanda and temporal.

3 years of experience using cloud-based platforms such as AWS, GCP, Azure or similar.

3 years of experience with a Version Control System (GIT, Subversion, or similar).

Experience in using AI tools, NLP and agent creation.

Exposure to security and compliance considerations for data platforms (for example, access control, encryption, data governance, and auditing).

Prior experience mentoring engineers, leading technical initiatives, or coordinating work with vendors and external partners.