Principal Engineer, DevEx
Yahoo · United States · Yesterday
RemoteRemoteEngineering$144k–$299k/yrFull-time
Job Description
We are seeking a Principal Developer Experience Engineer to lead the modernization of the CI/CD portion of our internal developer platform. The immediate focus is a high-scale migration: moving ~30,000 pipelines to GitHub Actions, with a target of 100% migration by the end of the year and ensuring that all new repos/apps start on GitHub Actions by default.
What you’ll do
- Build and operate an agentic migration system to GitHub Actions
- Design an agentic AI automation that can translate and migrate pipelines to GitHub Actions workflows
- Automate PR creation and iteration
- Build “safe at scale” operations: migration batching, progress tracking, exception queues, rollback strategies, and clear ownership boundaries
- Establish evaluation/quality loops for the agent: regression tests, correctness checks, policy checks, and measurable success criteria (not just “it looks right”)
- Establish GitHub Actions governance + the CI/CD paved road
- Define governance for GitHub Actions at enterprise/org scale
- Build and maintain reusable workflows
- Define Artifactory best practices and standard integrations
- Standardize how CI publishes and consumes artifacts with secure defaults and consistent metadata
- Maintain conventions that scale (including repository naming/constraints and guardrails)
- Define when to use GitHub-hosted vs self-hosted runners and document the default paths
- Partner with infra/security where ownership sits elsewhere, but be accountable for the end-to-end developer experience
- Enable app teams through office hours, migration support, design-partner engagements, and iterative improvements to reduce friction
- Treat CI/CD as a product: measure adoption, reliability, and developer satisfaction - and iterate based on data
Success Criteria
- 100% of Screwdriver pipelines migrated to GitHub Actions by end of year, with transparent burn-down tracking and a stable landing zone
- All new repos/apps start on GitHub Actions using approved templates and reusable workflows
- Clearly defined governance for allowed actions/workflows, plus scalable guardrails and upgrade paths
- Consistent Artifactory usage for containers + npm (publish/consume patterns, permissions, retention), reducing break/fix and “tribal knowledge”
- Tangible DX improvements: faster time-to-green, fewer flaky failures, fewer support tickets, and predictable CI costs
Minimum Qualifications
- Practical experience building LLM/agentic AI systems where correctness, guardrails, and evaluation matter (not just ad-hoc prompting)
- Senior-level experience building production-quality systems, platform tooling, or internal developer platforms
- CI/CD expertise: pipeline design, troubleshooting, reliability improvements, and rollout/migration planning
- Hands-on GitHub Actions experience including reusable workflows and enterprise/org governance considerations
- Experience with artifact repositories and release flows; JFrog Artifactory strongly preferred
- Strong written communication for internal docs, templates, and playbooks
- Bachelor's degree or equivalent work experience
Preferred Qualifications
- Experience migrating at scale between CI systems (GHA/Jenkins/GitLab CI/Circle/etc.)
- Experience building automation that interacts with GitHub at scale (repo scanning, PR bots, policy validators)
- Security-minded CI/CD experience (pinning actions, least-privilege defaults, secrets hygiene, runner boundaries) in partnership with security