Senior Software Engineer, Engineering & Operations

Responsibilities

• AI Agent & Automation Engineering
• Design and build internal AI agents and automation workflows using technologies such as LangChain, LangGraph, Snowflake Cortex, LlamaIndex, or similar frameworks, to support planning, tool use, retrieval, validation, and human-in-the-loop execution where appropriate.
• Develop reusable tools, APIs, and components that engineers can compose into new agentic workflows.
• Implement retrieval-augmented generation workflows, context management strategies, and prompt patterns that improve accuracy, reliability, latency, and cost efficiency.
• Agent Evaluation & Reliability
• Build evaluation harnesses, regression tests, and monitoring patterns for AI-agent behavior.
• Define and track metrics such as task completion, groundedness, response accuracy, latency, cost, and failure rate.
• Design guardrails and validation patterns to reduce hallucinations, unsafe outputs, and unreliable automation behavior.
• Partner with engineering and operations teams to move AI workflows from prototype to production-ready systems.
• Software Engineering & Platform Development
• Design, build, and maintain production-grade Python applications, libraries, and services.
• Champion object-oriented design principles, including encapsulation, abstraction, inheritance/composition, reusable interfaces, and clean separation of concerns to improve maintainability and extensibility.
• Champion software engineering best practices including modular design, automated testing, CI/CD, code reviews, observability, and documentation.
• Create reusable engineering patterns that reduce bespoke development effort and improve consistency across partner engagements.
• Collaborate with product, engineering, operations, and data platform teams to translate repeatable business needs into scalable technical solutions.
• Audience & Measurement Productization
• Build reusable Python libraries that support clean room capabilities across first-party audience workflows and core measurement use cases, including audience onboarding, ingestion, indexing, activation, campaign and impression delivery analysis, reach and frequency, attribution, and incrementality.
• Abstract complex analytical and data collaboration workflows into repeatable, self-service components for internal teams and external partners.
• Enable configurable feature deployment so new audience and measurement capabilities can be delivered quickly and consistently across partners.
• Technical Mentorship
• Mentor engineers through code reviews, technical design discussions, and operational best practices.
• Help establish engineering standards for AI-assisted workflows, agentic system design, reusable libraries, and production automation.
• Promote a culture of reliability, maintainability, and continuous improvement.

Qualifications

• Education
• Bachelor’s degree or equivalent practical experience in Computer Science, Information Systems, Software Engineering, Electrical Engineering, Electronics Engineering, or a related technical field
• Software Engineering
• 5+ years of experience building production-grade software using Python, including libraries, services, testing, CI/CD, and code reviews
• AI / LLM Engineering
• Hands-on experience building applications using LLMs, RAG, vector databases, prompt engineering, or frameworks such as LangChain, LangGraph, LlamaIndex, or similar tools
• Agentic Systems / Automation
• Experience designing AI-enabled workflows, reasoning agents, tool-using agents, or complex automation systems
• Data Platforms
• 3+ years of hands-on experience with cloud data platforms such as Snowflake, Databricks, or similar technologies
• Systems Design
• Strong understanding of production system design, including observability, reliability, scalability, performance tuning, and operational support
• Certifications
• Snowflake SnowPro Core Certification, Databricks Certified Data Engineer Associate, or similar cloud/data platform certification
• Additional Requirements
• Full Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee’s residence.
• This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website.
• Salary range: $140,000 - $180,000 (bonus eligible)