Data Engineer II
About the role
The Office Product Group (OPG) Data Platform team is building a unified, governed data platform for Office Product Group. The team’s mission is to provide a trusted intelligence backbone that enables OPG teams to deliver business-critical insights, scorecards, dashboards, feature health reports, experimentation intelligence, and AI-ready experiences from a shared source of truth.
We are looking for a Data Engineer II to design and lead the AI and agentic systems that build, operate, and scale a curated OPG data platform—the governed source of truth that experimentation, growth, and Copilot scenario analysis run on. In this role, you will orchestrate and drive the long-term architecture for agents to handle low-level ingestion, transformation, and metric engineering.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Architect the agentic data platform—the AI systems that generate, validate, operate, and scale ingestion, transformation, and serving—so new datasets and metrics are onboarded by orchestration rather than bespoke engineering.
- Own the long-term architecture and durable engineering patterns for the curated data and semantic layer as OPG's governed source of truth across Microsoft Fabric, Kusto/Eventhouse, and OneLake.
- Build the orchestration, guardrails, evaluations, and self-healing observability that let agents run data operations reliably, with engineers supervising outcomes rather than hand-tending pipelines.
- Ground AI-generated reports, narratives, and exports in deterministic, governed data so numbers are never invented.
- Lead architecture and design reviews, raise the engineering bar for applied AI, and partner across experimentation, growth, and app teams to turn ambiguous product needs into durable platform capability.
Requirements
- Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
- OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
- OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Preferred Qualifications
- Experience designing and operating large-scale data platforms, distributed services, or analytics systems.
- Recent experience building AI agentic systems with latest models.
- Deep engineering judgment in data modeling, KQL or SQL, data contracts, CI/CD, observability, reliability, and service operations.
- Ability to partner across engineering, program management, data/applied science, analytics, and app teams to convert ambiguous product needs into durable platform capabilities.
- Demonstrated ability to drive cross-team technical alignment and mentor engineers through architecture, implementation, and operational readiness.
- Familiarity with Microsoft Fabric, Kusto/Eventhouse, OneLake, ADLS Gen2/Delta, semantic models, Power BI, or AI-driven analytics.
Pay
The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. A different range applies to specific work locations, including the San Francisco Bay area and New York City metropolitan area, where the base pay range is USD $133,800 - $219,200 per year. Certain roles may be eligible for benefits and other compensation.