Data Platform Engineer, VP II - State Street Investment Management

About the role

The team you will be joining is a part of State Street Investment Management, one of the largest asset managers in the world. We partner with many of the world’s largest, most sophisticated investors and financial intermediaries to help them reach their goals through a rigorous, research-driven investment process. With over four decades of experience and trillions of dollars in assets under management, we offer one of the broadest selections of services across asset classes, risk profiles, regions and styles. As pioneers in index, ETF, and ESG investing, we are always inventing new ways to invest.

Why this role is important to us

This role is critical to the success of the investment management business. The successful candidate will lead the architecture, engineering execution, modernization strategy, and technology roadmap supporting the investment management business. The role requires deep hands-on expertise in large-scale data platform architecture, distributed computing, data pipeline engineering, and modern cloud architecture.

What You Will Be Responsible For

• Execute the long-term vision, target architecture, and roadmap for a unified, cloud-native data platform spanning ingestion, transformation, storage, governance, and secure access at scale.
• Collaborate with enterprise and application architects to define data strategies and deliver logical/physical data models aligned to analytical workloads.
• Collaborate on the core platform capabilities (Lakehouse, batch, events, streaming, metadata/catalog, observability, and security), ensuring reliability, scalability, and operability.
• Design, implement, and optimize Iceberg-based tables (partitioning, compaction, metadata) for consistent, performant analytical access across multiple compute engines.
• Establish data engineering excellence: CI/CD, IaC (Terraform/CloudFormation), automated testing, schema/versioning practices, data quality controls, and end-to-end observability.
• Partner with Product, Analytics, ML, and domain SMEs to define data semantics and data product contracts (schemas, SLAs, documentation, versioning/backward compatibility), and enforce governance, stewardship, and compliance standards.
• Build and publish curated semantic layer models (serving models/marts), exposing governed BI endpoints and/or consumption APIs to ensure consistent metrics and business definitions.
• Optimize pipeline and query performance through effective partitioning/clustering, caching, archiving, and data lifecycle (purge/retention) patterns.
• Evaluate and advance the use of agentic AI frameworks to improve software delivery across the full software development life cycle (SDLC).

Required Qualifications

• Master’s degree in Computer Science or a related engineering discipline.
• 15+ years of technology experience in the financial services industry.
• Strong hands-on programming in Python and SQL (Java/Scala a plus), with the ability to design, debug, and optimize distributed data processing; familiarity with AI-assisted development tools (e.g., GitHub Copilot, Codex, Anthropic tools).
• Deep experience with Spark (batch and streaming) including performance tuning, troubleshooting, and cost-aware optimization.
• Hands-on experience building and operating modern Lakehouse platforms using Snowflake and Databricks on AWS (Azure acceptable), supporting high concurrency analytical workloads.
• Working knowledge of open table formats and metadata ecosystems, including Apache Iceberg and table catalogs/governance services (e.g., Unity Catalog or equivalent).
• Extensive hands-on experience architecting and implementing modern, open architecture data platforms supporting OLAP, OLTP, and near real-time workloads; familiarity with catalog services that enable multiple compute engines, high concurrency, and strong performance.
• Expertise in zero-copy data sharing, data virtualization, catalog federation, and governed data access patterns, enabling scalable and trusted data consumption across platforms.
• Strong operational and engineering excellence mindset, with experience establishing SDLC standards, CI/CD, observability, reliability engineering, incident management, and continuous improvement practices for mission-critical platforms.

Preferred Qualifications

• Previous experience in data/platform development within a financial institution.
• Familiarity with modern governance frameworks (Unity Catalog, Collibra, Alation).
• Expertise in AI-assisted coding using GitHub Copilot or Claude Code Assistant.

Salary Range

$120,000 - $202,500 Annual

About State Street

We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

Job Application Disclosure

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.