Sr Manager Platform Development - Data Services (Databricks, AI)

NISC · Lake St Louis, MO · 3 wk ago

HybridInformation TechnologyFull-time

Essential Functions

Lead, develop, and mentor technical teams across Data Engineering, CDC, BI, and Data Curation; own hiring, coaching, performance, career growth, and team health.
Define and execute the Data Services strategy and operating model, aligned with NISC's business objectives, data-driven decision-making, and AI-enabled solutions for Members.
Drive continuous improvement of CDC pipelines to enhance the speed, quality, and reliability of data moving from operational systems into the cloud lakehouse.
Oversee the design, development, and optimization of scalable data pipelines, the lakehouse, and analytics frameworks in AWS and Databricks.
Lead the BI platform modernization and go-forward BI strategy, including the semantic/curation layer and the self-service "bring your own tool" experience for customers.
Champion best practices in data governance, data quality, data cataloging, lineage, and reliability; treat security, privacy, and compliance as first-class platform capabilities.
Establish FinOps practices — cost modeling, forecasting, and optimization across the Databricks/AWS platform and Member usage tiers.
Identify opportunities to incorporate automation, AI, and advanced analytics into platform workflows and Member-facing products.
Promote collaboration and alignment between Data Services, Application Development, Product, and business stakeholders; reduce handoffs and clarify ownership.
Establish and track KPIs for platform performance, pipeline reliability, team productivity, cost, and business/Member impact.
Manage resource planning, prioritization, and delivery across multiple concurrent initiatives using a single, transparent intake and prioritization process.
Partner with senior leadership to translate business and Member needs into technical roadmaps and priorities.
Stay current on emerging data and AI technologies and bring innovative, practical solutions to improve platform capabilities.

Preferred Knowledge, Skills & Abilities

6+ years in data engineering, analytics, or data platform roles, with 4+ years in formal people leadership.
Experience leading a cloud data platform migration or modernization, a BI tool replacement, or a self-service/"bring your own tool" data-access program.
Experience in utility, broadband, cooperative, or other regulated/Member-focused industries is a plus.

Technical Expertise

Strong experience with modern cloud data platforms — Databricks, Oracle, and AWS (S3, Lambda, Spark, Aurora/PostgreSQL, etc.).
Deep understanding of data engineering concepts: ETL/ELT, data modeling, the medallion/lakehouse pattern, streaming and batch processing.
Hands-on familiarity with Change Data Capture frameworks and streaming (e.g., log-based CDC, Debezium-style approaches, Kafka) and DevOps practices for data pipelines (Terraform, CI/CD).
Familiarity with programming languages such as Python, Scala, or Java.
Familiarity with BI/reporting tool integration (Power BI, Tableau, AWS QuickSight) and data visualization best practices, plus semantic-layer and self-service analytics concepts.
Working knowledge of data governance, cataloging, and access control (e.g., Databricks Unity Catalog) and of identity/OAuth-based access patterns.
Working knowledge of AI/ML and GenAI integration within data ecosystems.

Leadership & Management

Proven ability to lead, develop, and scale high-performing technical teams — ideally multiple teams or team leads.
Strong coaching and mentoring skills with a focus on employee growth and engagement.
Experience managing cross-functional teams and fostering collaboration across disciplines.
Ability to influence stakeholders and drive alignment at all organizational levels, especially through periods of change.

Strategic & Operational Skills

Strong problem-solving and analytical thinking.
Experience defining and implementing technical strategy and multi-year roadmaps.
Ability to balance long-term vision with near-term execution and to prioritize amid competing demands.
Strong project and program management capabilities; experience introducing scalable intake and prioritization processes.
FinOps / cloud cost-management awareness.

Communication & Collaboration

Excellent verbal and written communication skills.
Strong stakeholder management and relationship-building skills, including with Members.

Personal Attributes

Innovative mindset with a focus on continuous improvement.
Results-driven, with strong ownership and accountability.
Adaptable and comfortable leading in a Member-focused, rapidly evolving environment.
Passion for leveraging data and technology to drive tangible value for NISC and its Members.

Education

Preferred: Bachelor's or master's degree in a Computer Science, Information Systems, Data/Analytics and/or related field (or equivalent experience).

Minimum Physical Requirements

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this position. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the essential functions of this position, employees must be able to see and communicate. Employees are regularly required to maintain a stationary position, move, and operate computer keyboards or office equipment.

Disclaimer