Sr Manager Platform Development - Data Services (Databricks, AI)
NISC · St Louis, MO · 3 wk ago
HybridInformation TechnologyFull-time
Essential Functions
- Lead, develop, and mentor technical teams across Data Engineering, CDC, BI, and Data Curation; own hiring, coaching, performance, career growth, and team health.
- Define and execute the Data Services strategy and operating model, aligned with NISC's business objectives, data-driven decision-making, and AI-enabled solutions for Members.
- Drive continuous improvement of CDC pipelines to enhance the speed, quality, and reliability of data moving from operational systems into the cloud lakehouse.
- Oversee the design, development, and optimization of scalable data pipelines, the lakehouse, and analytics frameworks in AWS and Databricks.
- Lead the BI platform modernization and go-forward BI strategy, including the semantic/curation layer and the self-service "bring your own tool" experience for customers.
- Champion best practices in data governance, data quality, data cataloging, lineage, and reliability; treat security, privacy, and compliance as first-class platform capabilities.
- Establish FinOps practices — cost modeling, forecasting, and optimization across the Databricks/AWS platform and Member usage tiers.
- Identify opportunities to incorporate automation, AI, and advanced analytics into platform workflows and Member-facing products.
- Promote collaboration and alignment between Data Services, Application Development, Product, and business stakeholders; reduce handoffs and clarify ownership.
- Establish and track KPIs for platform performance, pipeline reliability, team productivity, cost, and business/Member impact.
- Manage resource planning, prioritization, and delivery across multiple concurrent initiatives using a single, transparent intake and prioritization process.
- Partner with senior leadership to translate business and Member needs into technical roadmaps and priorities.
- Stay current on emerging data and AI technologies and bring innovative, practical solutions to improve platform capabilities.
Preferred Knowledge, Skills & Abilities
- 6+ years in data engineering, analytics, or data platform roles, with 4+ years in formal people leadership.
- Experience leading a cloud data platform migration or modernization, a BI tool replacement, or a self-service/"bring your own tool" data-access program.
- Experience in utility, broadband, cooperative, or other regulated/Member-focused industries is a plus.
Technical Expertise
- Strong experience with modern cloud data platforms — Databricks, Oracle, and AWS (S3, Lambda, Spark, Aurora/PostgreSQL, etc.).
- Deep understanding of data engineering concepts: ETL/ELT, data modeling, the medallion/lakehouse pattern, streaming and batch processing.
- Hands-on familiarity with Change Data Capture frameworks and streaming (e.g., log-based CDC, Debezium-style approaches, Kafka) and DevOps practices for data pipelines (Terraform, CI/CD).
- Familiarity with programming languages such as Python, Scala, or Java.
- Familiarity with BI/reporting tool integration (Power BI, Tableau, AWS QuickSight) and data visualization best practices, plus semantic-layer and self-service analytics concepts.
- Working knowledge of data governance, cataloging, and access control (e.g., Databricks Unity Catalog) and of identity/OAuth-based access patterns.
- Working knowledge of AI/ML and GenAI integration within data ecosystems.
Leadership & Management
- Proven ability to lead, develop, and scale high-performing technical teams — ideally multiple teams or team leads.
- Strong coaching and mentoring skills with a focus on employee growth and engagement.
- Experience managing cross-functional teams and fostering collaboration across disciplines.
- Ability to influence stakeholders and drive alignment at all organizational levels, especially through periods of change.
Strategic & Operational Skills
- Strong problem-solving and analytical thinking.
- Experience defining and implementing technical strategy and multi-year roadmaps.
- Ability to balance long-term vision with near-term execution and to prioritize amid competing demands.
- Strong project and program management capabilities; experience introducing scalable intake and prioritization processes.
- FinOps / cloud cost-management awareness.
Communication & Collaboration
- Excellent verbal and written communication skills.
- Strong stakeholder management and relationship-building skills, including with Members.
Personal Attributes
- Innovative mindset with a focus on continuous improvement.
- Results-driven, with strong ownership and accountability.
- Adaptable and comfortable leading in a Member-focused, rapidly evolving environment.
- Passion for leveraging data and technology to drive tangible value for NISC and its Members.
Work Schedule
Hybrid from one of our office locations: Atlanta, GA, Cedar Rapids, IA, Lake Saint Louis, MO, Mandan, ND. Virtual Office: Candidates working from a remote location within approved states will be considered for those who have applicable industry experience.
NISC's Shared Values & Competencies
- We're a cooperative, which means we're owned by the Members we serve. It also means that our focus is on taking care of our Members and our employees, rather than having a big bottom line.
- Quality service and innovative technology starts with happy and dedicated employees.
- Integrity – We are committed to doing the right thing – always.
- Relationships – We are committed to building and preserving lasting relationships.
- Innovation – We promote the spirit of creativity and champion new ideas.
- Teamwork – We exemplify the cooperative spirit by working together.
- Empowerment – We believe individuals have the power to make a difference.
- Personal Development – We believe the free exchange of knowledge and information is absolutely necessary to the success of each individual and the organization.