Jobs · Information Technology

Infrastructure Capacity Planning & Forecasting Engineer

Bayside Solutions · Cupertino, CA · 3 wk ago
RemoteRemoteInformation Technology$60–$70/hrContract

Duties and Responsibilities

  • Own end-to-end infrastructure demand forecasting across compute, storage, networking, and accelerator resources.
  • Develop and maintain 12–15 month forecasts using time-series techniques (e.g., ARIMA, Prophet).
  • Gather and validate inputs from product and engineering teams, incorporating business growth and roadmap signals.
  • Track and improve forecast accuracy (actual vs. forecast %) and forecast stability over time.
  • Build and maintain cost attribution models that allocate infrastructure spend (compute, accelerators, storage, networking, data transfer) across teams, products, and workloads.
  • Develop cost-of-revenue pipelines and reporting models to provide clear visibility into spend drivers.
  • Define and monitor unit cost metrics such as cost per request, cost per GB stored, and cost per pipeline execution.
  • Analyze infrastructure usage to identify inefficiencies, underutilization, and cost optimization opportunities.
  • Drive initiatives including:
    • Rightsizing resources
    • Reserved/committed usage strategies
    • Spot/preemptible workload optimization
  • Track utilization, efficiency targets, and cost avoidance metrics.
  • Design and build scalable data pipelines and models to process large-scale infrastructure, billing, and usage datasets.
  • Enable reliable ingestion, transformation, and serving of data for forecasting and cost analytics.
  • Create dashboards and reporting frameworks for:
    • Forecast vs. request vs. allocation
    • Allocation efficiency
    • Capacity utilization trends
  • Support scenario analysis (what-if modeling) to guide infrastructure scaling and investment decisions.
  • Deliver clear, concise insights to technical and business stakeholders.
  • Promote a cost-aware engineering culture through transparency and tooling.
  • Partner with SRE, infrastructure, product, finance, and procurement teams to align capacity and cost strategies.
  • Establish feedback loops to inform:
    • Product roadmap decisions
    • Infrastructure scaling strategies
    • Process and service improvements

Requirements and Qualifications

  • 6+ years of experience in data engineering, analytics, or FinOps, with exposure to cloud infrastructure or capacity planning.
  • Strong proficiency in Python and or Golang and SQL for data processing, modeling, and analysis.
  • Experience building forecasting models and working with time-series data.
  • Solid understanding of cloud infrastructure and billing systems (compute, storage, networking, accelerators).
  • Experience with cost allocation methodologies and optimization techniques (e.g., reserved instances, committed use discounts, rightsizing).
  • Strong analytical skills with the ability to translate complex datasets into actionable insights.
  • Able to operate effectively in ambiguous, fast-paced environments with a bias for action.
  • Experience with Agentic AI Development
  • Experience as a Technical Project or Program Manager

Preferred Qualifications

  • Experience with large-scale data processing frameworks (e.g., Spark) or cloud data platforms.
  • Familiarity with SRE practices and infrastructure monitoring systems.
  • Experience building data visualization and reporting solutions (e.g., Tableau, Looker).
  • Exposure to FinOps frameworks and governance models.
  • Strong written and verbal communication skills with experience presenting to cross-functional stakeholders.

Similar jobs