Data Solution Architect

Role Overview

The Senior Data Solutions Architect for the Enterprise Data Platforms Advanced Analytics team drives enterprise-wide capacity management, resource optimization, and data platform insights by building analytics solutions within the Enterprise Data Warehouse and enterprise data lake ecosystem. This role will contribute to building a single source of truth for capacity data, developing scalable data models, automating reporting, and enabling data-driven decision-making for storage, compute, and platform hygiene initiatives.

Responsibilities

• Design and deliver analytics solutions across enterprise data lakes, large-scale Hadoop platforms, and cloud or hybrid data ecosystems.
• Leverage HDFS CLI commands and FSImage analysis for storage and compute utilization assessment.
• Analyze CPU, memory, and workload utilization across Hadoop platforms using YARN, Hive, and Impala query metrics for resource utilization reporting.
• Develop API-driven ETL pipelines using cURL, PySpark, and shell scripting to extract, validate, and load data into Hive tables.
• Design data models and develop analytical datasets to capture and analyze storage, compute, and resource utilization metrics.
• Translate complex data into actionable insights for senior leadership and executive audiences.
• Automate reporting and data refresh processes using tools like Excel VBA, Power Query, and scripting.
• Lead proof-of-concept (POC) efforts for emerging technologies, evaluate business value, and recommend scalable implementation strategies.

Required Qualifications

A lead-level professional with deep Hadoop architectural expertise, including HDFS, FSImage analysis, Ozone, Hive, Impala, and YARN. Proficiency is required in API-driven data integration, PySpark, Python, PowerShell, shell scripting, and advanced SQL query writing. Candidates should have hands-on experience with tools such as Cloudera Manager, Pepperdata, or Acceldata Pulse for platform monitoring. Familiarity with RDBMS like Teradata or PostgreSQL is also necessary.

Preferred Qualifications

• Experience with object storage architectures like HBase, MinIO, or S3-compatible platforms.
• Familiarity with visualization tools such as Tableau or PowerBI.
• Experience with advanced visualization and monitoring tools like Prometheus and Grafana.
• Proficiency in Excel automation using VBA and Power Query.

Benefits

• Supplemental benefits including medical, dental, vision, life, disability, and other insurance plans.
• ESPP (employee stock purchase program).
• 401K program with company match after 12 months of tenure.
• HSA (Health Savings Account on the HDHP plan).
• SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions.
• Corporate discount savings program and other discounts.
• On-demand training program, certification prep, and library of technical and leadership courses/books/seminars (available after 6+ months of tenure).
• Certification discounts and perks for associations including CompTIA and IIBA.
• Dedicated customer service team for consultants and a certified Career Coach.