Senior/Lead Data Solutions Architect

About the Role

We are seeking a Senior Data Solutions Architect to join our dynamic Enterprise Data Platforms Advanced Analytics team. The ideal candidate will have strong experience in Hadoop architecture, enterprise data lakes, capacity and resource analytics, and API-driven ETL and a proven ability to design and deliver scalable analytics solutions that drive platform insights, automate reporting, and enable data-driven decisions.

Work Arrangement

Hybrid. Four days onsite and one day remote for the first six months. Three days onsite and two days remote after six months.

Responsibilities

• Build analytics solutions within the Enterprise Data Warehouse and enterprise data lake to deliver capacity and resource insights.
• Develop a single source of truth for capacity, storage, compute, onboarding demand, and platform hygiene data.
• Design scalable data models and analytical datasets across Hadoop and cloud platforms.
• Automate reporting and dashboards to support leadership decision-making.
• Analyze CPU, memory, and workload utilization using YARN, Hive, and Impala metrics for resource reporting.
• Leverage HDFS CLI and FSImage analysis to assess storage and compute utilization, including Ozone and object storage platforms.
• Develop API-driven ETL pipelines using cURL, PySpark, and shell scripting with Autosys scheduling and monitoring.
• Use Cloudera Manager, Pepperdata, and/or Acceldata Pulse for platform monitoring and operational insights.
• Translate complex data into actionable insights and executive-ready narratives.
• Lead POCs for emerging technologies and recommend scalable implementation strategies.

Required Skills & Qualifications

• Deep Hadoop architecture expertise, including HDFS, HBase, Ozone, MinIO, Hive, Impala, YARN, and Hadoop CLI.
• Proficiency with FSImage analysis and storage compute utilization assessment.
• Hands-on API programming and ETL using cURL, PySpark, Python, shell scripting, and PowerShell.
• Experience with Autosys for scheduling, monitoring, and error resolution.
• Strong data modeling, advanced query writing, and analytical dataset development skills.
• Experience with Cloudera data services, Cloudera Manager, Pepperdata, and/or Acceldata Pulse.
• Familiarity with object storage and S3-compatible platforms, bucket-based storage models, and cloud storage concepts.
• Proficiency in Excel automation using VBA, Power Query, and scripting; familiarity with Tableau and Power BI.
• RDBMS experience, including Teradata and PostgreSQL.
• Demonstrated ability to operate independently with ownership, attention to detail, and a continuous improvement mindset.

Preferred Skills

• Experience with Prometheus and Grafana for advanced platform visibility and trend analysis.
• Experience in cloud or hybrid data ecosystems and compute analytics.