Azure Databricks Senior Architect

Key Responsibilities

• Architectural Leadership: Lead the design of high-level data architectures in Multi-Cloud environments (Azure and GCP) specifically for IIoT (Industrial Internet of Things) and manufacturing execution systems
• Industrial Data Modernization: Oversee the migration of legacy factory data systems to unified storage platforms like Hadoop and Databricks
• Smart Manufacturing Insights: Build visualization frameworks in Tableau to track OEE (Overall Equipment Effectiveness), supply chain bottlenecks, and production quality metrics
• Predictive Analytics: Utilize Spark, PySpark, and Python to develop models for predictive maintenance and demand forecasting
• End-to-End Delivery: Manage the full SDLC for high-impact projects, ensuring data integrity and security across global manufacturing sites
• Strategic Mentorship: Guide technical teams across onshore and offshore models, fostering excellence in data engineering and industrial AI

Requirements

• Making Manufacturing Domain Expertise: Proven experience applying data solutions to manufacturing challenges, such as inventory optimization, shop-floor automation, or digital twins
• Extensive IT Background: Over 18+ years of experience with a strong focus on Big Data ecosystems including Hadoop, Hive, and Spark
• Cloud Mastery: Deep expertise in Azure and GCP, supported by certifications in Data Engineering and Architecture
• Technical Depth: Hands-on proficiency with Informatica, Kubernetes, and advanced SQL for complex data exploration

Qualifications

• Education: A Master's Degree in Software Engineering
• Analytical Skills: Strong data processing and ETL experience using Python (NumPy/Pandas)

Skills

• Python
• Spark, PySpark
• Hadoop, Hive
• Kubernetes
• Informatica
• Advanced SQL

Benefits

• Significant career development opportunities
• Part of a small, fast-growing, challenging and entrepreneurial environment
• A high degree of individual responsibility
• EEO Employer