Senior Architect, Data Engineering
West Monroe · Los Angeles Metropolitan Area · 3 wk ago
Art & Creative$199k–$223k/yrFull-time
About the role
West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This role offers opportunities to work with clients developing Big Data strategy and roadmaps across various industries including Healthcare, Financial Services, Insurance, Consumer & Industrial Products, and Energy & Utilities.
Responsibilities
- Provide guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft Fabric
- Design data flow and processing pipelines for analysis using modern toolsets like Spark on Scala, Storm, Flume, Sqoop
- Create data structures for ingestion and reporting, tailored to specific use cases and technologies
- Offer data management expertise to clients in evaluating requirements and developing data architecture, including platform selection and design
- Architect and implement scalable AI/ML and Generative AI solutions leveraging modern data platforms such as Databricks, Snowflake, and Microsoft Fabric
- Design data architectures enabling AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environments
- Guide and coach consultants, share best practices, perform code reviews
- Coordinate activities with data source application owners to ensure integration with analytics platform and source systems
- Ensure data integrity issues are addressed
- Liaise and attend meetings necessary to perform duties and aid business and technical development
- Partner with business development teams to identify client needs, propose tailored solutions, and build long-term relationships with key stakeholders to drive growth opportunities
- Collaborate on crafting compelling proposals, presentations, and technical demonstrations that showcase innovative architecture solutions and align with client objectives to win new business
Qualifications
- 10+ years of professional experience, 5+ within consulting ecosystem
- Strong technical expertise in Databricks and/or Snowflake, including modern lakehouse architecture, performance optimization, governance, orchestration, and enablement of AI/ML and Generative AI workloads
- Hands-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures
- Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment
- Development of or architecture of modern distributed architectures using modern messaging patterns and tools
- Strong data engineering experience with the following core competencies:
- Experience with Databricks, Snowflake, and/or Fabric
- Experience working with relational databases (Microsoft SQL Server) and large unstructured data sets
- Strong experience with ETL procedures and ideation from scratch
- Experience using cloud platforms such as AWS, Azure, GCP etc.
- Experience with reporting tools such as PowerBI and Tableau
- Working knowledge or experience working with Azure SQL, Azure Data Lake or Azure Data Factory
- Excellent organizational, verbal and written communication skills
- A commitment to inclusion and diversity, and openness to new ideas and perspectives
- Proven experience in supporting business development efforts, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth
- Travel to client sites as needed (30% to 50%)
Pay
Based on pay transparency guidelines, the salary range for this role can vary based on your proximity to one of our West Monroe offices (see table below).
Benefits
- Medical, dental, vision, and basic life insurance
- Eligibility for company's 401k plan
- Ability to purchase shares from employee stock ownership program
- Unlimited flexible time off
- Ten paid holidays throughout the calendar year
- Eligibility for ten weeks of paid parental leave upon hire date