Databricks Architect -
We're growing rapidly and are looking for a senior-level data architect to help us design and build a large-scale cloud-based data lake. If you love orchestrating complex data pipelines from multiple source systems into a well-designed data lake structure, then CGI is the place for you.
About the role
The Databricks Architect is responsible for designing and governing an enterprise-grade Lakehouse architecture on Databricks. This role leads end-to-end solution design—from data ingestion and modeling through performance optimization, governance (Unity Catalog), reliability, and cost control—while enabling analytics, AI/ML, and self-service data capabilities at scale. You will inspire innovation, foster collaboration, and drive continuous improvement within your team, making a tangible impact on how our client leverages data to unlock growth and competitive advantage.
This role offers a unique blend of hands-on coding, technical leadership, and strategic influence. You will work on-site hybrid in St. Louis, MO, Minneapolis, MN, or Des Moines, IA.
Responsibilities
- Provide technical and architectural guidance on Databricks, modern data platforms, and cloud-native solutions to both clients and internal team members.
- Design and implement scalable data architectures using Databricks, with hands-on experience in specific platform features such as Delta Lake, Uniform (Iceberg), Delta Live Tables, and Unity Catalog.
- Lead and mentor engineering teams, fostering a culture of learning and innovation, while driving best practices in data management and performance optimization.
- Engage with clients to understand their business challenges and deliver solutions that align with their goals, utilizing Databricks' capabilities to enhance outcomes.
- Demonstrate hands-on technical leadership in designing and developing different components of a Data Lakehouse platform to meet client's business needs.
- Deepen CGI's presence in the market by developing proposals, SOWs, and strategies to grow our footprint within existing accounts.
Requirements
- 10+ years of experience in data engineering or architecture, including 5+ years of direct experience designing end-to-end solutions leveraging Databricks on cloud services.
- Proficiency in Apache Spark, Databricks SQL, Delta Lake & Lakehouse Architecture, Unity Catalog, Python, and Scala.
- Deep understanding of Databricks architecture, clusters, notebooks, and workspace management.
- Experience with Unity Catalog, Databricks Repos, Jobs API, and Workflows.
- Ability to design and implement scalable ETL pipelines using Databricks and Spark.
- Hands-on experience with Azure, AWS, or GCP integrations with Databricks.
- Expertise in designing logical and physical data models for analytics and reporting.
- Familiarity with Unity Catalog, role-based access control, and compliance standards.
- Ability to optimize Spark jobs, cluster configurations, and storage for cost and speed.
- Ability and willingness to code and troubleshoot critical issues under tight deadlines.
- Proven track record of successfully delivering multiple complex, enterprise-scale projects leveraging Databricks, including end-to-end solution design, implementation, and optimization.
Desired Skills
- Databricks Data Engineering Professional certification.
- Designing and implementing data pipelines in Azure Data Factory.
- Experience with DevOps principles including CI/CD, unit testing, and Agile methodologies.
- Experience with metadata management, data cataloging, and data mesh domain architecture.
- Exposure to Databricks migration tooling (e.g., Lakebridge) and cross-tenant/region governance strategies.
Pay
A reasonable estimate of the current range for this role in the U.S. is $88,200.00 - $214,600.00.
Benefits
- Competitive compensation.
- Comprehensive insurance options.
- Matching contributions through the 401(k) plan and the share purchase plan.
- Paid time off for vacation, holidays, and sick time.
- Paid parental leave.
- Learning opportunities and tuition assistance.
- Wellness and well-being programs.