Principal Solutions Architect

About the role

Serve as a trusted advisor to customers, guiding them through their data engineering and data architecture needs with a focus on Databricks solutions. Split your time evenly between billable and pre-sales activity.

Responsibilities

• Design, build, and deploy comprehensive data solutions that capture, transform, and leverage data to support AI, ML, and business intelligence initiatives.
• Drive technology innovation by providing thought leadership on data trends.
• Collaborate with sales teams to present technical solutions to prospective clients, demonstrating the value of SunnyData's offerings.
• Manage multiple customer accounts, ensuring timely delivery of solutions and tracking progress to report outcomes.
• Architect data solutions, incorporating best practices in data governance, security, and quality.
• Evaluate data sources for their value, recommending data inclusion strategies to enhance analytical processes.
• Lead cross-functional teams, providing direction and mentorship to project teams to deliver solutions and educate end users on data products and analytic environments.
• Perform system analysis, assess and resolve data and system defects, and apply appropriate corrections.
• Test data movement, transformation code, and data components to ensure accuracy and reliability.

Requirements

• Experience: 10+ years as a hands-on Solutions Architect and/or Sr. Data Engineer designing and implementing data solutions with a focus on Databricks.
• Technical Proficiency: Expertise in Data Engineering technologies (e.g., Spark, Hadoop, Kafka), Databricks platform, and data science/machine learning technologies (e.g., pandas, scikit-learn).
• Architecture and leadership skills: In-depth understanding of the end to end data analytics workflow (e.g., data modeling, ETL processes, and data integration) using modern data engineering techniques; Ability to lead complex architecture requirements(discovery), solution design sessions and build out implementation architecture blueprints that can be implemented by data-engineering and analytics teams.
• Programming Skills: Proficiency in Java, Python, and/or Scala.
• Cloud Platforms: AWS, Azure, and/or GCP.
• SQL Expertise: Ability to write, debug, and optimize SQL queries.
• Client-Facing Skills: Strong written and verbal communication skills with experience in client-facing roles.
• Presentation Skills: Ability to create and deliver detailed presentations to clients and stakeholders.
• Documentation: Experience in creating detailed solution documentation including POCs, roadmaps, sequence diagrams, class hierarchies, and logical system views.
• End-to-End Solutions: Ability to develop end-to-end technical solutions into production, ensuring performance, security, scalability, and robust data integration.
• Team Leadership: Experience leading, mentoring, growing team of engineers.

Qualifications

• Degree: 4-year Bachelor's degree in Computer Science or a related field.

Skills

• Distributed Storage: Familiarity with cloud and distributed data storage systems such as S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra, or other NoSQL storage systems.
• Data Integration: Experience with data integration technologies like Spark, Kafka, Streamsets, Matillion, Fivetran, NiFi, AWS DataMigration Services, Azure DataFactory, and Informatica Intelligent Cloud Services (IICS).
• Software Development Lifecycle: Comprehensive experience with the complete software development lifecycle including design, documentation, implementation, testing, and deployment.
• Automated Pipelines: Expertise in automated data transformation and curation using tools like dbt, Spark, Spark streaming, and automated pipelines.
• Workflow Management: Experience with workflow management and orchestration tools like Airflow, AWS Managed Airflow, Luigi, and NiFi.

Benefits

• Health Insurance: Eligible for coverage from the first day of employment.
• Paid Time Off: Minimum of 20 days annually, plus nine paid company Holidays.

Pay

The annual base salary range provided for this position is a nationwide market range and represents a broad range of salaries for this role across the country. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment.

Schedule

Flexible work schedule to accommodate client needs.