Senior Databricks AI/ML Engineer

About the role

PEMCO is seeking a Senior Databricks AI/ML Engineer to join our team. This role focuses on building and deploying scalable AI/ML solutions across various insurance functions.

Responsibilities

• Conduct customer workshops to identify requirements and provide architecture design for analytics projects with Azure and Databricks AI/ML products & services.
• Serve as Databricks Architect responsible for designing, deploying, and governing Databricks workspaces and resources across multiple environments (Dev, Test, Prod).
• Define and implement Databricks Lakehouse architecture, set up best practices for Databricks governance and integrate Databricks with Azure services.
• Lead implementation of Databricks SQL, Delta Live Tables, and MLflow tracking for reproducible and scalable experimentation.
• Develop and maintain automated MLOps workflows for model deployment and monitoring.
• Set up and configure Azure and Databricks AI/ML products and infrastructure.
• Conduct code review for ML models and other code related to smart analytics, AI & ML.
• Demonstrate behaviors consistent with PEMCO's policies, values, code of ethics and business conduct.
• Authentically support the PEMCO Brand and constantly are on the lookout for top talent to join us to achieve our Mission to Worry Less and Live More.

Requirements

• B.A./B.S. degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Data Science or Data Engineering or a related field or equivalent work experience is required.
• Master’s degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Data Science or Data Engineering or a related field preferred.
• 6+ years of hands-on experience building ETL pipelines, managing production data workflows, and developing SQL in SQL Server environments.
• 3+ years of enterprise scale experience in using Azure and Databricks AI/ML products & services, including experience with complex data analysis techniques and visual analytics.
• 3+ years of enterprise scale experience in solving business problems using Azure and Databricks AI/ML services in combination with building data pipelines, data streams, and system integration.
• 3+ years of enterprise scale experience in transforming data science prototypes and applying appropriate ML algorithms and tools.
• 5+ years of enterprise scale experience with CI/CD and Development workflows for ML models and related code/scripts/apps.
• Experience in the insurance industry and understanding of Auto, Home, and Umbrella insurance-related AI/ML applications.
• Expertise in building and maintaining batch and streaming data pipelines for real-time and offline analytics.
• Experience with unsupervised learning techniques to identify patterns and anomalies in data.
• Familiarity with agile software delivery methodologies such as Scrum.
• Familiarity with platforms and enabling tools such as Azure Machine Learning, Azure Databricks, Microsoft Fabric, Synapse Analytics, Power BI, Snowflake, and APIs like Azure OpenAI, Azure Cognitive Services, and Azure ML Endpoints.
• Strong knowledge of real-time data streaming frameworks like Apache Kafka, Azure Event Hubs, and Delta Live Tables for Databricks.
• Engineering skills in AI/ML at enterprise scale to develop frameworks for analytic solutions to business goals.
• Hands-on experience with implementing AI/ML solutions that enable data-driven decision making and insights.
• Strong Math and problem-solving skills.
• Ability to learn new skills rapidly and apply as needed, e.g., learn a new machine learning algorithm from a research paper and implement it.
• Detail oriented with strong organizational, analytical, and communication skills.
• Service minded with experience deciphering ambiguous requests and taking ownership.
• Ability to create and maintain positive relationships with employees at all levels of the organization.
• Ability to work independently and manage tasks with minimal supervision.

Qualifications

• B.A./B.S. degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Data Science or Data Engineering or a related field or equivalent work experience is required.
• Master’s degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Data Science or Data Engineering or a related field preferred.
• 6+ years of hands-on experience building ETL pipelines, managing production data workflows, and developing SQL in SQL Server environments.
• 3+ years of enterprise scale experience in using Azure and Databricks AI/ML products & services, including experience with complex data analysis techniques and visual analytics.
• 3+ years of enterprise scale experience in solving business problems using Azure and Databricks AI/ML services in combination with building data pipelines, data streams, and system integration.
• 3+ years of enterprise scale experience in transforming data science prototypes and applying appropriate ML algorithms and tools.
• 5+ years of enterprise scale experience with CI/CD and Development workflows for ML models and related code/scripts/apps.
• Experience in the insurance industry and understanding of Auto, Home, and Umbrella insurance-related AI/ML applications.
• Expertise in building and maintaining batch and streaming data pipelines for real-time and offline analytics.
• Experience with unsupervised learning techniques to identify patterns and anomalies in data.
• Familiarity with agile software delivery methodologies such as Scrum.
• Familiarity with platforms and enabling tools such as Azure Machine Learning, Azure Databricks, Microsoft Fabric, Synapse Analytics, Power BI, Snowflake, and APIs like Azure OpenAI, Azure Cognitive Services, and Azure ML Endpoints.
• Strong knowledge of real-time data streaming frameworks like Apache Kafka, Azure Event Hubs, and Delta Live Tables for Databricks.
• Engineering skills in AI/ML at enterprise scale to develop frameworks for analytic solutions to business goals.
• Hands-on experience with implementing AI/ML solutions that enable data-driven decision making and insights.
• Strong Math and problem-solving skills.
• Ability to learn new skills rapidly and apply as needed, e.g., learn a new machine learning algorithm from a research paper and implement it.
• Detail oriented with strong organizational, analytical, and communication skills.
• Service minded with experience deciphering ambiguous requests and taking ownership.
• Ability to create and maintain positive relationships with employees at all levels of the organization.
• Ability to work independently and manage tasks with minimal supervision.

Skills

• Expertise in building and maintaining batch and streaming data pipelines for real-time and offline analytics.
• Experience with unsupervised learning techniques to identify patterns and anomalies in data.
• Familiarity with agile software delivery methodologies such as Scrum.
• Familiarity with platforms and enabling tools such as Azure Machine Learning, Azure Databricks, Microsoft Fabric, Synapse Analytics, Power BI, Snowflake, and APIs like Azure OpenAI, Azure Cognitive Services, and Azure ML Endpoints.
• Strong knowledge of real-time data streaming frameworks like Apache Kafka, Azure Event Hubs, and Delta Live Tables for Databricks.
• Engineering skills in AI/ML at enterprise scale to develop frameworks for analytic solutions to business goals.
• Hands-on experience with implementing AI/ML solutions that enable data-driven decision making and insights.
• Strong Math and problem-solving skills.
• Ability to learn new skills rapidly and apply as needed, e.g., learn a new machine learning algorithm from a research paper and implement it.

Benefits

• Medical, dental, and vision plans with generous employer premium cost shares.
• Basic life and accidental death & dismemberment insurance policies and long- and short-term disability benefit coverages.
• Participation in PEMCO’s 401(k) plan which includes a generous employer match (2 for 1 on the first 6% employee pre-tax and/or Roth deferral, up to federal maximums).
• Vacation accrues at a rate of 10 days for new hires, and increases based on a schedule to a maximum annual accrual of 25 days based on tenure.
• Four (4) personal days immediately upon hire.
• Paid holidays for the eight (8) holidays observed by PEMCO throughout the calendar year.
• Up to ten (10) days of sick leave immediately upon hire (pro-rated based on hire date and full-time/part-time status), which is approximately 28 hours more per year than the Washington state-required accrual.
• Payroll deductions for voluntary programs such as flexible spending accounts, education assistance programs, and employee assistance programs.
• Discretionary bonuses, tiered sales commissions and/or incentives (from 5-25% of employee’s monthly sales), employee referral bonuses, shift differential pay, and other miscellaneous benefits.

Pay

The pay range for this role is shown below. Compensation decisions are determined based on an individual's qualifications, job-related knowledge, skills, and experience. Greater Seattle area target pay range: $150,334-$183,742. The full pay range is $125,279-$208,798. Outside greater Seattle area target pay range: $132,673-$162,155. The full pay range is $110,561-$184,268. Greater Seattle Area is defined as working within approximately 100 miles of Seattle. Outside Greater Seattle is defined as working approximately 100 miles or more from Seattle.

Schedule

Regular part-time PEMCO employees working at least 24 hours per week and regular full-time PEMCO employees are eligible to elect coverage under medical, dental, and vision plans for themselves and their eligible family members with generous employer premium cost shares.

Location

Greater Seattle Area is defined as working within approximately 100 miles of Seattle. Outside Greater Seattle is defined as working approximately 100 miles or more from Seattle.