Associate Data Engineer (Remote)

About the role

Crum & Forster is seeking an Associate Data Engineer to support the S&S Data Science team's External Data function. This role involves building and maintaining pipelines that integrate third-party data sources into underwriting, claims, and BI workflows.

Responsibilities

• Build and maintain batch and streaming ETL/ELT pipelines that feed a cloud data warehouse
• Schedule and monitor cloud data jobs, diagnosing failures and tuning for cost and performance
• Create idempotent load logic to handle reprocessing and backfills without duplicates
• Integrate external data providers and APIs with authentication, error handling, and retries
• Implement data quality checks, validation, and alerts to catch pipeline issues early
• Manage and deploy pipelines using infrastructure-as-code and CI/CD
• Support data migrations and service updates with minimal downtime
• Deliver clean, analytics-ready datasets for data scientists and analysts

Requirements

• 1-5+ years of professional experience in data engineering or a related software/data role
• Bachelor's degree in Computer Science, Data Engineering, or a related technical field or equivalent experience
• Strong programming skills in Python and SQL
• Familiarity with ETL/ELT concepts and building data pipelines
• Experience with at least one major cloud platform (AWS preferred)
• Familiarity with REST APIs and integrating external data sources
• Strong attention to data quality and reliability
• Ability to communicate clearly with both technical and business audiences

Qualifications

• Hands-on experience with AWS data services such as Glue, Lambda, and S3
• Experience loading and modeling data in a cloud data warehouse (e.g. Snowflake)
• Experience with distributed processing frameworks such as Apache Spark
• Experience with streaming technologies such as Kafka or Kinesis
• Experience with infrastructure-as-code (CDK, Terraform, or CloudFormation) and monitoring with CloudWatch
• Knowledge of geospatial analysis
• Experience with zero-downtime deployment patterns such as blue-green deployments
• Interest in insurance, underwriting, or claims

Skills

• Python programming
• SQL programming
• Elasticsearch
• Apache Spark
• Kafka
• Cloud platforms (AWS preferred)
• REST APIs
• Data quality checks
• Alerting
• Infrastructure-as-code (CDK, Terraform, or CloudFormation)
• Monitoring with CloudWatch
• Geospatial analysis
• Zero-downtime deployment patterns
• Insurance, underwriting, or claims knowledge

Benefits

• Generous 401K employer match
• Employee Stock Purchase plan with employer matching
• Generous Paid Time Off
• Excellent benefits that go beyond health, dental & vision
• Programs focused on your whole family’s wellness
• Tuition reimbursement and industry-related certifications
• Professional training to keep you progressing on your chosen path
• A dynamic, ambitious, fun, and exciting work environment
• A commitment to equal employment opportunity and diversity
• A matching donation program and volunteer opportunities
• An employee-driven corporate giving program

Pay

The annualized base pay for the advertised position, located in the specified area, ranges from a minimum of $71,600 to a maximum of $105,000. The actual compensation is determined by various factors, including but not limited to the market pay for the jobs at each level, the responsibilities and skills required for each job, and the employee’s contribution (performance) in that role.

Schedule

Full-time position