Sr. Data Platform Engineer

Duties and responsibilities

• Design, build, and optimize data pipelines (batch and streaming) using PySpark, Python, and SQL
• Lead and support SQL Server → PostgreSQL migration efforts, including schema translation, performance tuning, and data validation
• Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.)
• Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements
• Develop frameworks for data quality, monitoring, and reconciliation
• Collaborate with business stakeholders and other engineers to translate requirements into scalable solutions
• Apply software engineering best practices (version control, CI/CD, testing, code reviews) to data engineering workflows
• Contribute to standards, best practices, and technical mentorship across the team
• Participate in a rotating on-call schedule to provide production support, ensuring reliability of data platforms with minimal disruption to business operations

Additional Duties and Responsibilities

• Maintain regular and punctual attendance
• Any other assigned tasks
• Comply with all company policies and procedures

Qualifications

• 5+ years of professional experience in data engineering or software engineering roles
• Advanced skills with Python and PySpark for large-scale data processing
• Strong SQL development experience, including query tuning and ETL/ELT design
• Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC)
• Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation
• Familiarity with SQL Server and PostgreSQL, including database optimization and migration patterns
• Working knowledge of C# for application/data integrations
• Strong grasp of data modeling, architecture, and governance best practices
• Excellent problem-solving skills, ability to self-manage, and comfort working in environments with changing priorities
• Bachelor’s degree required
• Excellent verbal, written and presentation skills
• Ability to thrive in a fast paced, deadline driven environment
• AWS certification (Solutions Architect, Data Analytics, or DevOps) a plus
• Data visualization experience with Tableau, PowerBI, MicroStrategy, etc. also a plus
• Experience working in the healthcare industry a plus

Benefits

• Competitive base salary
• Work from home
• Ongoing training and coaching for career development
• Comprehensive medical, dental and vision coverage with significant company contribution
• Disability insurance
• 401(k) retirement savings program