Data Engineer II

Responsibilities

• Design and implement robust, scalable, and high-performance data pipelines
• Implement Data Ingestion, transformation, and Data Quality features to support Application Engineering, Analytics, and various Business Verticals across the organization
• Collaborate with Data Engineering Manager, and Product in building data models to improve reliability and interpretability of data for analytical and business needs
• Design, develop, and maintain robust data export solutions to facilitate the efficient transfer of data to external systems and platforms
• Actively contribute to the creation of design documents, assess technologies, and conduct Proof of Concepts (PoCs)
• Write unit, integration, and functional tests for new features
• Contribute to the Technology Roadmap, PR Reviews and formulate standards/best practices
• Bring in a positive attitude and foster a culture that embraces continuous learning and Innovation

Qualifications

• 3+ years of experience as a Data Engineer (or related role), building and supporting data pipelines in production
• Hands-on experience with Spark, Python, and SQL to build, test, and maintain data pipelines (including writing clear, maintainable code and queries)
• Experience with Microsoft SQL Server (preferred) or other relational databases, including query optimization and performance tuning
• Experience working with big data technologies such as Spark (preferred), Databricks, or similar frameworks
• Experience using Infrastructure as Code tools such as Terraform (or similar) to provision and manage cloud resources
• Experience building data pipelines that are scalable and reliable, with attention to data quality, testing, and operational support
• Experience contributing to data lake or lakehouse solutions to support analytics and downstream consumption
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders
• Prior Experience working with Healthcare Information exchange standards like HL7, X12 EDI, FHIR will be helpful
• Experience or knowledge of creating RESTful API’s is a plus
• Experience building Dashboards and visualizations using Power BI or other tools is a plus