Staff Data Engineer

About the role

The Staff Data Engineer serves as a primary development resource for design, writing code, test, implementation, document functionality, and maintain of NextGen solutions for the GCP Cloud enterprise data initiatives. The role requires working closely with data teams, frequently in a matrixed environment as part of a broader project team.

Responsibilities

• Set technical direction on groups of applications and similar technologies
• Take responsibility for technically robust solutions encompassing all business, architecture, and technology constraints
• Work with data engineers, data architects, data scientists, and other internal stakeholders to understand product requirements and then design, build, and monitor data platforms and pipelines that meet today's requirements but can gracefully scale
• Implement automated workflows that lower manual/operational costs, define and uphold SLAs for timely delivery of data, and move the company closer to democratizing data
• Enable a self-service data architecture supporting query exploration, dashboards, data catalog, and rich data discovery
• Promote a collaborative team environment that prioritizes effective communication, team member growth, and success of the team over success of the individual
• Create real-time data pipelines that accelerate the time from idea to insight
• Adhere to and support data engineering best practices, processes, and standards
• Produce high quality, modular, reusable code that incorporates best practices and serves as an example for less experienced engineers
• Help promote and support data security best practices that align with industry standards and regulatory and legal requirements
• Help mentor team members on complex data projects and following the Agile process
• Help lead data analysis efforts and solution proposals to data related and data architecture problems
• Help lead implementation of unit and integration tests and promote and conduct performance testing where appropriate
• Be a leader in the HCA data community
• Evangelize data engineering best practices and standards, participate, or present at community events, and encourage the continual growth and development of others
• Be curious. Be growth minded. Encourage and enable this in others
• Build productive and healthy relationships within the department and other teams to foster growth of our culture, our people, and our platforms
• Perform other duties as assigned

Requirements

• Bachelor's degree in computer science, related technical field, or equivalent experience required
• Master's degree in computer science or related field preferred
• 5+ years of experience as a Data Engineer required
• 1+ year(s) of experience in healthcare preferred
• 7+ years of experience in information technology required
• Demonstrates an empathetic and growth mindset with a willingness to learn new skills, technologies, and methodologies
• Strong knowledge of public cloud best practices and design patterns used in creating, automating, and supporting data pipelines
• Strong ability to assemble large, complex sets of data that meet functional and non-functional product requirements
• Strong ability to identify, design, and implement internal process improvements including redesigning data platforms for greater scalability, optimized data delivery, and automating manual processes
• Strong ability to create and use analytical tools to monitor data pipeline metrics and provide actionable intelligence to increase operational efficiency and valuable data outcomes
• Strong ability to present and facilitate technical ideas
• Expert ability using source control management tools such as Git/GitHub
• Expert ability using CI/CD automation tools
• Strong understanding of SQL and analytical data warehouses
• Strong understanding of Agile methodologies and how to apply Agile within the team
• Helps coach and mentor junior team members and others external to the team
• Proven ability to complete work, make sound decisions, and plan and accomplish goals without explicit direction/guidance from leadership
• Builds and nurtures healthy relationships with all colleagues
• Stays abreast of public cloud technologies, capabilities, and industry use of public cloud to help guide HCA’s strategy and adoption
• Demonstrates productive and inclusive communication skills with all colleagues
• Excellent problem-solving and analytical skills
• Experience applying prompt engineering techniques to improve accuracy and efficiency of AI-assisted solutions
• Strong ability to prototype and iterate using AI-assisted development tools (e.g., Copilot, ChatGPT, or equivalent) to accelerate engineering tasks
• 2+ years hands-on experience with GCP platform and experience with many of the following components: Cloud Run, GKE, Cloud Functions Pub/Sub, Bigtable, Cloud SQL, Cloud Spanner, BigQuery, Dataflow, Data Fusion, Cloud Composer, DataProc, CI/CD, Cloud Logging, Vertex AI, NLP, GitHub
• 4+ Years of hands-on experience with many of the following components: Spark Streaming, Kafka, SQL, Avro, Parquet, Java, Python, or Scala
• 18+ months of hands-on experience with many of the following components: Hands-on experience with AI-assisted development tools (e.g., Copilot, ChatGPT, or equivalent) to accelerate engineering tasks
• Familiarity with modern AI application patterns such as prompting strategies, RAG, evals, and agent-based systems
• Demonstrated ability to rapidly prototype and iterate with AI/ML technologies to deliver practical, production-ready solutions

Qualifications

• A growth mindset with curiosity to experiment with emerging AI frameworks and incorporate them into engineering practices
• Certifications (a plus, but not required): GCP Cloud Professional Data Engineer