GCP Data Engineer

About the role

The Cloud Data Engineer is a hands-on role responsible for performance, availability and scalability of the public cloud environment. You will collaborate with other Architects and Engineers to enable enterprise applications to meet the organizations business goals.

Responsibilities

• Work closely with application development and data engineers on day-to-day tasks.
• Participate in project planning and implementation.
• Coordinate with Data Scientists, Product Managers and business leaders to understand data needs and deliver on those needs.
• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and other data sources.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Improve, optimize and identify opportunities for efficient software development processes.
• Help achieve milestones as per sprint plan and prioritize to manage ad-hoc requests in parallel with ongoing sprints.

Required Qualifications

• 5+ years of hands-on experience in building Data pipeline (ETL/ELT) in a cloud platform
• GCP knowledge strongly preferred - other cloud experience such as AWS. AZURE is ok
• 5+ years of hands-on experience of building and operationalizing data processing systems
• Strong Python scripting experience is very important requirement
• 2+ years' experience in NoSQL databases and close familiarity with technologies/languages such as Python/R, Scala, Java, Hive, Spark, Kafka
• 2+ years' experience working with data platforms (Data warehouse, Data Lake, ODS)
• 2+ years' experience working with tools to automate CI/CD pipelines (e.g., Jenkins, GIT, Control-M)
• Must have working experience with the clinical data
• GCP (google cloud platform) experience
• 3+ years of experience working on healthcare / clinical data

Preferred Qualifications

• Data analysis / Data mapping skills
• Python
• Cloud Data flow/Data proc/Function
• Whistle map SDK
• Google health care API/ FHIR store

Benefits

• Bonus
• Benefits package (for more information visit https://www.exlservice.com/us-careers-and-benefits)