Senior Data Engineer (contract)

Summary

In this contingent resource assignment, you may consult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables. Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors. Contribute to the resolution of moderately complex issues and consult with others to meet Software Engineering deliverables while leveraging solid understanding of the function, policies, procedures, and compliance requirements. Collaborate with client personnel in Software Engineering.

Required Qualifications

• Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.

Key Requirements

• Experience in data engineering including hands-on experience working with Hadoop and Google Cloud data solutions: creating/supporting Spark based processing, Kafka streaming, in a highly collaborative team
• Hands-on experience developing data flows using Kafka, Flink, and Spark streaming
• Experience with Data lakehouse architecture and design, including hands-on experience with Python, pySpark, Apache Kafka, Airflow, and SQL, GCP Cloud Storage, BigQuery, Data Proc, Cloud Composer
• Working with NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats
• Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics
• Proven skills with data migration from on-prem to a cloud native environment
• Proven experience working with the Hadoop ecosystem capabilities such as Hive, HDFS, Parquet, Iceberg, and Delta Tables
• Deep understanding of data warehouse, data cloud architecture, building data pipelines, and orchestration
• Design and implementation of highly scalable and modular data pipelines with built-in data controls for automating data governance
• Familiarity of GenAI frameworks such as Langchain and Langraph to develop agent-based data capabilities
• DevOps and CI/CD deployments including Git, Jenkins, Docker, and Kubernetes
• Web based UI development using React and Node JS is a plus

Benefits

• Health Insurance
• Life insurance
• 401K
• Voluntary Benefits