Senior Data Engineer

About the role

We are looking for a seasoned Senior Data Engineer to work with our team and clients to develop enterprise‑grade data platforms, services, and pipelines in Databricks. The ideal candidate is a technologist with excellent communication and customer‑service skills, a passion for data and problem solving, and will contribute to the growth of our AI & Data Exploitation Practice.

Responsibilities

• Lead and architect migrations of data using Databricks with focus on performance, reliability, and scalability.
• Assess and understand ETL jobs, workflows, data marts, BI tools, and reports.
• Address technical inquiries concerning customization, integration, enterprise architecture, and general feature/functionality of data products.

Requirements

• Current ICE US Public Trust Clearance (Full Background Investigation) and ability to hold a position of public trust with the US government.
• 5‑7 years of industry experience coding commercial software.
• 5‑7 years of direct experience in Data Engineering with big‑data tools such as Databricks, Apache Spark, Delta Lake, etc.
• Experience with relational SQL (preferably T‑SQL; alternatively pgSQL, MySQL).
• Experience with data pipeline and workflow management tools: Databricks Workflows, Airflow, Step Functions, etc.
• Experience with AWS and Azure cloud services (e.g., Databricks on AWS, S3, EC2, RDS).
• Experience with object‑oriented/object‑function scripting languages: PySpark/Python, Java, C++, Scala, etc.
• Experience working with Data Lakehouse architecture and Delta Lake/Apache Iceberg.
• Advanced working SQL knowledge and experience authoring and optimizing queries in relational databases.
• Experience manipulating, processing, and extracting value from large, disconnected datasets.
• Ability to inspect existing