Data Engineer - Remote

About The Role

Our Digital Modernization and Experience (DMX) Group is expanding, and we are seeking a highly motivated and experienced Senior Databricks Subject Matter Expert (SME). This role is pivotal in transforming complex data into actionable insights that enhance public systems and services, particularly within the emergency management sector. The successful candidate will support enterprise initiatives focused on platform infrastructure and analytics modernization for a federal client. You will be part of a dynamic, cross-functional team comprising full-stack developers, data engineers, and data analysts working within a cloud-native, modular platform. Your expertise will ensure that disaster management decision-makers have access to accurate, timely, and meaningful data products to improve service delivery and achieve measurable mission outcomes. This position offers the flexibility of remote work with occasional travel to the DC Metropolitan area for client meetings. The role requires U.S. residency and citizenship, with the ability to obtain and maintain necessary security clearances.

Responsibilities

• Enable secure, scalable data exchange between federal clients and external partners using Databricks Delta Sharing
• Design, develop, and optimize data pipelines and ETL routines within Azure Cloud for diverse data sources, including RDBMS, APIs, and unstructured data
• Perform data profiling, transformation, and quality assurance on structured, semi-structured, and unstructured datasets
• Identify technical issues and translate them into actionable requirements for data solutions
• Assist in building and optimizing data lakes, feature stores, and data warehouses to support analytics and machine learning initiatives
• Prepare and validate data for data science and MLOps workflows, ensuring data quality and integrity
• Monitor data flow across BI dashboards, analytics environments, and ML pipelines to ensure consistency and reliability
• Engage with clients and stakeholders to understand their data needs and translate these into scalable technical solutions
• Collaborate with UX designers, business analysts, developers, and end users to define reporting and data requirements
• Work with external data partners to understand their data product needs and facilitate rapid prototyping within Databricks platform
• Participate in Agile development processes, supporting iterative development, backlog grooming, and sprint planning
• Mentor junior team members, fostering knowledge sharing and technical growth within the team
• Maintain awareness of evolving data technologies and methodologies to continuously improve platform capabilities

Qualifications

• Bachelor's degree in Computer Science, Data Science, Engineering, or related field
• Minimum of 5+ years of experience in data engineering, data security practices, and analytics platforms
• U.S. Citizenship is mandatory, with the ability to obtain a federal public trust clearance
• Resided in the U.S. for at least three of the last five years
• Proficiency in Databricks platform, Delta Lake, and Delta Sharing (3+ years SME level)
• Deep understanding of distributed computing with Apache Spark
• Extensive experience developing scalable ETL pipelines in cloud environments, especially Azure
• Hands-on experience with Azure services such as Data Factory, Synapse, and Databricks
• Strong SQL, Python, and Spark skills; familiarity with Scala preferred
• Certifications in Databricks or related cloud/data engineering certifications are highly desirable
• Experience with data visualization tools like Tableau, Power BI, or similar
• Knowledge of MLOps, data science methodologies, and machine learning deployment
• Experience with CI/CD pipelines, DevOps practices, and IaC tools such as Terraform
• Emergency management domain knowledge is a plus
• Excellent communication skills, with the ability to work directly with clients and stakeholders at various levels
• Proven ability to develop rapid prototypes and break down complex ideas into manageable components

Benefits

• Competitive salary package within the range of $98,614 to $202,850 annually
• Fully remote work environment with flexibility to travel up to 10% to the DC Metropolitan area
• Comprehensive health, dental, and vision insurance plans
• Retirement savings options, including 401(k) plans with company matching
• Paid time off and holidays to promote work-life balance
• Professional development opportunities, including certifications and training
• Supportive and inclusive workplace culture that values diversity and innovation
• Access to cutting-edge technology and tools to advance your skills and career