Senior Data Engineer Small Business Administration Office of Inspector General (Remote, US)

Responsibilities

• Develop new datasets to support fraud identification, audits, and investigations.
• Optimizes the performance of common queries in the database.
• Create and implement data models to improve the efficiency and utility of the database.
• Proposes and implements architectural improvements to reduce cloud costs.
• Develops, optimizes, and maintains ELT/ETL pipelines.
• Maintains pipelines to ensure performance and regular updating of datasets.
• Works with a Cloud Architect to develop new ways of accessing and transporting data.
• Aids in the development of dashboards or reports to visualize data and storytelling.
• Assists in ingestion, transformation, and configuration of data in cloud-based data lake or data warehouse.
• Assists with exploration, structuring, and analysis of unstructured and semi-structured data from SQL and data lake environments.
• In collaboration with data architecture staff, authors SOPs governing creation, maintenance, and monitoring of all assets in Azure environment.

Qualifications

• 5+ years of experience maintaining SQL databases and conducting advanced operations in SQL and T-SQL.
• 5+ years of experience designing, implementing, and maintaining ELT/ETL processes in cloud-based data analytics environments.
• 3+ years of experience working in Azure Synapse and Azure Machine Learning, with the modern data stack.
• 3+ years of experience manipulating data in Python. Pandas required.
• Experience with PySpark/Polars and developing reusable, modular code preferred.
• Experience implementing pipelines and infrastructure using code-first approaches (Python SDK, CLI, REST APIs, or IaC tooling), implementing source control and CI/CD workflows and AI coding assistants and LLM integration patterns preferred.
• Must be a U.S. citizen and able to successfully complete a Public Trust background investigation.
• Bachelor's degree.

Benefits

• Health benefits.
• 401(k) offered.