Data Engineer- Databricks
About the Role
Slalom's Enhance & Operate (E&O) team is looking for a hands-on Data Engineer who enjoys building and improving data pipelines and keeping production platforms running smoothly. In this role, you'll support a modern Databricks + Snowflake + Azure Data Factory (ADF) Enterprise Data Warehouse (EDW) ecosystem, combining data engineering fundamentals with operational excellence—monitoring pipelines, resolving incidents, developing code enhancements, and continuously improving reliability and performance in a service-oriented environment. You'll work with a highly collaborative, cross-regional delivery model ("all-shore") and partner closely with both technical and non-technical stakeholders.
What You'll Do
- Build, enhance, and troubleshoot Azure Data Factory (ADF) pipelines and Snowflake ELT/ETL processes, and Databricks ELT/ETL
- Monitor daily/weekly/monthly data batch cycles and respond quickly to job failures, latency, or data-quality issues
- Diagnose and resolve production incidents within Service-Level Agreements (SLA) targets using SQL, Python, platform logs, documentation, and runbooks
- Perform root cause analysis (RCA), write documentation of findings, and implement fixes to prevent recurrence of issues
- Drive operational improvements: automation, alert tuning, performance optimization, and reliability enhancements
- Work within ITIL/ITSM workflows (ticketing, incident/problem management, change processes) and communicate clearly with both technical and business stakeholders
- Collaborate with teammates across regions—sharing context early, documenting decisions, and maintaining strong handoffs
- Apply agentic AI in day-to-day E&O delivery using Snowflake Cortex and agentic coding tools to investigate incidents, accelerate root cause analysis, navigate code and data context, automate repeatable work, and turn operational knowledge into reusable skills
- Use agentic tools to support, not replace, engineering judgment by verifying evidence, challenging recommendations, protecting production data, and clearly communicating what the agent did, what was validated, and what still requires human approval
What You Bring
- A proactive, data platform service-focused mindset: you will own incidents, issues, and development work end-to-end and follow your work through to resolution
- A Problem-solving mindset; Willingness to learn and understand how issues and resolutions fit into the EDW system design
- Experience in working independently on assigned work; but also, comfortable collaborating with others to investigate and resolve issues; comfortable sharing concepts and information about issue resolution with teammates
- 2-3 years of experience in data engineering, ETL/ELT development, or production support for data platforms
- Strong SQL skills (debugging, performance awareness, data validation)
- Strong Python skills (troubleshooting, scripting, automation)
- Hands-on experience with Snowflake and/or Databricks and Azure Data Factory (ADF)
- Comfort working in a fast-paced, consulting-oriented environment where priorities shift and outcomes matter
- An agentic-assisted engineering mindset: comfort using AI agents as part of daily engineering work by providing clear context and constraints, reviewing proposed plans, SQL, and code, validating outputs against source evidence, and iterating when results are incomplete or unsafe
- Strong engineering fundamentals for AI-enabled operations, including Git and pull-request practices, scripting or Python experience, API and integration literacy, and the ability to trace issues across data pipelines, logs, code repositories, and operational records
Nice to Have
- Experience with ServiceNow, Control-M, Azure DevOps, Git-based workflows, and/or CI/CD
- Exposure to data observability/monitoring patterns, alerting, and platform logging
- Familiarity with modern data tooling (e.g., dbt) or cloud data ecosystem patterns
- Experience with Snowflake Cortex or enterprise GenAI platforms, including Cortex Agents, Cortex Search, Cortex Analyst, LLM functions, or a comparable enterprise agent or GenAI platform
- Experience building reusable agent solutions, including agent skills, tool integrations, prompts, or automations for repeatable engineering and operations workflows
- Experience with responsible AI operations, including retrieval-augmented generation (RAG) or governed knowledge, evaluation and observability, access controls, human-in-the-loop approvals, and safe production rollout
What Success Looks Like (First 3–6 Months)
- You can independently troubleshoot common ADF/Snowflake/Databricks failures and stabilize recurring issues
- You consistently meet incident response expectations and communicate status clearly
- You deliver at least a few measurable improvements (automation, reduced failures, faster recovery, better monitoring)
- You're a trusted partner to teammates and stakeholders—reliable, proactive, and collaborative
Pay
$30-35/hr
Schedule
12:00 AM – 9:00 AM Central Time (CT), Monday through Friday
Benefits
- Meaningful time off and paid holidays
- 401(k) with a match
- Range of choices for highly subsidized health, dental, and vision coverage
- Adoption and fertility assistance
- Long-term disability
- Yearly $350 reimbursement account for any well-being-related expenses