Jobs · Consulting · New Mexico

#986 - Apache Airflow Consultant

Venon Solutions · Miami, NM · 2 mo ago
ConsultingFull-time

This opportunity is only available for professionals located in Latin America.

About the role

We are seeking an experienced Apache Airflow Consultant to support and optimize mission-critical workflow orchestration platforms in production environments. The ideal candidate has strong expertise in Apache Airflow administration, troubleshooting, and security, along with hands-on experience deploying and maintaining containerized solutions on AWS. This role requires a proactive problem solver who can work directly with clients, resolve complex technical issues within SLA commitments, and collaborate with cross-functional teams to deliver secure, reliable, and scalable data orchestration solutions.

Requirements

  • Advanced English level (B2/C1) to ensure fluent communication across teams.
  • 4+ years hands-on with Apache Airflow in production (not just used it in a pipeline) — scheduler, executors, DAG lifecycle, backfills.
  • Strong troubleshooting of Airflow failures: restart loops, scheduler lag, task queue issues, executor problems, dependency conflicts.
  • AWS production experience, specifically ECS on EC2 (containerized Airflow) — sizing, deployment, networking.
  • Security hardening: RBAC, secrets backends, TLS, and reducing Airflow's provider surface / CVE footprint.
  • Comfortable with CVE triage and vulnerability justification — assessing exploitability, documenting findings for compliance review.
  • Python proficiency (Airflow is Python-native; needed to read/debug DAGs and providers).
  • Docker/containerization fundamentals.
  • Strong written communication — client-facing support with SLA-bound response/resolution.

Strongly Preferred Experience

  • Supporting federal / government contractor environments; familiarity with FISMA/NIST 800-53/800-171 concepts (support context, not as a certifier).
  • Kubernetes (some clients run Airflow).
  • CI/CD, infrastructure-as-code (Terraform/CloudFormation).
  • Prior SLA-based support or managed-services experience (vs. pure engineering).
  • Monitoring: CloudWatch, Prometheus, Grafana.

Responsibilities

  • Manage and support Apache Airflow production environments, ensuring workflow reliability and platform stability.
  • Troubleshoot Airflow issues, including scheduler, executor, task queue, and DAG execution failures.
  • Deploy and maintain containerized Airflow on AWS ECS (EC2), optimizing performance and availability.
  • Implement Airflow security best practices, including RBAC, TLS, secrets management, and CVE risk reduction.
  • Assess and document security vulnerabilities (CVEs) to support compliance and remediation efforts.
  • Develop, review, and debug Python-based DAGs and Airflow integrations.
  • Provide SLA-driven client support, perform root cause analysis, and deliver technical documentation.
  • Monitor platform health using CloudWatch, Prometheus, and Grafana, and support CI/CD and Infrastructure as Code practices.

Benefits

  • 100% Remote work.
  • Competitive salary in USD.
  • Paid Holidays: from the Client's calendar (USA).

Schedule

  • Full-time CST working hours, fully committed.

Contract

  • Type of contract: Independent Contractor with Venon Solutions LLC.
  • Contract duration: from 6 months to 1 year, with possibility of renewal.

Similar jobs