#986 - Apache Airflow Consultant
Venon Solutions · Miami, NM · 2 mo ago
ConsultingFull-time
This opportunity is only available for professionals located in Latin America.
About the role
We are seeking an experienced Apache Airflow Consultant to support and optimize mission-critical workflow orchestration platforms in production environments. The ideal candidate has strong expertise in Apache Airflow administration, troubleshooting, and security, along with hands-on experience deploying and maintaining containerized solutions on AWS. This role requires a proactive problem solver who can work directly with clients, resolve complex technical issues within SLA commitments, and collaborate with cross-functional teams to deliver secure, reliable, and scalable data orchestration solutions.
Requirements
- Advanced English level (B2/C1) to ensure fluent communication across teams.
- 4+ years hands-on with Apache Airflow in production (not just used it in a pipeline) — scheduler, executors, DAG lifecycle, backfills.
- Strong troubleshooting of Airflow failures: restart loops, scheduler lag, task queue issues, executor problems, dependency conflicts.
- AWS production experience, specifically ECS on EC2 (containerized Airflow) — sizing, deployment, networking.
- Security hardening: RBAC, secrets backends, TLS, and reducing Airflow's provider surface / CVE footprint.
- Comfortable with CVE triage and vulnerability justification — assessing exploitability, documenting findings for compliance review.
- Python proficiency (Airflow is Python-native; needed to read/debug DAGs and providers).
- Docker/containerization fundamentals.
- Strong written communication — client-facing support with SLA-bound response/resolution.
Strongly Preferred Experience
- Supporting federal / government contractor environments; familiarity with FISMA/NIST 800-53/800-171 concepts (support context, not as a certifier).
- Kubernetes (some clients run Airflow).
- CI/CD, infrastructure-as-code (Terraform/CloudFormation).
- Prior SLA-based support or managed-services experience (vs. pure engineering).
- Monitoring: CloudWatch, Prometheus, Grafana.
Responsibilities
- Manage and support Apache Airflow production environments, ensuring workflow reliability and platform stability.
- Troubleshoot Airflow issues, including scheduler, executor, task queue, and DAG execution failures.
- Deploy and maintain containerized Airflow on AWS ECS (EC2), optimizing performance and availability.
- Implement Airflow security best practices, including RBAC, TLS, secrets management, and CVE risk reduction.
- Assess and document security vulnerabilities (CVEs) to support compliance and remediation efforts.
- Develop, review, and debug Python-based DAGs and Airflow integrations.
- Provide SLA-driven client support, perform root cause analysis, and deliver technical documentation.
- Monitor platform health using CloudWatch, Prometheus, and Grafana, and support CI/CD and Infrastructure as Code practices.
Benefits
- 100% Remote work.
- Competitive salary in USD.
- Paid Holidays: from the Client's calendar (USA).
Schedule
- Full-time CST working hours, fully committed.
Contract
- Type of contract: Independent Contractor with Venon Solutions LLC.
- Contract duration: from 6 months to 1 year, with possibility of renewal.