Lead Data Engineer / Airflow Architect - Orchestration & Integration

About the role

Job Type: W2/C2C • Experience: 9-12 Years • Location: Prosper, Texas

Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.

Responsibilities

• Design and define enterprise Airflow architecture, standards, frameworks, and best practices.
• Architect and develop scalable, reusable, and maintainable Airflow DAGs for complex data workflows.
• Lead the design of ETL/ELT and data integration architectures across multiple enterprise systems.
• Develop robust data pipelines using Python, SQL, and Airflow.
• Design and implement integration patterns for Oracle EBS and other enterprise applications.
• Design pipelines to support high-volume, scalable, and performance-sensitive workloads.
• Establish and improve pipeline observability, including logging, monitoring, metrics, SLA tracking, and operational dashboards.
• Implement data quality and validation frameworks to ensure data accuracy, completeness, and consistency.

Qualifications

• 9-12 years of experience in Data Engineering, Data Integration, ETL, or related areas.
• Strong hands-on expertise with Apache Airflow and enterprise orchestration architecture.
• Proven experience designing and implementing complex, enterprise-scale Airflow DAGs.
• Experience with Oracle EBS integration and enterprise application data flows.
• Experience designing highly scalable, reliable, and fault-tolerant data pipelines.
• Experience implementing data quality and validation mechanisms.
• Hands-on experience with CI/CD practices and source control.
• Experience participating in or leading technical architecture and design reviews.
• Strong programming skills in Python.
• Strong proficiency in SQL and relational databases.
• Strong understanding of ETL/ELT and data integration architecture.
• Strong understanding of database synchronization, data replication, and data movement patterns.
• Strong knowledge of monitoring, observability, logging, alerting, and failure recovery.
• Strong understanding of software engineering principles, design patterns, and development standards.
• Bachelor's degree or equivalent combination of education and experience.