Batch Automation

Responsibilities

• Automate and optimize batch workflows using robust Shell scripting and file‑processing techniques.
• Manage secure file transfers using NDM (Connect: Direct) and SFTP, including monitoring, troubleshooting, and operational support.
• Develop scalable PySpark ETL pipelines, ensuring high performance and reliability for large‑scale data processing.
• Implement automation and configuration management using Ansible, following Infrastructure‑as‑Code best practices.
• Collaborate with cross‑functional teams to ensure secure, reliable, and compliant data‑movement operations.

Skills

• Shell Scripting – strong scripting and file‑processing expertise for batch automation and workflow optimization.
• PySpark – hands‑on experience developing scalable, high‑performance, and reliable ETL pipelines for large‑scale datasets.
• NDM (Connect: Direct) – experience managing secure enterprise file transfers, monitoring transfer jobs, and troubleshooting failures.
• SFTP – strong knowledge of secure file‑transfer operations, controls, monitoring, and issue resolution.
• Infrastructure‑as‑Code – experience implementing automation and configuration management using Ansible.
• Operational Excellence – ability to support secure, reliable, and compliant data movement in collaboration with cross‑functional teams.

Qualifications

Bachelor of Computer Science

Pay

Salary range: $100,000 to $135,000 per year.