Backend Software Engineer - Python & Pipeline Orchestration (Cloud / AI Platform)

Duties and Responsibilities

• Design, build, and maintain backend services and APIs for pipeline orchestration using Python
• Develop and manage end-to-end workflows for Data ingestion, Data processing and transformation, Machine learning training and evaluation, Model deployment, and lifecycle management.
• Build scalable and reliable orchestration systems that integrate with internal data and AI platforms.
• Collaborate with cross-functional teams to enable seamless pipeline execution across services.
• Ensure system performance, scalability, and reliability in a distributed, multi-cloud environment (AWS, GCP)
• Troubleshoot production issues across application, pipeline, and infrastructure layers
• Contribute to system design and architecture decisions for next-generation AI and data platforms.

Requirements and Qualifications

• Strong backend engineering experience with Python (required)
• Experience building APIs and services using frameworks such as Flask, FastAPI, or gRPC
• Hands-on experience working with data pipelines or machine learning pipelines
• Solid understanding of Workflow orchestration concepts, distributed systems, API design, and service architecture
• Familiarity with Kubernetes and containerized environments, Basic understanding of pods, deployments, and services
• Experience deploying or operating applications in Kubernetes environments

Preferred Qualifications

• Experience with orchestration tools such as Apache Airflow or Flyte
• Exposure to ML lifecycle workflows (training, evaluation, deployment)
• Experience with multi-cloud or hybrid cloud architectures
• Familiarity with data platforms, feature stores, or model serving systems
• Strong debugging and troubleshooting skills across logs, monitoring, and distributed systems