Cloud Engineer II

About the role

We are looking for a Cloud Engineer II to join our team in Philadelphia, Pennsylvania to support a six-week proof of concept project focused on deploying and evaluating open-weight AI coding models in AWS. This role will help validate the feasibility, performance, scalability, and developer experience of an enterprise AI coding assistant solution.

Responsibilities

• Deploy and configure open-weight LLM endpoints in AWS.
• Configure model-serving infrastructure, GPU resources, APIs, routing, monitoring, and logging.
• Integrate AI model endpoints with coding-assistant platforms and developer workflows.
• Build observability dashboards and track latency, throughput, utilization, and reliability metrics.
• Create reusable deployment artifacts, runbooks, and technical documentation.
• Conduct testing, performance analysis, and knowledge-transfer sessions.
• Deliver recommendations and a go/no-go assessment for future enterprise-scale deployment.

Requirements

• 3-5+ years of Cloud Engineering experience.
• Hands-on AWS, Kubernetes, Docker, and API integration experience.
• Experience with infrastructure automation (Terraform, Helm, Kubernetes manifests, or similar).
• Strong experience with monitoring and observability tools such as Grafana and CloudWatch.
• Ability to troubleshoot distributed cloud environments and performance issues.

Qualifications

• Experience with Generative AI, LLMs, or AI infrastructure.
• Familiarity with model-serving platforms such as vLLM, Triton, TGI, or similar.
• Experience supporting GPU-based workloads in AWS.
• Knowledge of OpenAI-compatible APIs and AI-powered developer tools.

Benefits

Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan.