Engineer II, Gen AI

Responsibilities

Design, implement, and operate production-grade Generative AI and machine learning solutions to support NYU Langone Health's Remote Patient Monitoring initiatives, deploying, monitoring, and optimizing large language models and related services for clinical workflows, patient engagement, and operational use cases.

Skills and Qualifications

• Generative AI
• Large language models
• MLOps
• LLMOps
• Python
• PyTorch
• TensorFlow
• Model fine-tuning
• Prompt engineering
• Retrieval-augmented generation (RAG)
• Vector databases
• Embedding models
• Semantic search
• MLflow
• Kubeflow
• Airflow
• Weights & Biases
• Docker
• Kubernetes
• CI/CD
• Model quantization
• Inference optimization
• Model versioning
• Experiment tracking
• Monitoring and observability
• Data ingestion
• Data preprocessing
• Data validation
• Model evaluation
• High-performance computing (HPC) / clusters (Spark) / compute-intensive apps